To 'Delete a Product Category', from the store dashboard go to:
> Products > Product Categories

From within this page on the right hand side, hover your cursor over a 'Product Category' that you'd like to delete, and click 'Delete'.
(*Don't forget to click 'Save Changes' after making alterations*)