Deleting classification

From the Admin menu go to Structure > Taxonomy

Select Settings next to the taxonomy you wish to delete
Click Delete at the bottom.

This will delete the vocabulary as well as all the terms in this vocabulary.