Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix classification report for multilabel #150

Merged
merged 1 commit into from Nov 14, 2019
Merged

Conversation

tholor
Copy link
Member

@tholor tholor commented Nov 14, 2019

This fixes #148.

In multilabel classification we evaluate by predicting multihot vectors (ids), whereas in binary classification we predict label values (strings). Therefore, we need to supply different types of lists to the labels arg of sklearn's classification report: list of ids for multilabel vs. list of strings for binary.

Quickfix: distinguishing these cases

Longterm: We might wanna predict also label values (strings) in multilabel classification. However, we then also need to find/implement another classification report

@tholor tholor added bug Something isn't working part: evaluator Evaluator task: Text Classif Text Classification labels Nov 14, 2019
@tholor tholor merged commit b7b87e1 into master Nov 14, 2019
@tholor tholor deleted the fix_multilabel_report branch April 28, 2020 07:30
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working part: evaluator Evaluator task: Text Classif Text Classification
Projects
None yet
Development

Successfully merging this pull request may close these issues.

example doc_classification_multilable throws exception "TypeError: cannot perform reduce with flexible type"
1 participant