New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
FEA Add support for micro averaging in ovr-roc-auc #24338
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thanks for the PR. Here is some feedback. I think the example should be updated accordingly in a follow-up PR once your already ongoing PR has been reviewed and merged.
Co-authored-by: Olivier Grisel <olivier.grisel@ensta.org>
Co-authored-by: Olivier Grisel <olivier.grisel@ensta.org>
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thanks for the new tests. They are very clean and convincing.
Just a few suggestions to clarify the intent.
Co-authored-by: Olivier Grisel <olivier.grisel@ensta.org>
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM. Thank you, @ArturoAmorQ.
Here are a few minor comments.
Co-authored-by: Julien Jerphanion <git@jjerphan.xyz>
Co-authored-by: Julien Jerphanion <git@jjerphan.xyz>
Thanks for your time and feedback @ogrisel, @jjerphan and @glemaitre. All your comments have been addressed. |
Thank you, @ArturoAmorQ! |
Reference Issues/PRs
Relevant for simplifying #24200.
What does this implement/fix? Explain your changes.
Micro-averaging was not supported for the multiclass
roc_auc_score
. There is no reason for not doing so, as thelabel_binarize
function is run internally.This PR makes micro-averaging
roc_auc_score
accessible to the users without needing an externallabel_binarize
.Any other comments?
I added a test that covers this line of code and as side effect, checks for consistency with chance level.