-
-
Notifications
You must be signed in to change notification settings - Fork 179
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
🎩 🎸 Class-Based Rank-Based Metrics #786
Conversation
Trigger CI
Trigger CI
So at this point, this PR now defines all of the ranking metrics through classes but only applies a subset of them this way. To finish the job, this PR will have to get quite a bit more complicated. What do you think @mberr? I'm not sure that there are any more meaningful checkpoints between what's already on master and what it will take to finish the job, so maybe we might want to just bite the bullet and rewrite the evaluator's part that handles these |
agreed, let's do this in one PR. |
Trigger CI
Trigger CI
Part 7(?) of the #744 destruction train
It also changes the canonical order of metrics from
metric_name.side.rank_type.k?
toside.rank_type.metric_name.k?
Tasks
RankBasedEvaluator