Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Improve AUC-PR Calculation #8553

Closed
exalate-issue-sync bot opened this issue May 12, 2023 · 2 comments
Closed

Improve AUC-PR Calculation #8553

exalate-issue-sync bot opened this issue May 12, 2023 · 2 comments

Comments

@exalate-issue-sync
Copy link

Improve our AUC-PR calculation which currently uses linear interpolation. The following article states that in the "PR space it is incorrect to linearly interpolate between points" (see: http://pages.cs.wisc.edu/~jdavis/davisgoadrichcamera2.pdf). XGBoost's AUC-PR implementation is more sophisticated (see: https://github.com/dmlc/xgboost/blob/2abe69d7744b4f695ffcf89a6add16233bfc7986/src/metric/rank_metric.cc#L446)

@exalate-issue-sync
Copy link
Author

Michal Kurka commented: Link to a current XGBoost implementation[https://github.com/dmlc/xgboost/blob/master/src/metric/rank_metric.cc#L511|https://github.com/dmlc/xgboost/blob/master/src/metric/rank_metric.cc#L511|smart-link]

@h2o-ops
Copy link
Collaborator

h2o-ops commented May 14, 2023

JIRA Issue Migration Info

Jira Issue: PUBDEV-7087
Assignee: Veronika Maurerová
Reporter: Megan Kurka
State: Resolved
Fix Version: 3.30.0.1
Attachments: N/A
Development PRs: Available

Linked PRs from JIRA

#4433

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant