Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add Ability to Calculate Performance Metrics on any predictions (incl. calibrated) #9209

Closed
exalate-issue-sync bot opened this issue May 12, 2023 · 2 comments
Closed

Add Ability to Calculate Performance Metrics on any predictions (incl. calibrated) #9209

exalate-issue-sync bot opened this issue May 12, 2023 · 2 comments
Labels
fixVersion/3.30.0.2

Comments

@exalate-issue-sync
Copy link

We offer Platt Scaling but it is not possible to calculate performance metrics on the calibrated predictions. Can we add the ability to also see performance like logloss, auc, etc on the calibrated predictions?
@exalate-issue-sync
Copy link
Author

Michal Kurka commented: h2o.make_metrics serves this purpose, however, it doesn’t allow to use weights. I will add support for weights in this ticket.

@h2o-ops
Copy link
Collaborator

h2o-ops commented May 15, 2023

JIRA Issue Migration Info

Jira Issue: PUBDEV-6417
Assignee: Michal Kurka
Reporter: Megan Kurka
State: Resolved
Fix Version: 3.30.0.2
Attachments: N/A
Development PRs: Available

Linked PRs from JIRA

#3742
#4543

@h2o-ops h2o-ops closed this as completed May 15, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
fixVersion/3.30.0.2
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@h2o-ops