Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add R/Python examples to metrics in Performance and Prediction section #8784

Closed
exalate-issue-sync bot opened this issue May 12, 2023 · 4 comments
Closed
Assignees

Comments

@exalate-issue-sync
Copy link

In the Performance and Prediction chapter in the h2o-3 user guide, we include examples for Prediction functions. We should also include R and Python examples for the Metrics functions. The examples would be similar to what you are creating in PUBDEV-6712.

Some of theses may be dependent on PUBDEV-6366 to be fixed first (#3842).

@exalate-issue-sync
Copy link
Author

hannah.tillman commented: For AUCPR, RMSLE, and MAE I keep getting the error that gbm/glm/xgboost has no attribute AUCPR/RMSLE/MAE; cannot seem to get them to work in python or r. Using h2o-3.26.0.4782.

I have found examples of them in github, but it’s as stopping_metrics ([https://github.com/h2oai/h2o-3/blob/760e634f7668c329de2dcb1b2767cb762ec33313/h2o-py/tests/testdir_jira/pyunit_pubdev_6684_AUCPR_early_stop.py|https://github.com/h2oai/h2o-3/blob/760e634f7668c329de2dcb1b2767cb762ec33313/h2o-py/tests/testdir_jira/pyunit_pubdev_6684_AUCPR_early_stop.py|smart-link] ← as an example) or as part of a list of metrics--not much help.

@exalate-issue-sync
Copy link
Author

Angela Bartz commented: AUCPR currently being replaced with PR_AUC. Other issues should use regression models.

@exalate-issue-sync
Copy link
Author

Angela Bartz commented: Pull request merged into master.

@h2o-ops
Copy link
Collaborator

h2o-ops commented May 14, 2023

JIRA Issue Migration Info

Jira Issue: PUBDEV-6849
Assignee: hannah.tillman
Reporter: Angela Bartz
State: Resolved
Fix Version: 3.28.0.1
Attachments: N/A
Development PRs: Available

Linked PRs from JIRA

#3884

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants