Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

AUCPR is now an available stopping metric for AutoML and additional AutoML doc updates #8498

Closed
exalate-issue-sync bot opened this issue May 12, 2023 · 2 comments
Assignees

Comments

@exalate-issue-sync
Copy link

Add "aucpr" to list of Optional Miscellaneous Parameters here:
[https://github.com/h2oai/h2o-3/blob/master/h2o-docs/src/product/automl.rst#optional-miscellaneous-parameters|https://github.com/h2oai/h2o-3/blob/master/h2o-docs/src/product/automl.rst#optional-miscellaneous-parameters]

Remove (Note available for AutoML) here:
[https://github.com/h2oai/h2o-3/blob/master/h2o-docs/src/product/data-science/algo-params/stopping_metric.rst#description|https://github.com/h2oai/h2o-3/blob/master/h2o-docs/src/product/data-science/algo-params/stopping_metric.rst#description]

Another fix due to PUBDEV-6737:
Add monotone_constraints to list of AutoML parameters.
Update the following topics:

  • [https://github.com/h2oai/h2o-3/blob/master/h2o-docs/src/product/automl.rst#optional-miscellaneous-parameters|https://github.com/h2oai/h2o-3/blob/master/h2o-docs/src/product/automl.rst#optional-miscellaneous-parameters]
  • [https://github.com/h2oai/h2o-3/blob/master/h2o-docs/src/product/data-science/algo-params/monotone_constraints.rst#monotone_constraints|https://github.com/h2oai/h2o-3/blob/master/h2o-docs/src/product/data-science/algo-params/monotone_constraints.rst#monotone_constraints]

Another fix due to PUBDEV-6840:
Add modeling_plan option to the list of AutoML parameters.
Update the following topic:

  • [https://github.com/h2oai/h2o-3/blob/master/h2o-docs/src/product/automl.rst#optional-miscellaneous-parameters|https://github.com/h2oai/h2o-3/blob/master/h2o-docs/src/product/automl.rst#optional-miscellaneous-parameters]

A description of that option is available here: [https://github.com//pull/3867/files#diff-8989176adf3a0a599b73b2fcdf0c6a4e|https://github.com//pull/3867/files#diff-8989176adf3a0a599b73b2fcdf0c6a4e]

Another fix due to PUBDDEV-7072.
"AUCPR" is now an available sort metric. Update the following topics:

  • [https://github.com/h2oai/h2o-3/blob/master/h2o-docs/src/product/data-science/algo-params/sort_metric.rst|https://github.com/h2oai/h2o-3/blob/master/h2o-docs/src/product/data-science/algo-params/sort_metric.rst]
  • [https://github.com/h2oai/h2o-3/blob/master/h2o-docs/src/product/automl.rst#optional-miscellaneous-parameters|https://github.com/h2oai/h2o-3/blob/master/h2o-docs/src/product/automl.rst#optional-miscellaneous-parameters]

Also just saw this in Seb's blog post update:
"max_runtime_secs: changed defaults to 0 (no limit), dynamically set to 1h if none of max_runtime_secs and max_models are specified by user."
(for reference: https://0xdata.atlassian.net/wiki/spaces/H2O/pages/1557954682/Draft+of+H2O+3.28.0.1+Release+Blogpost)

@exalate-issue-sync
Copy link
Author

Angela Bartz commented: Pull request merged into master.

@h2o-ops
Copy link
Collaborator

h2o-ops commented May 14, 2023

JIRA Issue Migration Info

Jira Issue: PUBDEV-7141
Assignee: hannah.tillman
Reporter: Angela Bartz
State: Closed
Fix Version: 3.28.0.1
Attachments: N/A
Development PRs: Available

Linked PRs from JIRA

#4144
#4153

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants