You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
We should add a new column to the binary classification leaderboard, "aucpr". The stopping_metric and sort_metric option should be "AUCPR" (with support for lowercase on the backend).
Updates should also be made to the automl.rst user guide file to reflect the changes.
The text was updated successfully, but these errors were encountered:
Sebastien Poirier commented: [~accountid:557058:afd6e9a4-1891-4845-98ea-b5d34a2bc42c] any wish for the default position of {{aucpr}} in the leaderboard (meaning, when it’s not used as a sort metric).
Current default columns are in this order:
{{{"auc", "logloss", "mean_per_class_error", "rmse", "mse"}}}
Sebastien Poirier commented: [~accountid:557058:afd6e9a4-1891-4845-98ea-b5d34a2bc42c] Also for regression, leaderboard default sorting metric for regression is {{mean_residual_deviance}} (a.k.a {{residual_deviance}} in GLM, a.k.a {{deviance}} when used as metric input name: [http://docs.h2o.ai/h2o/latest-stable/h2o-docs/data-science/algo-params/stopping_metric.html|http://docs.h2o.ai/h2o/latest-stable/h2o-docs/data-science/algo-params/stopping_metric.html]).
I suggest to also display it as {{deviance}} in leaderboard. OK with this?
We should add a new column to the binary classification leaderboard, "aucpr". The stopping_metric and sort_metric option should be "AUCPR" (with support for lowercase on the backend).
Updates should also be made to the automl.rst user guide file to reflect the changes.
The text was updated successfully, but these errors were encountered: