Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Change warn to info when weights are not present during validation/test dataset scoring #6843

Open
exalate-issue-sync bot opened this issue May 11, 2023 · 3 comments
Assignees

Comments

@exalate-issue-sync
Copy link

No description provided.

@exalate-issue-sync
Copy link
Author

Wendy Wong commented: This is not so simple. When a user provides a training dataset with weights, but provides a test/validation dataset without weights, they should receive a warning that they are not getting weighted metrics and all rows are considered equal. If this is what they want, they can just ignore the warning.

This warning gets to be incorrect when there is cross validation and a validation dataset is provided. In this case, the weight column is internally generated by H2O-3 to divide up the training datasets into folds. This has nothing to do with weighted training. In this case, no warning should be generated.

@h2o-ops
Copy link
Collaborator

h2o-ops commented May 14, 2023

JIRA Issue Details

Jira Issue: PUBDEV-9085
Assignee: Wendy Wong
Reporter: Wendy Wong
State: In Progress
Fix Version: 3.42.0.1
Attachments: N/A
Development PRs: Available

@h2o-ops
Copy link
Collaborator

h2o-ops commented May 14, 2023

Linked PRs from JIRA

#6841

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants