Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

PSVM giving NaNs for some metrics #8323

Open
exalate-issue-sync bot opened this issue May 11, 2023 · 1 comment
Open

PSVM giving NaNs for some metrics #8323

exalate-issue-sync bot opened this issue May 11, 2023 · 1 comment

Comments

@exalate-issue-sync
Copy link

This issue was found in R with binary classification, but should also be checked in Python too:

{code:r}library(h2o)
h2o.init()
train <- h2o.importFile("https://s3.amazonaws.com/erin-data/higgs/higgs_train_10k.csv")
test <- h2o.importFile("https://s3.amazonaws.com/erin-data/higgs/higgs_test_5k.csv")
y <- "response"
x <- setdiff(names(train), y)

train[,y] <- as.factor(train[,y])
test[,y] <- as.factor(test[,y])
psvm <- h2o.psvm(x = x, y = y, training_frame = train)
h2o.performance(psvm, test){code}

Gives NaNs:

H2OBinomialMetrics: psvm
MSE: 0.43
RMSE: 0.6557439
LogLoss: NaN
Mean Per-Class Error: 0.4269508
AUC: NaN
AUCPR: NaN
Gini: NaN

@h2o-ops
Copy link
Collaborator

h2o-ops commented May 14, 2023

JIRA Issue Migration Info

Jira Issue: PUBDEV-7314
Assignee: Michal Kurka
Reporter: Erin LeDell
State: Open
Fix Version: Backlog
Attachments: N/A
Development PRs: Available

Linked PRs from JIRA

#4341

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant