Skip to content
This repository has been archived by the owner on Nov 14, 2023. It is now read-only.

Metric names issue tune_sklearn.tune_basesearch.TuneBaseSearchCV._format_results #116

Closed
zhu0619 opened this issue Oct 9, 2020 · 1 comment

Comments

@zhu0619
Copy link

zhu0619 commented Oct 9, 2020

In tune_sklearn/tune_basesearch.py:603, the way to get the column names of the given metric names aren't robust for customized scoring function and metric name, see below
df[[ col for col in dfs[0].columns if "split" in col and "test_%s" % name in col ]].to_numpy() for df in finished
If metric names are 'metric 1', 'metric 11', the result of metric 11 will also be added in 'metric 1'.
In this case, maybe use col.endswith("test_%s" % name) is better.

@richardliaw
Copy link
Collaborator

Seems to be a duplicate of #117 ?

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants