You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
When a user tries to call fit on a model that contains Choice at any level (can be nested), raise an exception. Also point to the correct method (see 4.).
Add new method fit_by_exhaustive_search to Classifier and subclasses with parameter:
optimization_metric: The metric to use to find the best model. It should have type ClassifierMetric, which is an enum with one value for each classifier metric we have available:
Add new method fit_by_exhaustive_search to Regressor and subclasses with parameter:
optimization_metric: The metric to use to find the best model. It should have type RegressorMetric, which is an enum with one value for each regressor metric we have available:
Both of those methods should then collect the Choices inside of the model and its children, and for each possible setting create a model without choices, fit this, and compute the listed metric on it. It should then keep track of the best (fitted) model according to the metric and return it at the end. GridSearchCV of scikit-learn can be useful for this.
The text was updated successfully, but these errors were encountered:
Is your feature request related to a problem?
Finding appropriate values for hyperparameters by hand is tedious. There should be automation to try different combinations of values.
Desired solution
T
it should also be possible to pass aChoice[T]
(see feat: addChoice
class for possible values of hyperparameter #325). Example:fit
on a model that containsChoice
at any level (can be nested), raise an exception. Also point to the correct method (see 4.).fit_by_exhaustive_search
toClassifier
and subclasses with parameter:optimization_metric
: The metric to use to find the best model. It should have typeClassifierMetric
, which is an enum with one value for each classifier metric we have available:fit_by_exhaustive_search
toRegressor
and subclasses with parameter:optimization_metric
: The metric to use to find the best model. It should have typeRegressorMetric
, which is an enum with one value for each regressor metric we have available:Choice
s inside of the model and its children, and for each possible setting create a model without choices, fit this, and compute the listed metric on it. It should then keep track of the best (fitted) model according to the metric and return it at the end.GridSearchCV
ofscikit-learn
can be useful for this.The text was updated successfully, but these errors were encountered: