Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Improve hyperparameter organization #30

Closed
kmax12 opened this issue Aug 25, 2019 · 3 comments
Closed

Improve hyperparameter organization #30

kmax12 opened this issue Aug 25, 2019 · 3 comments
Labels
enhancement An improvement to an existing feature.

Comments

@kmax12
Copy link
Contributor

kmax12 commented Aug 25, 2019

Right now all parameters specified at one level for the whole pipeline. We should break up parameters by step of the pipeline.

This could also be used to improve the output of describe_pipeline

@kmax12 kmax12 changed the title Improve parameter organization Improve hyperparameter organization Aug 25, 2019
@kmax12 kmax12 added the enhancement An improvement to an existing feature. label Aug 25, 2019
@dsherry
Copy link
Contributor

dsherry commented Feb 7, 2020

I want to add a couple more points here which are related to this issue. These just came up in @angela97lin's catboost PR:

  1. We should allow the sub-library to specify intelligent defaults whenever possible. Example: catboost's loss_function and bootstrap_type are both chosen by the library based on certain heuristics. Unless we have a good reason to override those heuristics, we should make use of them, because otherwise we risk negatively impacting performance.
  2. Question: do we need a distinction between a) hyperparameters which automl will search over and b) the list of hyperparameters supported by a particular pipeline? This would be required if we wanted to have automl tuners operate on different sets of hyperparameters, so I guess the real question is whether or not we want to support that. Perhaps that should simply be filed as a future feature.

@dsherry
Copy link
Contributor

dsherry commented Mar 27, 2020

@jeremyliweishih is this a duplicate of #359 ?

@dsherry
Copy link
Contributor

dsherry commented Mar 27, 2020

Closing in favor of #359 and the other tickets we've got tracking hyperparameter improvements

@dsherry dsherry closed this as completed Mar 27, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement An improvement to an existing feature.
Projects
None yet
Development

No branches or pull requests

2 participants