Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

HEBO suggests the same parameters multiple times #28

Closed
qo4on opened this issue May 13, 2021 · 4 comments
Closed

HEBO suggests the same parameters multiple times #28

qo4on opened this issue May 13, 2021 · 4 comments

Comments

@qo4on
Copy link

qo4on commented May 13, 2021

Why does opt.suggest suggest the same parameters multiple times?

space_cfg = [
    {'name': 'n_estimators',     'type': 'int', 'lb': 20, 'ub': 21},
    {'name': 'max_depth',        'type': 'int', 'lb': 2, 'ub': 3},
]
{'n_estimators': 20, 'max_depth': 2}
{'n_estimators': 20, 'max_depth': 2}
{'n_estimators': 21, 'max_depth': 2}
{'n_estimators': 20, 'max_depth': 3}
The value argument must be within the support

HEBO suggests {'n_estimators': 20, 'max_depth': 2} twice and throws an error while there is one hp configuration remains untested: {'n_estimators': 21, 'max_depth': 3}.

@Alaya-in-Matrix
Copy link
Collaborator

It seems that the search space is so small (2 * 2 = 4), so that HEBO has enumerated all possible combination

@qo4on
Copy link
Author

qo4on commented May 17, 2021

I believe this is incorrect behavior. @smcdonagh, @iamhankai please take a look at this.

@smcdonagh
Copy link
Collaborator

Hi @qo4on -- I am not part of the HEBO project, apologies.

@alexanderimanicowenrivers
Copy link
Collaborator

@qo4on This is correct behaviour and I will close this issue. If you look at your design space you only have two variables for n_estimators (20, 21) and two for max_depth (2,3) so there's going to be expected overlap, typical search spaces are much larger.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants