Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Implement ask-and-tell interface for DEHB #36

Closed
Bronzila opened this issue Jun 28, 2023 · 1 comment · Fixed by #73
Closed

Implement ask-and-tell interface for DEHB #36

Bronzila opened this issue Jun 28, 2023 · 1 comment · Fixed by #73
Assignees
Labels
enhancement New feature or request refactoring Improving code quality

Comments

@Bronzila
Copy link
Collaborator

Bronzila commented Jun 28, 2023

Similar to SMAC, an ask-and-tell interface would make DEHB more flexible and potentially easier to use.

@Bronzila Bronzila added enhancement New feature or request refactoring Improving code quality labels Jun 28, 2023
@Bronzila Bronzila self-assigned this Aug 17, 2023
@eddiebergman
Copy link
Contributor

eddiebergman commented Sep 8, 2023

Some extra comments thinking out it's use case. SMAC has some hidden bugs as ask() and tell() was sort of put in but not planned out for non-default use cases.

  • If I tell() many times before starting optimization, these results are used.
    • Makes warmstarting any optimizer with tell() trivial.
  • If I tell() during optimization but with a result that was not suggested by DEHB, how should it be used. What happens to the population? What if it's not in a fidelity bracket DEHB is aware of? If there's no good idea, better to explicitly error then.
    • Can share information between concurrent optimizers or self experimentation.
  • If I ask() twice without any internal update, will I get the same suggestion? Can I get two different suggestions for better parallelization?
    • xs = [ask(), ask()] -> Two same suggestions
    • xs = ask(2) -> Two different suggestions

@Bronzila Bronzila linked a pull request Mar 10, 2024 that will close this issue
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request refactoring Improving code quality
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants