Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Auto-suggest domains with better encoding #380

Closed
mseeger opened this issue Oct 13, 2022 · 1 comment · Fixed by #741
Closed

Auto-suggest domains with better encoding #380

mseeger opened this issue Oct 13, 2022 · 1 comment · Fixed by #741
Labels
enhancement New feature or request good first issue Good for newcomers

Comments

@mseeger
Copy link
Collaborator

mseeger commented Oct 13, 2022

Syne Tune provides a number of data types for hyperparameters:

https://github.com/awslabs/syne-tune/blob/main/syne_tune/config_space.py

Some of them are for finite ranges: choice, finrange, logfinrange, ordinal, logordinal.

For numerical values, users often choose choice even though one of the others would be more appropriate, and lead to better results with Bayesian optimization.

The goal of this task is to provide recommendations when choice is used, on what could be a better type. For now, this would simply just be printed, but in the future. Upon call of choice(categories), the recommender would check whether the value type is int or float. If so:

  • categories not sorted increasing order? Print message
  • If sorted increasing order? Check whether equispaced. If so, recommend finrange. Check whether equispaced in log. If so, recommend logfinrange
  • Advanced. If increasing, but not equispaced. Recommend ordinal(kind="nn") or logordinal, depending on spacing closer to equal in normal or log domain. Also logordinal requires positive values

This task does not require internal knowledge about Syne Tune, and it would simplify adoption.

@mseeger
Copy link
Collaborator Author

mseeger commented Jul 8, 2023

Dealt with by #741

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request good first issue Good for newcomers
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant