Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Use total experiment time limit #12

Closed
mfeurer opened this issue Jan 22, 2014 · 2 comments
Closed

Use total experiment time limit #12

mfeurer opened this issue Jan 22, 2014 · 2 comments
Assignees
@mfeurer
Labels
feature request
Milestone
Version 0.1.0rc1

Comments

@mfeurer
Copy link
Contributor

mfeurer commented Jan 22, 2014

Right now it is not possible to have an experiment time limit, e.g. to reproduce the AutoWEKA experiment. We did the AutoWEKA experiments on a grid machine with a wall time limit of 30 hours.
@mfeurer mfeurer self-assigned this Mar 3, 2014
@mfeurer
Copy link
Contributor Author

mfeurer commented Mar 3, 2014

We can easily add the management for the total time limit here. But if we only exit the runsolver_wrapper, how does the optimizer (SMAC, TPE or spearmint) know that we are done?

@mfeurer mfeurer removed their assignment Mar 3, 2014
@mfeurer
Copy link
Contributor Author

mfeurer commented Mar 3, 2014

Discussed this issue with @KEggensperger . We decided that we kill the optimizer from the wrapping.py script. The approximate location to do so is here

@mfeurer mfeurer self-assigned this Mar 5, 2014
mfeurer added a commit that referenced this issue Mar 7, 2014
@mfeurer
ENHANCEMENT: #12 total_time_limit is now enforced
f47ac4b
mfeurer added a commit that referenced this issue Mar 7, 2014
@mfeurer
REFACTOR: adapted optimizers for #12
d9c5092 
TPE now changes the working directory itself
TPE now doesn't rely on the config key algorithm any more
Spearmint now calls HPOlib.cv instead of cv for the experiments
REMOVED an update of the python path in wrapping.py
@mfeurer mfeurer closed this as completed Mar 7, 2014
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@mfeurer mfeurer

Labels
feature request
Projects
None yet
Milestone
Version 0.1.0rc1
Development

No branches or pull requests
1 participant
@mfeurer