Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add parameter sweep to learning rate and batch size #708

Merged
merged 2 commits into from
Apr 27, 2016

Conversation

jmancewicz
Copy link
Contributor

@jmancewicz jmancewicz commented Apr 26, 2016

Adding the ability to sweep Batch Size and Learning Rate. Their entry fields now accept multiple values.

image

image

Each permutation of the swept fields will generate one job. With Batch Size [1,2] and Learning Rate [0.01, 0.015, 0.02], six jobs will be created. The job names are augmented by the swept field value. When multiple jobs are launched, the page is redirected to the home page rather than a job page.

image

If you were to clone one of these jobs, it will only have the values of that particular job. The clone data is saved per job.

@lukeyeager
Copy link
Member

Looks great, thanks for the screenshots!

At first glance, the code works great and looks to be written well - no complaints!

Let's add a simple test so we don't break it in the future and I think we're good to go. @gheinrich do you want to take a look too?

@jmancewicz
Copy link
Contributor Author

Added tests

@lukeyeager
Copy link
Member

Tests look good (despite the fact that TravisCI can't complete before the time limit 😠).

Thanks for the great work!

@lukeyeager lukeyeager merged commit 6f7ca8b into NVIDIA:master Apr 27, 2016
SlipknotTN pushed a commit to cynnyx/DIGITS that referenced this pull request Mar 30, 2017
Add parameter sweep to learning rate and batch size
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants