Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: integrate ray tune to hyperopt #1001

Merged
merged 25 commits into from
Feb 1, 2021

Conversation

kaushikb11
Copy link
Contributor

@kaushikb11 kaushikb11 commented Nov 8, 2020

Description

The motivation for this Pull Request is to integrate Ray Tune with Ludwig's Hyperopt design. This will support the samplers provided by Ray Tune by using the RayTuneExecutor.

Resource Allocation, support for Search Algorithms & Trial Schedulers, tests & docs.

Example Config for RayTuneExecutor

hyperopt:
  sampler:
    type: ray
    search_alg:
      type: bayesopt
	num_samples: 2
  executor:
    type: ray
    cpu_resources_per_trial: 2
	gpu_resources_per_trial: 1
  parameters:
    training.learning_rate:
      space: uniform
      lower: 0.001
      upper: 0.1
    combiner.num_fc_layers:
      space: qrandint
      lower: 2
      upper: 6
      q: 2
    utterance.cell_type:
      space: grid_search
      values: [rnn, gru, lstm]
  goal: minimize

ludwig/hyperopt/ray.py Outdated Show resolved Hide resolved
@tgaddair
Copy link
Collaborator

tgaddair commented Nov 8, 2020

Sweet!

cc @richardliaw

@richardliaw
Copy link

this is awesome! I'll take a look later.

@kaushikb11 kaushikb11 marked this pull request as ready for review November 11, 2020 15:57
@kaushikb11 kaushikb11 marked this pull request as draft November 11, 2020 17:25
@kaushikb11 kaushikb11 marked this pull request as ready for review November 12, 2020 17:23
ludwig/hyperopt/execution.py Outdated Show resolved Hide resolved
ludwig/hyperopt/sampling.py Outdated Show resolved Hide resolved
@kaushikb11 kaushikb11 marked this pull request as ready for review December 4, 2020 18:03
@w4nderlust w4nderlust merged commit 8d2ce05 into ludwig-ai:master Feb 1, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

4 participants