Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Experiment groups with only discrete spaces and larger number of experiments requested don't create experiments #193

Closed
mmourafiq opened this issue Oct 3, 2018 · 1 comment
Assignees
Labels

Comments

@mmourafiq
Copy link
Contributor

mmourafiq commented Oct 3, 2018

Describe the bug

Hi All, Has anyone had issues with deploying a group of experiments in a hp tunning fashion which deployed ok and stated to be "running" but there are no experiments in the "Experiments" tab?

We had to restart rabbitmq to be able to start new groups

To Reproduce

Start an experiment group with the following polyaxonfile.

hptuning:
  concurrency: 10
  random_search:
    n_experiments: 10

  matrix:
    dropout:
      values: [0.25, 0.3]
    activation:
      values: [relu, sigmoid]

Expected behavior

Polyaxon should start the group with the maximum possible experiments (total space) without trying to sample more experiments than possible, ideally, a check should be in place when only discrete values are passed.

This behavior impacts the whole hptuning service, so no more groups are created, because all CPU is consumed by the sampling.

@mmourafiq mmourafiq added the bug label Oct 3, 2018
@mmourafiq mmourafiq self-assigned this Oct 3, 2018
@mmourafiq mmourafiq changed the title Experiment groups with only discrete spaces and larger number of XPs requested don't create experiments Experiment groups with only discrete spaces and larger number of experiments requested don't create experiments Oct 3, 2018
@mmourafiq
Copy link
Contributor Author

Will be part of 0.2.7

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

1 participant