Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

HPO experiments management web dashboard #3100

Closed
jyh2986 opened this issue Nov 19, 2020 · 2 comments
Closed

HPO experiments management web dashboard #3100

jyh2986 opened this issue Nov 19, 2020 · 2 comments

Comments

@jyh2986
Copy link
Contributor

jyh2986 commented Nov 19, 2020

What would you like to be added:
Web dashboard for managing all experiments

Why is this needed:
Command line interface is supported to manage experiments (list, view, resume, etc.)
However, this interface is uncomfortable to handle experiments result.

Without this feature, how does current nni work
Here is the example to resume some experiment,

  1. listing all experiment IDs using "nnictl experiment view --all"
  2. find exact experiment by printing configs using "nnictl experiment config show [ID]"
  3. resume/view experiment using "nnictl view [ID] --port xxx"

It is very difficult to find exact experiment if there are many experiments using CLI.

Brief description of your proposal if any:
Web dashboard manages all experiments (include stopped, running exps)
Here are features for new dashboard
* Listing all experiment: show status, port, start/end time, etc.
* Manage experiments: stop, delete, view, resume, show config
* Editing exp config: rename exp name

@J-shang
Copy link
Contributor

J-shang commented Nov 20, 2020

Thanks for your issue. The good news is showing all experiments information on web dashboard will release in v2.0. And experiment management is in the supporting plan. If you have any other good suggestions, please feel free to let us know.

@kvartet
Copy link
Contributor

kvartet commented Jun 10, 2021

We had supported this feature partially in NNI v2.0 and will enhance it continuously, feel free to offer more suggestions. Thank you again!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

4 participants