[Feature] AutoML/NAS support in Katib

[johnugeorge]

We have an early design arch of AutoML/NAS support in Katib.

Doc link: https://docs.google.com/document/d/1fE5yKG4d1eOC8vXvxNoAiTHErLfkVbvC-i_cArZp9Jo/edit

Please review the design

Related issues:
kubeflow/kubeflow#1074
#24

Contributed by @Akado2009 @DeeperMind @garganubhav @andreyvelich @tremblerz

/cc @YujiOshima @gaocegege @jlewi

[gaocegege]

/cc @ddutta

Awesome! I will take a look soon.

[DeeperMind]

A presentation of our work can be found in https://docs.google.com/presentation/d/1SfcKy7fzHFJZMChodCR1uBN44yX6p6QEkb0gRO0w_JI/edit?usp=sharing

[andreyvelich]

A final Katib-NAS design doc can be found here
https://docs.google.com/document/d/1qGWy-C5XSQmh82XYoMcJ_JWLHwmyvdMRjCkFMfkO0vE/edit

[andreyvelich]

/area nas

[gaocegege]

https://github.com/Microsoft/nni/blob/b6cf7cee0e72671672b7845ab24fcdc5aed9ed48/docs/en_US/GeneralNasInterfaces.md#example-enas-macro-search-space

NNI developed by MSRA has a document about their design decisions on NAS. It is really helpful for us.

Ref microsoft/nni#1049

[richardsliu]

Any more remaining work here?

[andreyvelich]

@richardsliu I think, we can close this issue, since we support NAS in v1alpha1 and v1alpha2.
For any other NAS improvements we can create another issue.

[richardsliu]

/close

[k8s-ci-robot]

@richardsliu: Closing this issue.

In response to this:

/close

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.