Iteration Plan for May 2019

[scarlett2018]

This plan captures our work in May. This is a 4 week iteration, and we will ship our May update in in early June. We'll continue work we started in the previous iteration, and we started to pick up items from our roadmap.

Endgame

May 27 28 (to be finalized): Code freeze for the endgame
June 3: Endgame done

The endgame details for this iteration are tracked in May Endgame.

Plan Items

Below is a summary of the top level plan items.

New OS Support

• Support PAI TrainingService on Windows PAI TrainingService on Windows #1051 @SparkSnail
• Remote TrainingService on Windows Remote TrainingService on Windows #1053 @demianzhang

Tuners and Assessors

• Nested search space refinement Nested search space refinement #1028 @leelaylay
• Ability to resume a tuner Ability to replay a tuner #879 @QuanluZhang @Crysple @PurityFan
• Searchspace's type "randint" is better to support lower bound [Improvement] Searchspace's type "randint" is better to support lower bound #902 @xuehui1991
• remind users to install tuner if the tuner is not installed remind users to install tuner if the tuner is not installed #1026 @SparkSnail
• Support SMAC for the feature data import support SMAC for the feature data import #1042 @QuanluZhang
• New Tuner: Design a general and efficient tuner for neural architecture search New Tuner: Design a general and efficient tuner for neural architecture search #870
  * Provide easy-to-use interface for neural architecture search Provide easy-to-use interface for neural architecture search #869 @Crysple

Training Service

• Support Kubeflow TFJob/PyTorchJob v1beta2 [feature request] Support Kubeflow TFJob/PyTorchJob v1beta2 #1033 @SparkSnail @yds05
• Multiple trials on the same GPU Multiple trials on the same GPU #608 @SparkSnail

Web Portal & User Experience

• Improve the design of copying trial's parameters Improve the design of copying trial's parameters #1055 @lvybriage
• Website became very slowly when I run an experiment with many trials Website became very slowly when I run an experiment with many trials #1024 @lvybriage @Crysple

Bug Fixes

• nnimanager handle string type error nnimanager handle string type error #689 @chicm-ms
• The error message is empty when failed to create kubeflow config. [bug] The error message is empty when failed to create kubeflow config. #1036 @SparkSnail @yds05
• bug of state transition in nnimanager bug of state transition in nnimanager #1011 @QuanluZhang
• Fix bugs of table entries and hyper-parameter graph Fix bugs of table entries and hyper-parameter graph #1054 @lvybriage

Docs, Blogs, Samples, Articles

• add an example for Recommenders add an example for Recommenders #957 @Crysple
• add an comparsion of different hyper-parameter tuning algorithm. @leelaylay @xuehui1991

---

Pending Items

N/A

Deferred Items

• [Pending for the clean up resolution] PAI quota management NNI used PAI storage clean up #1050 @SparkSnail
• trial compare trial compare #1062 @lvybriage
• [Pending for evaluation results] Add a parallel algorithm to improve the performance of TPE with large concurrency Add a parallel algorithm to improve the performance of TPE with large concurrency #1052 @PurityFan