Iteration Plan for June 2019

[scarlett2018]

This plan captures our work in June. This is a 4 week iteration, and we will ship our June update in in early July. We'll continue work we started in the previous iteration, and we started to pick up items from our roadmap.

Endgame

June 24 25: Code freeze for the endgame
July 1st: Endgame done

The endgame details for this iteration are tracked in June Endgame.

Plan Items

Below is a summary of the top level plan items.

Tuners and Assessors

• Tuner Installation Improvements Tuner Installation Improvements #858 @SparkSnail
• Oneshot example (ENAS, etc.) Oneshot example (ENAS, etc.) #1159 @Crysple
• Add GP Tuner and related doc Add GP Tuner and related doc #1191 @suiguoxin

Training Service

• Multiphase support: @chicm-ms
  • multiphase support PAI mode
  • multiphase refactoring Multiphase refactor and support OpenPAI training service. #1138

Web Portal & User Experience

• trial compare trial compare #1062 @lvybriage
• Enhancement: ability to adjust rendering interval. Enhancement: ability to adjust rendering interval. #1106 @lvybriage
• Command to Delete Experiments. (risk on azure storage) Provide command to delete experiments, so that user can save storage space. #1123 @SparkSnail
• show intermediate results more friendly show intermediate results more friendly #536 @lvybriage

Bug Fixes

• Failed to connect to PAI http code:500 Failed to connect to PAI http code:500 #1076 @demianzhang
• Validate file name in PAI platform Validate file name for PAI platform #1164 @SparkSnail
• fix negative time number in local mode when trial time is short fix negative time number in local mode when trial time is short #1185 @LeonardoWang
• Trial's end time is less than start time in auto gbdt example Trial's end time is less than start time in auto gbdt example #1182; fix negative time number in local mode when trial time is short fix negative time number in local mode when trial time is short #1185; owner: xupu/tester: jiangong.
• hyper-parameter not shown correctly in WebUI when there is only one hyper parameter hyper-parameter not shown correctly in WebUI when there is only one hyper parameter #1192 @lijiao // PR Show default metric in hyper-parameter #1200 xuehui/chengmin

---

Deferred Items

• Intermediate result @suiguoxin
• Add NAS examples as NNI example Add NAS examples as NNI example #1158 @Crysple
• Assign dedicated resources (such as GPU) to Tuner Assign dedicated resources (such as GPU) to Tuner #874 @QuanluZhang
• retrieve the values of the metrics in a programmatic way retrieve the values of the metrics in a programmatic way #868 @chicm-ms
• UX (design only) for retry FAILED trial UX for Resubmit FAILED trial #1180 @lvybriage @yangou1988
• Latest paper for NAS (AutoML blog/analysis) - Add blogs of popular NAS paper  #1160 @suiguoxin / xupu / @Crysple
• investigation - Model compression Support automatic model compression on NNI #876 - xupu
• (Pending for evaluation results) Add a parallel algorithm to improve the performance of TPE with large concurrency Add a parallel algorithm to improve the performance of TPE with large concurrency #1052 @Crysple