Iteration Plan for July 2019

[suiguoxin]

This plan captures our work in July. This is a 4 week iteration, and we will ship our July update in in early August. We'll continue work we started in the previous iteration, and we started to pick up items from our roadmap.

Endgame

Aug 5: Code freeze for the endgame
Aug 12: Endgame done
Release manager: @suiguoxin

The endgame details for this iteration are tracked in [July Endgame](to be created).

TODO in bug bash

• yarn.lock @liuzhe-lz Eject from react-scripts-ts-antd and bump webui dependencies version #1412
• Add NAS examples as NNI example Add NAS examples as NNI example #1158 @QuanluZhang
• Add blogs of popular NAS paper Add blogs of popular NAS paper  #1160

Docs, Blogs, Samples, Articles

• Update NNI Introduction Board Update NNI Introduction Board #1270 # 1313 @rabbit008
• Add a document similar to naming SupportTrainingService.md Add a document similar to naming SupportTrainingService.md #1370 @rabbit008 @SparkSnail

Plan Items

• Unify nas searchspace Unify nas searchspace #1393 @Crysple
• (check )SMAC don't support quniform type? Check whether SMAC support quniform type or not #1136 @QuanluZhang
• retrieve the values of the metrics in a programmatic way retrieve the values of the metrics in a programmatic way #868 @chicm-ms
• Add a parallel algorithm to improve the performance of TPE with large concurrency Add a parallel algorithm to improve the performance of TPE with large concurrency #1052 [need an option to turn on/off parallel] @xuehui1991 @Crysple
• support multiphase for hyperband PR support multi-phase in hyperband #1257 @QuanluZhang

Tuners and Assessors

• Auto-Feature generator & selection Auto Feature Extraction #877 @baomengjiao @xuehui1991
  • design auto feature interface
  • random tuner or beam search tuner
  • pakdd example

Training Service

• NNI doesn't support private docker registry NNI doesn't support private docker registry #755 @SparkSnail
• get_experiment_id, get_trial_id python API @suiguoxin

Engineering Improvements

• Python wrapper for rest api Python wrapper for rest api #1318(pr) @chicm-ms (need review)
• sometimes CUDA_VISIBLE_DEVICES="-1" is not wanted sometimes CUDA_VISIBLE_DEVICES="-1" is not wanted #1365 @SparkSnail
• Remove outputDir and dataDir configuration in PAI mode Remove outputDir and dataDir in PAI mode #1342 @SparkSnail
• Copy codeDir to logDir when create trial on Kubeflow mode Copy codeDir to logDir when create trial on Kubeflow mode  #1224 @SparkSnail

Web Portal & User Experience

• Can nni show the best metric curve during search progress in WebUI? Can nni show the best metric curve during search progress in WebUI? #1218 @lvybriage (modify)
• Some improvements in webui Some improvements in webui #1210 @lvybriage
  • trial progress(intermediate results count) : as a customized column
• webui not support search parameters value webui not support search parameters value #1208 @lvybriage
• WebUI上显示的metric动态调整下画图的区间 WebUI上显示的metric可以动态调整下画图的区间吗？ #1360 @lvybriage
• Add a detailed documentation link to the nnictl command in the command prompt. Add a detailed documentation link to the nnictl command in the command prompt. #1260 @SparkSnail
• webui nav webui nav  #1230 @lvybriage
• UX improvement for showing Error log UX improvement for showing Error log #1173 @yangou1988 @Ivybriage
• slow rendering of webui slow rendering of webui #590 @LeonardoWang

Docs, Blogs, Samples, Articles

• multi phase doc improvement NAS mode doc improvement #1233 @chicm-ms #pull 1242
• Update the docs structure Update the docs structure #1231 @xuehui1991 pr to review

Bug Fixes

• script for auto-complete @liuzhe-lz
• Fix pipeline issue that it only check exit code of last command in a script. Fix pipeline #1417 @chicm-ms
• quniform fors tuners quniform fors tuners #1377 @suiguoxin
• 'quniform' has different meaning beween GridSearch and other tuner. 'quniform' has different meaning beween GridSearch and other tuner. #1335 @suiguoxin
• "nnictl experiment list" give the status of a "RUNNING" experiment as "INITIALIZED" @SparkSnail
• SMAC cannot be installed if nni is installed in dev mode SMAC cannot be installed if nni is installed in dev mode #1376 @SparkSnail
• 404 links in 0.9 release 404 links in 0.9 release #1236 @leckie-chn
• The filter button of the intermediate result cannot be clicked The filter button of the intermediate result cannot be clicked #1263 @lvybriage
• API "/api/v1/nni/trial-jobs/xxx" doesn't show a trial's all parameters in multiphase experiment API "/api/v1/nni/trial-jobs/xxx" doesn't show a trial's all parameters in multiphase experiment #1258 @chicm-ms
• Succeeded trial doesn't have final result but webui show ×××(FINAL) Succeeded trial doesn't have final result but webui show ×××(FINAL) #1207 @chicm-ms
• IT for nnictl stop @Crysple add IT for nnictl stop  #1298
• fix security warning @chicm-ms
• Hyper-parameter page broken Hyper-parameter page broken #1332 @lvybriage
• Run flake8 tests to find Python syntax errors and undefined names Run flake8 tests to find Python syntax errors and undefined names #1217