Skip to content

Latest commit

 

History

History
16 lines (12 loc) · 648 Bytes

one_shot_nas.rst

File metadata and controls

16 lines (12 loc) · 648 Bytes

One-shot NAS

One-shot NAS algorithms leverage weight sharing among models in neural architecture search space to train a supernet, and use this supernet to guide the selection of better models. This type of algorihtms greatly reduces computational resource compared to independently training each model from scratch (which we call "Multi-trial NAS"). NNI has supported many popular One-shot NAS algorithms as following.

Run One-shot NAS <OneshotTrainer> ENAS <ENAS> DARTS <DARTS> SPOS <SPOS> ProxylessNAS <Proxylessnas> FBNet <FBNet> Customize one-shot NAS <WriteOneshot>