Skip to content
An open source AutoML toolkit for neural architecture search and hyper-parameter tuning.
Python TypeScript JavaScript CSS Makefile PowerShell Other
Branch: master
Clone or download
chicm-ms Filter prune algo implementation (#1655)
* fpgm pruner pytorch and tensorflow 2.0 implementation
Latest commit 262fabf Nov 15, 2019
Type Name Latest commit message Commit time
Failed to load latest commit information.
.github/ISSUE_TEMPLATE Update (#956) Apr 9, 2019
deployment Refine gitignore (#1642) Nov 4, 2019
docs Filter prune algo implementation (#1655) Nov 15, 2019
examples Filter prune algo implementation (#1655) Nov 15, 2019
src Filter prune algo implementation (#1655) Nov 15, 2019
test Installation test pipeline (#1709) Nov 11, 2019
tools Show experiment name in nnictl experiment list (#1726) Nov 11, 2019
.gitattributes NNI dogfood version 1 Aug 20, 2018
LICENSE Initial commit Jun 1, 2018
Makefile Fix pipeline node version for unittests (#1721) Nov 8, 2019 Rename the pypi package for nni Nov 2, 2018 update Chinese file path as en_US (#764) Feb 26, 2019 Update doc (#1647) Oct 23, 2019 Add Docs for Tuning Systems with NNI (#1715) Nov 11, 2019
_config.yml Set theme jekyll-theme-cayman Feb 11, 2019
azure-pipelines.yml Fix windows pipeline (#1729) Nov 11, 2019
crowdin.yml Chinese translation (#1278) Aug 5, 2019
install.ps1 NNI on Windows for NNI Remote mode (#1073) May 27, 2019 To install the whole nni in an virtual environment (#538) Jan 6, 2019
pylintrc modify pylint rules (#1663) Oct 31, 2019
uninstall.ps1 Remove all whitespace at end of line (#1162) Jun 19, 2019

MIT licensed Build Status Issues Bugs Pull Requests Version Join the chat at Documentation Status


NNI (Neural Network Intelligence) is a toolkit to help users run automated machine learning (AutoML) experiments. The tool dispatches and runs trial jobs generated by tuning algorithms to search the best neural architecture and/or hyper-parameters in different environments like local machine, remote servers and cloud.

NNI v1.1 has been released!  

Frameworks & Libraries Tuning Algorithms Training Services
  • Supported Frameworks
    • PyTorch
    • Keras
    • TensorFlow
    • MXNet
    • Caffe2
    • More...
  • Supported Libraries
    • Scikit-learn
    • XGBoost
    • LightGBM
    • More...
Tuner Assessor

Who should consider using NNI

  • Those who want to try different AutoML algorithms in their training code (model) at their local machine.
  • Those who want to run AutoML trial jobs in different environments to speed up search (e.g. remote servers and cloud).
  • Researchers and data scientists who want to implement their own AutoML algorithms and compare it with other algorithms.
  • ML Platform owners who want to support AutoML in their platform.

Related Projects

Targeting at openness and advancing state-of-art technology, Microsoft Research (MSR) had also released few other open source projects.

  • OpenPAI : an open source platform that provides complete AI model training and resource management capabilities, it is easy to extend and supports on-premise, cloud and hybrid environments in various scale.
  • FrameworkController : an open source general-purpose Kubernetes Pod Controller that orchestrate all kinds of applications on Kubernetes by a single controller.
  • MMdnn : A comprehensive, cross-framework solution to convert, visualize and diagnose deep neural network models. The "MM" in MMdnn stands for model management and "dnn" is an acronym for deep neural network.
  • SPTAG : Space Partition Tree And Graph (SPTAG) is an open source library for large scale vector approximate nearest neighbor search scenario.

We encourage researchers and students leverage these projects to accelerate the AI development and research.

Install & Verify

Install through pip

  • We support Linux, MacOS and Windows (local, remote and pai mode) in current stage, Ubuntu 16.04 or higher, MacOS 10.14.1 along with Windows 10.1809 are tested and supported. Simply run the following pip install in an environment that has python >= 3.5.

Linux and MacOS

python3 -m pip install --upgrade nni


python -m pip install --upgrade nni


  • --user can be added if you want to install NNI in your home directory, which does not require any special privileges.
  • Currently NNI on Windows support local, remote and pai mode. Anaconda or Miniconda is highly recommended to install NNI on Windows.
  • If there is any error like Segmentation fault, please refer to FAQ

Install through source code

  • We support Linux (Ubuntu 16.04 or higher), MacOS (10.14.1) and Windows (10.1809) in our current stage.

Linux and MacOS

  • Run the following commands in an environment that has python >= 3.5, git and wget.
    git clone -b v1.1
    cd nni


  • Run the following commands in an environment that has python >=3.5, git and PowerShell
  git clone -b v1.1
  cd nni
  powershell -ExecutionPolicy Bypass -file install.ps1

For the system requirements of NNI, please refer to Install NNI

For NNI on Windows, please refer to NNI on Windows

Verify install

The following example is an experiment built on TensorFlow. Make sure you have TensorFlow 1.x installed before running it. Note that currently Tensorflow 2.0 is NOT supported.

  • Download the examples via clone the source code.
    git clone -b v1.1

Linux and MacOS

  • Run the MNIST example.
    nnictl create --config nni/examples/trials/mnist/config.yml


  • Run the MNIST example.
    nnictl create --config nni\examples\trials\mnist\config_windows.yml
  • Wait for the message INFO: Successfully started experiment! in the command line. This message indicates that your experiment has been successfully started. You can explore the experiment using the Web UI url.
INFO: Starting restful server...
INFO: Successfully started Restful server!
INFO: Setting local config...
INFO: Successfully set local config!
INFO: Starting experiment...
INFO: Successfully started experiment!
The experiment id is egchD4qy
The Web UI urls are:

You can use these commands to get more information about the experiment
         commands                       description
1. nnictl experiment show        show the information of experiments
2. nnictl trial ls               list all of trial jobs
3. nnictl top                    monitor the status of running experiments
4. nnictl log stderr             show stderr log content
5. nnictl log stdout             show stdout log content
6. nnictl stop                   stop an experiment
7. nnictl trial kill             kill a trial job by id
8. nnictl --help                 get help information about nnictl
  • Open the Web UI url in your browser, you can view detail information of the experiment and all the submitted trial jobs as shown below. Here are more Web UI pages.
drawing drawing


Our primary documentation is at here and is generated from this repository.
Maybe you want to read:

How to



This project welcomes contributions and there are many ways in which you can participate in the project, for example:

Before providing your hacks, you can review the Contributing Instruction to get more information. In addition, we also provide you with the following documents:

External Repositories and References

With authors' permission, we listed a set of NNI usage examples and relevant articles.



The entire codebase is under MIT license

You can’t perform that action at this time.