Skip to content
Unity Machine Learning Agents Toolkit
C# Python Jupyter Notebook HLSL Dockerfile Batchfile
Branch: master
Clone or download
Type Name Latest commit message Commit time
Failed to load latest commit information.
.circleci remove codacy (#2287) Jul 18, 2019
.github/ISSUE_TEMPLATE Add console log section to Bug Report form (#2566) Sep 17, 2019
UnitySDK fix BananaIL scene (#2512) Sep 9, 2019
config Fix docs for Generalization (#2334) Jul 26, 2019
demos GAIL and Pretraining (#2118) Jul 16, 2019
docs Updated the comment for —multi-gpu option. Aug 28, 2019
gym-unity new versions (#2504) Sep 6, 2019
ml-agents-envs new versions (#2504) Sep 6, 2019
ml-agents Add more extensive tests for BC trainer (#2506) Sep 9, 2019
notebooks Release v0.5 (#1202) Sep 11, 2018
protobuf-definitions Merge branch 'develop' into protobuf_update Jun 27, 2019
unity-volume [containerization] CPU based containerization to support all environm… Feb 22, 2018
utils Use pre-commit for CI tests, add black hook (#2163) Jun 25, 2019
.gitattributes Develop communicator redesign (#638) May 24, 2018
.gitignore enforce a min % of code coverage Jul 15, 2019
.pre-commit-config.yaml update mypy version Jul 18, 2019 Release v0.5 (Develop) (#1203) Sep 11, 2018 Update to include CLA language (#2195) Jun 26, 2019
Dockerfile Install dependencies for ml-agents-envs and ml-agents in Docker (#1895) Apr 4, 2019
LICENSE Revert "Release v0.5 (#1202)" (#1221) Sep 12, 2018 Fix docs for Generalization (#2334) Jul 26, 2019 Help us know about you by filling out the survey at… Nov 30, 2018
setup.cfg Merge remote-tracking branch 'origin/develop' into enable-flake8 Jul 18, 2019

Unity ML-Agents Toolkit (Beta)

docs badge license badge

The Unity Machine Learning Agents Toolkit (ML-Agents) is an open-source Unity plugin that enables games and simulations to serve as environments for training intelligent agents. Agents can be trained using reinforcement learning, imitation learning, neuroevolution, or other machine learning methods through a simple-to-use Python API. We also provide implementations (based on TensorFlow) of state-of-the-art algorithms to enable game developers and hobbyists to easily train intelligent agents for 2D, 3D and VR/AR games. These trained agents can be used for multiple purposes, including controlling NPC behavior (in a variety of settings such as multi-agent and adversarial), automated testing of game builds and evaluating different game design decisions pre-release. The ML-Agents toolkit is mutually beneficial for both game developers and AI researchers as it provides a central platform where advances in AI can be evaluated on Unity’s rich environments and then made accessible to the wider research and game developer communities.


  • Unity environment control from Python
  • 10+ sample Unity environments
  • Support for multiple environment configurations and training scenarios
  • Train memory-enhanced agents using deep reinforcement learning
  • Easily definable Curriculum Learning and Generalization scenarios
  • Broadcasting of agent behavior for supervised learning
  • Built-in support for Imitation Learning
  • Flexible agent control with On Demand Decision Making
  • Visualizing network outputs within the environment
  • Simplified set-up with Docker
  • Wrap learning environments as a gym
  • Utilizes the Unity Inference Engine
  • Train using concurrent Unity environment instances


Additional Resources

We have published a series of blog posts that are relevant for ML-Agents:

In addition to our own documentation, here are some additional, relevant articles:

Community and Feedback

The ML-Agents toolkit is an open-source project and we encourage and welcome contributions. If you wish to contribute, be sure to review our contribution guidelines and code of conduct.

If you run into any problems using the ML-Agents toolkit, submit an issue and make sure to include as much detail as possible.

Your opinion matters a great deal to us. Only by hearing your thoughts on the Unity ML-Agents Toolkit can we continue to improve and grow. Please take a few minutes to let us know about it.

For any other questions or feedback, connect directly with the ML-Agents team at


To make the Unity ML-Agents toolkit accessible to the global research and Unity developer communities, we're attempting to create and maintain translations of our documentation. We've started with translating a subset of the documentation to one language (Chinese), but we hope to continue translating more pages and to other languages. Consequently, we welcome any enhancements and improvements from the community.


Apache License 2.0


If you use Unity or the ML-Agents Toolkit to conduct research, we ask that you cite the following paper as a reference:

Juliani, A., Berges, V., Vckay, E., Gao, Y., Henry, H., Mattar, M., Lange, D. (2018). Unity: A General Platform for Intelligent Agents. arXiv preprint arXiv:1809.02627.

You can’t perform that action at this time.