Unity ML-Agents (Beta)

Unity Machine Learning Agents (ML-Agents) is an open-source Unity plugin that enables games and simulations to serve as environments for training intelligent agents. Agents can be trained using reinforcement learning, imitation learning, neuroevolution, or other machine learning methods through a simple-to-use Python API. We also provide implementations (based on TensorFlow) of state-of-the-art algorithms to enable game developers and hobbyists to easily train intelligent agents for 2D, 3D and VR/AR games. These trained agents can be used for multiple purposes, including controlling NPC behavior (in a variety of settings such as multi-agent and adversarial), automated testing of game builds and evaluating different game design decisions pre-release. ML-Agents is mutually beneficial for both game developers and AI researchers as it provides a central platform where advances in AI can be evaluated on Unity’s rich environments and then made accessible to the wider research and game developer communities.

Features

• Unity environment control from Python
• 10+ sample Unity environments
• Support for multiple environment configurations and training scenarios
• Train memory-enhanced Agents using deep reinforcement learning
• Easily definable Curriculum Learning scenarios
• Broadcasting of Agent behavior for supervised learning
• Built-in support for Imitation Learning
• Flexible Agent control with On Demand Decision Making
• Visualizing network outputs within the environment
• Simplified set-up with Docker

Documentation and References

For more information, in addition to installation and usage instructions, see our documentation home. If you have used a version of ML-Agents prior to v0.3, we strongly recommend our guide on migrating to v0.3.

We have also published a series of blog posts that are relevant for ML-Agents:

• Overviewing reinforcement learning concepts (multi-armed bandit and Q-learning)
• Using Machine Learning Agents in a real game: a beginner’s guide
• Post announcing the winners of our first ML-Agents Challenge
• Post overviewing how Unity can be leveraged as a simulator to design safer cities.

In addition to our own documentation, here are some additional, relevant articles:

• Unity AI - Unity 3D Artificial Intelligence
• A Game Developer Learns Machine Learning
• Explore Unity Technologies ML-Agents Exclusively on Intel Architecture

Community and Feedback

ML-Agents is an open-source project and we encourage and welcome contributions. If you wish to contribute, be sure to review our contribution guidelines and code of conduct.

You can connect with us and the broader community through Unity Connect and GitHub:

• Join our Unity Machine Learning Channel to connect with others using ML-Agents and Unity developers enthusiastic about machine learning. We use that channel to surface updates regarding ML-Agents (and, more broadly, machine learning in games).
• If you run into any problems using ML-Agents, submit an issue and make sure to include as much detail as possible.

For any other questions or feedback, connect directly with the ML-Agents team at ml-agents@unity3d.com.

Translation

• Chinese

License

Apache License 2.0