Unity ML-Agents (Beta)

Unity Machine Learning Agents (ML-Agents) is an open-source Unity plugin that enables games and simulations to serve as environments for training intelligent agents. Agents can be trained using reinforcement learning, imitation learning, neuroevolution, or other machine learning methods through a simple-to-use Python API. We also provide implementations (based on TensorFlow) of state-of-the-art algorithms to enable game developers and hobbyists to easily train intelligent agents for 2D, 3D and VR/AR games. These trained agents can be used for multiple purposes, including controlling NPC behavior (in a variety of settings such as multi-agent and adversarial), automated testing of game builds and evaluating different game design decisions pre-release. ML-Agents is mutually beneficial for both game developers and AI researchers as it provides a central platform where advances in AI can be evaluated on Unity’s rich environments and then made accessible to the wider research and game developer communities.

Features

• Unity Engine flexibility and simplicity
• Flexible single-agent and multi-agent support
• Multiple visual observations (cameras)
• Discrete and continuous action spaces
• Easily definable Curriculum Learning scenarios
• Broadcasting of Agent behavior for supervised learning
• Built-in support for Imitation Learning (coming soon)
• Visualizing network outputs within the environment
• Python control interface
• TensorFlow Sharp Agent Embedding [Experimental]

Documentation and References

For more information on ML-Agents, in addition to installation, and usage instructions, see our documentation home.

We have also published a series of blog posts that are relevant for ML-Agents:

• Overviewing reinforcement learning concepts (multi-armed bandit and Q-learning)
• Using Machine Learning Agents in a real game: a beginner’s guide
• Post announcing the winners of our first ML-Agents Challenge
• Post overviewing how Unity can be leveraged as a simulator to design safer cities.

In addition to our own documentation, here are some additional, relevant articles:

• Unity AI - Unity 3D Artificial Intelligence
• A Game Developer Learns Machine Learning
• Unity3D Machine Learning – Setting up the environment & TensorFlow for AgentML on Windows 10
• Explore Unity Technologies ML-Agents Exclusively on Intel Architecture

Community and Feedback

ML-Agents is an open-source project and we encourage and welcome contributions. If you wish to contribute, be sure to review our contribution guidelines and code of conduct.

You can connect with us and the broader community through Unity Connect and GitHub:

• Join our Unity Machine Learning Channel to connect with others using ML-Agents and Unity developers enthusiastic about machine learning. We use that channel to surface updates regarding ML-Agents (and, more broadly, machine learning in games).
• If you run into any problems using ML-Agents, submit an issue and make sure to include as much detail as possible.

For any other questions or feedback, connect directly with the ML-Agents team at ml-agents@unity3d.com.

License

Apache License 2.0