# Unity ML-Agents Toolkit Documentation ## Installation & Set-up * [Installation](Installation.md) * [Background: Jupyter Notebooks](Background-Jupyter.md) * [Docker Set-up](Using-Docker.md) * [Basic Guide](Basic-Guide.md) ## Getting Started * [ML-Agents Toolkit Overview](ML-Agents-Overview.md) * [Background: Unity](Background-Unity.md) * [Background: Machine Learning](Background-Machine-Learning.md) * [Background: TensorFlow](Background-TensorFlow.md) * [Getting Started with the 3D Balance Ball Environment](Getting-Started-with-Balance-Ball.md) * [Example Environments](Learning-Environment-Examples.md) ## Creating Learning Environments * [Making a New Learning Environment](Learning-Environment-Create-New.md) * [Designing a Learning Environment](Learning-Environment-Design.md) * [Agents](Learning-Environment-Design-Agents.md) * [Academy](Learning-Environment-Design-Academy.md) * [Brains](Learning-Environment-Design-Brains.md): [Player](Learning-Environment-Design-Player-Brains.md), [Heuristic](Learning-Environment-Design-Heuristic-Brains.md), [Learning](Learning-Environment-Design-Learning-Brains.md) * [Learning Environment Best Practices](Learning-Environment-Best-Practices.md) * [Using the Monitor](Feature-Monitor.md) * [Using an Executable Environment](Learning-Environment-Executable.md) ## Training * [Training ML-Agents](Training-ML-Agents.md) * [Training with Proximal Policy Optimization](Training-PPO.md) * [Training with Curriculum Learning](Training-Curriculum-Learning.md) * [Training with Imitation Learning](Training-Imitation-Learning.md) * [Training with LSTM](Feature-Memory.md) * [Training on the Cloud with Amazon Web Services](Training-on-Amazon-Web-Service.md) * [Training on the Cloud with Microsoft Azure](Training-on-Microsoft-Azure.md) * [Using TensorBoard to Observe Training](Using-Tensorboard.md) ## Inference * [Unity Inference Engine](Unity-Inference-Engine.md) ## Help * [Migrating from earlier versions of ML-Agents](Migrating.md) * [Frequently Asked Questions](FAQ.md) * [ML-Agents Glossary](Glossary.md) * [Limitations](Limitations.md) ## API Docs * [API Reference](API-Reference.md) * [How to use the Python API](Python-API.md) * [Wrapping Learning Environment as a Gym (+Baselines/Dopamine Integration)](../gym-unity/README.md) * [Creating custom protobuf messages](Custom-Protos.md)