ml-agents/docs/Background-TensorFlow.md

Background: TensorFlow

Work In Progress

TensorFlow

TensorFlow is a deep learning library.

Link to Arthur's content?

A few words about TensorFlow and why/how it is relevant would be nice.

TensorFlow is used for training the machine learning models in ML-Agents. Unless you are implementing new algorithms, the use of TensorFlow is mostly abstracted away and behind the scenes.

TensorBoard

One component of training models with TensorFlow is setting the values of certain model attributes (called hyperparameters). Finding the right values of these hyperparameters can require a few iterations. Consequently, we leverage a visualization tool within TensorFlow called TensorBoard. It allows the visualization of certain agent attributes (e.g. reward) throughout training which can be helpful in both building intuitions for the different hyperparameters and setting the optimal values for your Unity environment. We provide more details on setting the hyperparameters in later parts of the documentation, but, in the meantime, if you are unfamiliar with TensorBoard we recommend this tutorial.

TensorFlowSharp

Third-party used in Internal Brain mode.