DO NOT MERGE

config/ppo/3DBall.yaml

         gamma: 0.99
         strength: 1.0
     keep_checkpoints: 5
-    max_steps: 500000
+    max_steps: 500
     time_horizon: 1000
     summary_freq: 12000
     threaded: true