trying larger beta

config/trainer_config.yaml

     batch_size: 2048
     buffer_size: 20480
     hidden_units: 256
-    beta: 2.0e-2
+    beta: 3.0e-2
     time_horizon: 1000
     self_play:
         window: 10