浏览代码

Avoid stall when multiple brains are present

/develop/dockerfile
Ervin Teng 5 年前
当前提交
6fa7ad0b
共有 1 个文件被更改,包括 6 次插入0 次删除
  1. 6
      ml-agents/mlagents/trainers/trainer/rl_trainer.py

6
ml-agents/mlagents/trainers/trainer/rl_trainer.py


from typing import Dict, List
from collections import defaultdict
import abc
import time
from mlagents.trainers.optimizer.tf_optimizer import TFOptimizer
from mlagents.trainers.buffer import AgentBuffer

# We grab at most the maximum length of the queue.
# This ensures that even if the queue is being filled faster than it is
# being emptied, the trajectories in the queue are on-policy.
_queried = False
_queried = True
if self.threaded and not _queried:
# Avoid busy-waiting
time.sleep(0.05)
if self.should_still_train:
if self._is_ready_update():
with hierarchical_timer("_update_policy"):

正在加载...
取消
保存