浏览代码

Fix SAC interrupted again

/develop/unified-obs
Ervin Teng 4 年前
当前提交
6e6a6b2b
共有 1 个文件被更改,包括 1 次插入1 次删除
  1. 2
      ml-agents/mlagents/trainers/sac/trainer.py

2
ml-agents/mlagents/trainers/sac/trainer.py


# Bootstrap using the last step rather than the bootstrap step if max step is reached.
# Set last element to duplicate obs and remove dones.
if last_step.interrupted:
agent_buffer_trajectory["next_obs"] = last_step.obs
agent_buffer_trajectory["next_obs"][-1] = last_step.obs
agent_buffer_trajectory["done"][-1] = False
# Append to update buffer

正在加载...
取消
保存