浏览代码

change yamls

/develop/bisim-review
yanchaosun 4 年前
当前提交
59251abe
共有 3 个文件被更改,包括 7 次插入5 次删除
  1. 4
      config/ppo_transfer/CrawlerStatic.yaml
  2. 5
      config/ppo_transfer/CrawlerStaticOpbuffer.yaml
  3. 3
      ml-agents/mlagents/trainers/ppo_transfer/optimizer.py

4
config/ppo_transfer/CrawlerStatic.yaml


encoder_layers: 2
policy_layers: 1
value_layers: 1
feature_size: 64
feature_size: 128
in_epoch_alter: true
use_op_buffer: true
use_inverse_model: true
network_settings:
normalize: true

5
config/ppo_transfer/CrawlerStaticOpbuffer.yaml


behaviors:
OldCrawlerStatic:
CrawlerStatic:
trainer_type: ppo_transfer
hyperparameters:
batch_size: 2024

encoder_layers: 2
policy_layers: 1
value_layers: 1
feature_size: 64
feature_size: 128
use_inverse_model: true
network_settings:
normalize: true
hidden_units: 512

3
ml-agents/mlagents/trainers/ppo_transfer/optimizer.py


self.use_alter = hyperparameters.use_alter
self.in_batch_alter = hyperparameters.in_batch_alter
self.in_epoch_alter = hyperparameters.in_epoch_alter
self.op_buffer = hyperparameters.use_op_buffer
self.train_type = hyperparameters.train_type

}
)
if self.use_alter or self.smart_transfer or self.in_batch_alter or self.in_epoch_alter:
if self.use_alter or self.smart_transfer or self.in_batch_alter or self.in_epoch_alter or self.op_buffer:
self._init_alter_update()
self.policy.initialize_or_load()

正在加载...
取消
保存