* [Initial Commit]
Modified the model.py file and the ppo/trainer.py file to use masked actions
* Preliminary modifications to the python side of the code to enable action masking
* Preliminary modifications to the C# side of the code to enable action masking
* Preliminary modifications to the communication side of the code to enable action masking
* Implemented action masking for BC
Note : The actions of the teacher are not masked
* More error messages for the action masking
* fix pytests
* Added Documentation
* Address comment
* Addressed Comments on docs
* Addressed second comment on docs
* Addressed comments for the python side of the code
* Created the action masker and associated unit tests
* Addressed comments on the C# side
* Addressed the comment regarding action_masking_name
* Addressed the comments
- Dockerfile pulls in the mlagents directory now.
- Installs mlagents package locally with `pip install .`.
- Clients should now place trainer configs in unity-volume.
* Update Feature-Monitor.md
Adds details on 1) how to activate the monitor and 2) how to be able to use a target transform to display the information on.
* Update Feature-Monitor.md
Updated with suggestions from reviewer.
- The environment did not respond to reset parameter values
defined by a curriculum until the second reset. This was
because on the first reset, the reset parameters were not
updated by the Academy.
- The old Curriculum object would accept None
as a location for the curriculum. If the
location was None, it would return default
values as its config and lesson number.
- The new MetaCurriculum does not accept
None as a location for the curriculum
folder. This was done to remove unnecessary
edge case functionality from curriculums.
- None checks have been added into
trainer_controller. In the future,
it should be possible to better refactor
trainer_controller so that these None
checks can be removed. This is preferable
to hard-coding default behavior into
MetaCurriculum objects when a metacurriculum
would not even be in place.
- Raises MetaCurriculumError when curriculum_folder is not a folder.
- Removed the ability to set curriculum_folder to None.
trainer_controller.py has been refactored to not depend on this
functionality which will make curriculums more stable.
Deric Pang
GitHub
Arthur Juliani
Marwan Mattar
vincentpierre