浏览代码
[WIP] ISensor interface and use for visual observations (#2731)
[WIP] ISensor interface and use for visual observations (#2731)
* ISensor and SensorBase * camera and rendertex first pass * use isensors for visual obs * Update gridworld with CameraSensors * compressed obs for reals * Remove AgentInfo.visualObservations * better separation of train and inference sensor calls * compressed obs proto - need CI to generate code * int32 * get proto name right * run protoc locally for new fiels * apply generated proto patch (pyi files were weird) * don't repeat bytes * hook up compressedobs * dont send BrainParameters until there's an AgentInfo * python BrainParameters now needs an AgentInfo to create * remove last (I hope) dependency on camerares * remove CameraResolutions and AgentInfo.visual_observations * update mypy-protobuf version * cleanup todos * python cleanup * more unit test fixes * more unit test fix * camera sensors for VisualFood collector, record demo * SensorCompon.../develop-gpu-test
GitHub
5 年前
当前提交
0892ef2c
共有 80 个文件被更改,包括 1919 次插入 和 2232 次删除
-
51UnitySDK/Assets/ML-Agents/Editor/AgentEditor.cs
-
113UnitySDK/Assets/ML-Agents/Editor/BrainParametersDrawer.cs
-
30UnitySDK/Assets/ML-Agents/Editor/DemonstrationDrawer.cs
-
2UnitySDK/Assets/ML-Agents/Editor/Tests/DemonstrationTests.cs
-
48UnitySDK/Assets/ML-Agents/Editor/Tests/MLAgentsEditModeTest.cs
-
5UnitySDK/Assets/ML-Agents/Examples/3DBall/Scripts/Ball3DDecision.cs
-
7UnitySDK/Assets/ML-Agents/Examples/Basic/Scripts/BasicDecision.cs
-
64UnitySDK/Assets/ML-Agents/Examples/FoodCollector/Prefabs/VisualFoodCollectorArea.prefab
-
43UnitySDK/Assets/ML-Agents/Examples/FoodCollector/Scenes/VisualFoodCollector.unity
-
16UnitySDK/Assets/ML-Agents/Examples/GridWorld/Prefabs/Area.prefab
-
24UnitySDK/Assets/ML-Agents/Examples/GridWorld/Scenes/GridWorld.unity
-
20UnitySDK/Assets/ML-Agents/Examples/Hallway/Prefabs/VisualSymbolFinderArea.prefab
-
83UnitySDK/Assets/ML-Agents/Examples/Hallway/Scenes/VisualHallway.unity
-
20UnitySDK/Assets/ML-Agents/Examples/PushBlock/Prefabs/PushBlockVisualArea.prefab
-
63UnitySDK/Assets/ML-Agents/Examples/PushBlock/Scenes/VisualPushBlock.unity
-
20UnitySDK/Assets/ML-Agents/Examples/Pyramids/Prefabs/VisualAreaPyramids.prefab
-
83UnitySDK/Assets/ML-Agents/Examples/Pyramids/Scenes/VisualPyramids.unity
-
7UnitySDK/Assets/ML-Agents/Examples/Reacher/Scripts/ReacherDecision.cs
-
7UnitySDK/Assets/ML-Agents/Examples/SharedAssets/Scripts/RandomDecision.cs
-
7UnitySDK/Assets/ML-Agents/Examples/Template/Scripts/TemplateDecision.cs
-
196UnitySDK/Assets/ML-Agents/Scripts/Agent.cs
-
43UnitySDK/Assets/ML-Agents/Scripts/Brain.cs
-
26UnitySDK/Assets/ML-Agents/Scripts/BrainParameters.cs
-
12UnitySDK/Assets/ML-Agents/Scripts/Decision.cs
-
69UnitySDK/Assets/ML-Agents/Scripts/Grpc/CommunicatorObjects/AgentInfo.cs
-
44UnitySDK/Assets/ML-Agents/Scripts/Grpc/CommunicatorObjects/BrainParameters.cs
-
9UnitySDK/Assets/ML-Agents/Scripts/Grpc/CommunicatorObjects/SpaceType.cs
-
2UnitySDK/Assets/ML-Agents/Scripts/Grpc/CommunicatorObjects/CompressedObservation.cs.meta
-
56UnitySDK/Assets/ML-Agents/Scripts/Grpc/GrpcExtensions.cs
-
80UnitySDK/Assets/ML-Agents/Scripts/Grpc/RpcCommunicator.cs
-
4UnitySDK/Assets/ML-Agents/Scripts/HeuristicBrain.cs
-
56UnitySDK/Assets/ML-Agents/Scripts/InferenceBrain/BarracudaModelParamLoader.cs
-
15UnitySDK/Assets/ML-Agents/Scripts/InferenceBrain/GeneratorImpl.cs
-
12UnitySDK/Assets/ML-Agents/Scripts/InferenceBrain/ModelRunner.cs
-
23UnitySDK/Assets/ML-Agents/Scripts/InferenceBrain/TensorGenerator.cs
-
67UnitySDK/Assets/ML-Agents/Scripts/Utilities.cs
-
24ml-agents-envs/mlagents/envs/brain.py
-
44ml-agents-envs/mlagents/envs/communicator_objects/agent_info_pb2.py
-
15ml-agents-envs/mlagents/envs/communicator_objects/agent_info_pb2.pyi
-
25ml-agents-envs/mlagents/envs/communicator_objects/brain_parameters_pb2.py
-
13ml-agents-envs/mlagents/envs/communicator_objects/brain_parameters_pb2.pyi
-
10ml-agents-envs/mlagents/envs/communicator_objects/space_type_pb2.py
-
38ml-agents-envs/mlagents/envs/environment.py
-
28ml-agents-envs/mlagents/envs/mock_communicator.py
-
7ml-agents/mlagents/trainers/demo_loader.py
-
27ml-agents/mlagents/trainers/tests/mock_brain.py
-
46ml-agents/mlagents/trainers/tests/test_bc.py
-
73ml-agents/mlagents/trainers/tests/test_ppo.py
-
75ml-agents/mlagents/trainers/tests/test_sac.py
-
1001ml-agents/mlagents/trainers/tests/testdcvis.demo
-
4protobuf-definitions/proto/mlagents/envs/communicator_objects/agent_info.proto
-
3protobuf-definitions/proto/mlagents/envs/communicator_objects/brain_parameters.proto
-
2protobuf-definitions/proto/mlagents/envs/communicator_objects/space_type.proto
-
234UnitySDK/Assets/ML-Agents/Scripts/Grpc/CommunicatorObjects/CompressedObservation.cs
-
8UnitySDK/Assets/ML-Agents/Scripts/Sensor.meta
-
113ml-agents-envs/mlagents/envs/communicator_objects/compressed_observation_pb2.py
-
72ml-agents-envs/mlagents/envs/communicator_objects/compressed_observation_pb2.pyi
-
15protobuf-definitions/proto/mlagents/envs/communicator_objects/compressed_observation.proto
-
101UnitySDK/Assets/ML-Agents/Scripts/Sensor/CameraSensor.cs
-
11UnitySDK/Assets/ML-Agents/Scripts/Sensor/CameraSensor.cs.meta
-
19UnitySDK/Assets/ML-Agents/Scripts/Sensor/CameraSensorComponent.cs
-
11UnitySDK/Assets/ML-Agents/Scripts/Sensor/CameraSensorComponent.cs.meta
-
25UnitySDK/Assets/ML-Agents/Scripts/Sensor/CompressedObservation.cs
-
11UnitySDK/Assets/ML-Agents/Scripts/Sensor/CompressedObservation.cs.meta
-
54UnitySDK/Assets/ML-Agents/Scripts/Sensor/ISensor.cs
-
11UnitySDK/Assets/ML-Agents/Scripts/Sensor/ISensor.cs.meta
-
97UnitySDK/Assets/ML-Agents/Scripts/Sensor/RenderTextureSensor.cs
-
11UnitySDK/Assets/ML-Agents/Scripts/Sensor/RenderTextureSensor.cs.meta
-
19UnitySDK/Assets/ML-Agents/Scripts/Sensor/RenderTextureSensorComponent.cs
-
11UnitySDK/Assets/ML-Agents/Scripts/Sensor/RenderTextureSensorComponent.cs.meta
-
54UnitySDK/Assets/ML-Agents/Scripts/Sensor/SensorBase.cs
-
11UnitySDK/Assets/ML-Agents/Scripts/Sensor/SensorBase.cs.meta
-
18UnitySDK/Assets/ML-Agents/Scripts/Sensor/SensorComponent.cs
-
11UnitySDK/Assets/ML-Agents/Scripts/Sensor/SensorComponent.cs.meta
-
231UnitySDK/Assets/ML-Agents/Scripts/Grpc/CommunicatorObjects/Resolution.cs
-
85ml-agents-envs/mlagents/envs/communicator_objects/resolution_pb2.py
-
45ml-agents-envs/mlagents/envs/communicator_objects/resolution_pb2.pyi
-
11protobuf-definitions/proto/mlagents/envs/communicator_objects/resolution.proto
-
0/UnitySDK/Assets/ML-Agents/Scripts/Grpc/CommunicatorObjects/CompressedObservation.cs.meta