Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[RLlib] Refine MultiAgentEpisode and add test cases. #40799

Merged
merged 52 commits into from
Nov 28, 2023
Merged

[RLlib] Refine MultiAgentEpisode and add test cases. #40799

Show file tree
Hide file tree
Changes from 49 commits
Commits
Show all changes
52 commits
Select commit Hold shift + click to select a range
afc0e17
Initialized MultiAgentEpisode.
simonsays1980 Oct 11, 2023
c6c8275
Added timestep mapping and necessary methods to MultiAgentEpisode.
simonsays1980 Oct 12, 2023
7b423ce
Added get_<data> - methods to 'MultiAgentEpisode' and refined initial…
simonsays1980 Oct 16, 2023
d7a50fa
Added 'create_successor', Äget_state()' and 'from_state()'. Agent mod…
simonsays1980 Oct 16, 2023
02ea5b8
Refactored 'self.t' and 'self.t_started'. Added 'to_sample_batch', 'g…
simonsays1980 Oct 17, 2023
ac189c5
Added list conversion to 'from_sample_batch' in case episode is not d…
simonsays1980 Oct 18, 2023
c84525a
Ran linter.
simonsays1980 Oct 18, 2023
f3d88ec
Adding docstrings.
simonsays1980 Oct 25, 2023
9112f38
Adding docstrings.
simonsays1980 Oct 25, 2023
7f860a5
Merged Master
simonsays1980 Oct 25, 2023
a8b3b1d
LINTER
simonsays1980 Oct 25, 2023
b4ea186
Added documentation to 'SingleAgentEpisode' and merged existing episo…
simonsays1980 Oct 26, 2023
fd71c17
Fixed some bugs found during testing and finished testing for 'Single…
simonsays1980 Oct 26, 2023
03cce90
Implemented review from @sven1977 and changed docstrings a bit.
simonsays1980 Oct 26, 2023
47e88e6
Changed import for 'SingleAgentEpisode' to fix some errors in CI tests.
simonsays1980 Oct 27, 2023
1a62530
Refactored 'get_observations|rewards|actions' into helper funciton.
simonsays1980 Oct 27, 2023
9056dfe
Refactored 'get_observations|rewards|actions' into helper funciton.
simonsays1980 Oct 27, 2023
0d8e324
Added infos to 'MUltiAgentEpiosde'.
simonsays1980 Oct 27, 2023
879b080
Fixed imports and the resulting bug in 'single_agent_gym_env_runner.py'.
simonsays1980 Oct 27, 2023
b53e122
Added 'extra_model_outputs' to 'MultiAgentEpisode'.
simonsays1980 Oct 27, 2023
77e6296
Merge branch 'multi-agent-episode' into infos-and-extra-model-outs-fo…
simonsays1980 Oct 27, 2023
96e9d21
Implemented @sven1977 's review.
simonsays1980 Oct 27, 2023
277282e
Implemented @sven1977 's review.
simonsays1980 Oct 27, 2023
ccce22c
Implemented @sven1977 's review.
simonsays1980 Oct 27, 2023
72bc8f5
Merged branch 'multi-agent-epsiode' into branch.
simonsays1980 Oct 27, 2023
9300309
Started testing for MultiAgentEpisode.
simonsays1980 Oct 28, 2023
c786e06
Added buffers to the 'MultiAgentEpisode' and a corresponding logic to…
simonsays1980 Oct 30, 2023
68d5478
Refined 'add_timestep()' in 'MultiAgentEpisode' to handle also states…
simonsays1980 Oct 31, 2023
d18d4a7
Added first test with multi-agent test environment and refined a coup…
simonsays1980 Oct 31, 2023
de6bab0
Added test scenarios and modified testing environment.
simonsays1980 Oct 31, 2023
09f9e3a
Added a test for 'add_initial_observation' and fixed some minor bug i…
simonsays1980 Oct 31, 2023
b57bef7
Added test for 'add_timestep', made intensive testing, modified 'add_…
simonsays1980 Nov 1, 2023
4e07c41
Added more testing for 'add_timestep()' and '__init__()'. Fixed some …
simonsays1980 Nov 3, 2023
fda7ef8
Added global reward list and global reward timestep mapping to keep t…
simonsays1980 Nov 3, 2023
b8b530c
Added test cases for 'create_successor' in the 'MultiAgentEpisode'. I…
simonsays1980 Nov 8, 2023
8d6ac06
Added functionalities to transfer buffers to successors of 'MultiAgen…
simonsays1980 Nov 9, 2023
2d375ee
Added more tests to the 'test_create_successor'. Found some incpnsist…
simonsays1980 Nov 9, 2023
9aabdac
Removed states and related methods from 'MultiAgentEpisode' as they w…
simonsays1980 Nov 13, 2023
53121d8
Finished 'get_actions()' and 'get_extra_model_outputs()' for the case…
simonsays1980 Nov 14, 2023
225eb68
Finished testing for 'get_rewards()' without partial and buffered rew…
simonsays1980 Nov 15, 2023
f0fb853
Added methods to '_IndexMapping' for more complex index searching. Ad…
simonsays1980 Nov 15, 2023
7d408aa
Added functionality for buffered_rewards and partial rewards. 'get_re…
simonsays1980 Nov 17, 2023
6bdc9e6
Added the file for testing the 'MultiAgentEpisode'. Worked on the fil…
simonsays1980 Nov 18, 2023
b42decf
Finished testing for getters and fixed some minor bugs I ran over whi…
simonsays1980 Nov 20, 2023
c0802ad
Fixed several minor bugs and modified 'create_successor()' and 'conca…
simonsays1980 Nov 22, 2023
040ad60
Finished testing for 'concat_episode()'. Also added a '_copy_buffer' …
simonsays1980 Nov 23, 2023
7d570e1
Added tests for 'to_sample_batch', '__len__', and 'get_returns'. Modi…
simonsays1980 Nov 24, 2023
d23f959
wip
sven1977 Nov 27, 2023
a8937f3
wip
sven1977 Nov 28, 2023
721ff00
wip
sven1977 Nov 28, 2023
3a64881
Merge branch 'master' of https://github.com/ray-project/ray into test…
sven1977 Nov 28, 2023
18ea675
wip
sven1977 Nov 28, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Loading
Loading