MADDPG implementation in RLlib

[wsjeon]

What do these changes do?

I refactored OpenAI/MADDPG implementation in RLlib and checked the performance.

Related issue number

Closes #4654

Linter

• I've run scripts/format.sh to lint the changes in this PR.

[ericl]

Thanks, this looks pretty good. Would it be possible to include some runnable example script so that we can run them in Jenkins, and so that users can try it out of the box?

[wsjeon]

Oh, I added a runnable script in README in my GitHub repository: https://github.com/wsjeon/maddpg-rllib. Additionally, I'm creating a Singularity image now :) Thanks. Best, Wonseok

…

On Thu, Aug 1, 2019 at 6:34 PM Eric Liang ***@***.***> wrote: Thanks, this looks pretty good. Would it be possible to include some runnable example script so that we can run them in Jenkins, and so that users can try it out of the box? — You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub <#5348?email_source=notifications&email_token=AE2DYWWNHPKQ4OWRZCGYUPTQCNQIRA5CNFSM4IIWTVH2YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOD3MCL2A#issuecomment-517481960>, or mute the thread <https://github.com/notifications/unsubscribe-auth/AE2DYWUXFLJRX7FTXMETBPLQCNQIRANCNFSM4IIWTVHQ> .

[AmplabJenkins]

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Ray-PRB/15910/
Test FAILed.

[ericl]

Thanks! I pushed some changes to add the twostep_game test, remove the need for obs_space_dict / act_space_dict, and move it to contrib/MADDPG.

[AmplabJenkins]

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Ray-PRB/16007/
Test FAILed.

[AmplabJenkins]

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Ray-PRB/16016/
Test FAILed.

[AmplabJenkins]

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Ray-PRB/16018/
Test FAILed.

[AmplabJenkins]

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Ray-PRB/16034/
Test FAILed.

[AmplabJenkins]

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Ray-PRB/16041/
Test FAILed.

[AmplabJenkins]

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Ray-PRB/16057/
Test PASSed.