Skip to content
This repository has been archived by the owner on Oct 31, 2023. It is now read-only.

Refactor PPOAgent and PPORNDAgent #80

Merged
merged 3 commits into from
Sep 23, 2022
Merged

Refactor PPOAgent and PPORNDAgent #80

merged 3 commits into from
Sep 23, 2022

Conversation

xiaomengy
Copy link
Contributor

@xiaomengy xiaomengy commented Sep 23, 2022 •
edited
Loading

This PR refactored PPOAgent and PPORNDAgent implementation.

  1. For PPOAgent, hide member variables as private.
  2. For PPORNDAgent, remove the "next_obs" field from replay_buffer to save memory and improve performance.

@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Sep 23, 2022
@xiaomengy xiaomengy merged commit f80dbe3 into facebookresearch:main Sep 23, 2022
@xiaomengy xiaomengy deleted the agent_update branch September 23, 2022 06:29
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Reviewers
No reviews
Assignees
No one assigned
Labels
CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

None yet
2 participants
@xiaomengy @facebook-github-bot