Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

DCG-MAP-Elites #166

Conversation

maxencefaldor
Copy link
Member

Add DCG-MAP-Elites algorithm to QDax.

This PR introduces:

  • a new method for MAP-Elites repertoire, that enables to samples individuals with their corresponding descriptors.
  • a new output extra_info for Emitter.emit methods that is similar to the extra_scores of the scoring function, and that enables to pass information from the emit step to the state_update (necessary for DCG-MAP-Elites).
  • a new DCGTransition that add desc and desc_prime to the QDTransition.
  • descriptor-conditioned TD3 loss, descriptor-conditioned scoring functions, descriptor-conditioned MLP
  • two new reward wrappers to clip and offset the reward (necessary for DCG-MAP-Elites).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

1 participant