add map-elites, with a brax ant example #33
Merged
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Add a simple implementation of the MAP-Elites algorithm (ref1, ref2), with an example on the Brax Ant task.
Users can implement their own behavior descriptor extractor, see an example in
task/brax_task.py
.Example commands
python train_ant_map_elites.py --max-iter=3000 python train_ant_map_elites.py --max-iter=3000 --save-gif # This can be slow
Example output
Note We plan to add more Quality Diversity methods, the implementations and related interfaces are subject to change.