Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Refactor State to increase flexibility and enable nesting #292

Open
cpnota opened this issue Feb 11, 2024 · 0 comments
Open

Refactor State to increase flexibility and enable nesting #292

cpnota opened this issue Feb 11, 2024 · 0 comments
Labels
Milestone

Comments

@cpnota
Copy link
Owner

cpnota commented Feb 11, 2024

The State object itself is unnecessarily limited to (observation, reward, done, mask), etc. It should be possible to construct a State with arbitrary keys. Additionally, the state should be nestable, in it should be able to contain dictionaries or keys whose leaf nodes are eventually converted to tensors. Perhaps State should even be a subclass of a more general object.

@cpnota cpnota added this to the ALL Next milestone Feb 11, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

1 participant