Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add support for the new OpenAI Gym step API interface #4

Open
br0kej opened this issue Aug 21, 2022 · 3 comments
Open

Add support for the new OpenAI Gym step API interface #4

br0kej opened this issue Aug 21, 2022 · 3 comments
Assignees
Labels
feature_request A feature request

Comments

@br0kej
Copy link
Contributor

br0kej commented Aug 21, 2022

The upstream team developing gym have implemented a new step API interface to support more granular termination criteria for environments. The details of the changes can be found here - openai/gym#2752.

This doesn't seem to be impacting the current build but as gym matures, it's likely that this interface will become the default.

@jamesshort1
Copy link
Collaborator

jamesshort1 commented Oct 31, 2022

Should be covered off when we implement the new "Gymnasium" interface. Will assess

@ChrisMcCarthyDev ChrisMcCarthyDev added the feature_request A feature request label Dec 2, 2022
@ChrisMcCarthyDev
Copy link
Collaborator

Just a quick update from our end. Stable Baselines3 and Gymnasium are now fully aligned in terms of compatible dependency versions, however Ray RLlib is still out of sync with the version of Gymnasium it depends on. This means we cannot migrate from Gym to Gymnasium just yet while still supporting Ray RLlib. We're hoping this issue is resolved soon so we can complete the migration, which will then bring in the new step API.

@ChrisMcCarthyDev ChrisMcCarthyDev self-assigned this Jul 21, 2023
@ChrisMcCarthyDev
Copy link
Collaborator

This a quick update from the Yawning-Titan Dev Team to say that Ray RLlib(versions >= 2.7.0) now supports Gymnasium v0.28.1. With both Stable Baselines3 and Ray RLlib now aligned on the same version of Gymnasium, we can move forward with this ticket. It is on our backlog and will be progressed soon.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
feature_request A feature request
Projects
None yet
Development

No branches or pull requests

3 participants