Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Missing next observation in dataset. #31

Closed
RchalYang opened this issue Jun 21, 2020 · 2 comments
Closed

Missing next observation in dataset. #31

RchalYang opened this issue Jun 21, 2020 · 2 comments

Comments

@RchalYang
Copy link

Hi! I'm recently exploring this dataset to study offline rl.

But i'm wondering why this dataset do not contain the information about next_observation in transitin? Is this on purpose or just a mistake?

Here is what i got:

>>> env = gym.make("maze2d-large-v1")

>>> dataset = env.env.get_dataset()

Downloading dataset: http://rail.eecs.berkeley.edu/datasets/offline_rl/maze2d/maze2d-large-sparse-v1.hdf5 to xxxxxxxxxxxxxxxxxxxxx

>>> dataset.keys()

dict_keys(['actions', 'infos/goal', 'infos/qpos', 'infos/qvel', 'observations', 'rewards', 'terminals'])`

@justinjfu
Copy link
Contributor

We excluded next_observations to reduce the size of the files. The datasets should generally consist of entire trajectories (from start to terminal state) appended one after another, so you can extract the next_observation by looking at the next item in the sequence.

@RchalYang
Copy link
Author

Thanks for the clarification. But maybe it's better to note it in the readme or somewhere else

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants