Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[On hold] Keep the last frame when preparing datasets #50

Closed
wants to merge 1 commit into from
Closed

[On hold] Keep the last frame when preparing datasets #50

wants to merge 1 commit into from

Conversation

alexander-soare
Copy link
Collaborator

@alexander-soare alexander-soare commented Mar 25, 2024

Previously we were dropping the last frame meaning that we potentially don't keep the action that leads to the success condition. Also, we prepared the initial buffer as all copies of the first frame td_data = ep_td[0].expand(total_frames).memmap_like(self.root / f"{self.dataset_id}"), then populated the buffer with the frames: td_data[idxtd : idxtd + len(ep_td)] = ep_td, meaning that the end of the buffer would have a bunch of nonsensical copies of the first frame.

@alexander-soare
Copy link
Collaborator Author

We are putting this fix on hold now. Left to do for #50 :

  • More careful check that this is really the right logic.
  • Re-processing and uploading the datasets.

@alexander-soare alexander-soare changed the title Keep the last frame when preparing datasets [On hold] Keep the last frame when preparing datasets Mar 25, 2024
@alexander-soare alexander-soare marked this pull request as draft April 1, 2024 14:25
@alexander-soare
Copy link
Collaborator Author

Resolved by another PR

@alexander-soare alexander-soare deleted the keep_last_frame branch April 17, 2024 16:07
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant