Skip to content

Issues: webdataset/webdataset

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

96 Open 192 Closed
96 Open 192 Closed
Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Milestones
Filter by milestone
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Excess memory usage when generating short sequence clips
#354 opened Apr 30, 2024 by clane9
Loop through same tar file 10 times?
#353 opened Apr 19, 2024 by chrisdxie
wds.Decoder TypeError: 'functools.partial' object is not iterable
#352 opened Apr 19, 2024 by stunlocked1
1
Restricting the number of samples in the dataset
#351 opened Apr 17, 2024 by sayakpaul
How does shuffling work?
#350 opened Apr 15, 2024 by richardrl
Update pypi with 0.2.88?
#349 opened Apr 15, 2024 by chrisdxie
Seed in multiprocessing (DDP) is not fixed in shuffle()
#348 opened Apr 13, 2024 by elicassion
wids cannot open SAM dataset enhancement New feature or request
#331 opened Feb 1, 2024 by Lyken17
@tmbdev
7
how to use wids on local dataset
#330 opened Jan 30, 2024 by WudiJoey
3
Buckets of elements of different sizes
#325 opened Jan 18, 2024 by ethansmith2000
AttributeError: module 'webdataset' has no attribute 'Dataset'
#323 opened Jan 8, 2024 by YYDreamzure
1
Please provide a mechanism for detecting when one tarball has been fully consumed enhancement New feature or request
#314 opened Nov 30, 2023 by pabl0
@tmbdev
1
stream is deleted but not closed
#311 opened Nov 24, 2023 by wangkenpu
1
Problem about webdataset load the same tar file by epoch enhancement New feature or request
#310 opened Nov 16, 2023 by si22bao
@tmbdev
1
Curl in popen doesn't close if there are no tar shard on an AWS. enhancement New feature or request
#308 opened Oct 31, 2023 by dmasny99
@tmbdev
1
Loss of performance
#306 opened Oct 25, 2023 by karamavusibrahim
to_tuple() needs **kwargs as well. bug Something isn't working
#304 opened Oct 10, 2023 by delta-func
@tmbdev
how to use num_workers in ddp training?
#303 opened Oct 8, 2023 by zhangvia
1
too many files when using multiprocessing with pytorch dataloader and decode bug Something isn't working
#301 opened Sep 30, 2023 by ekorman
@tmbdev
How can I use cache by "wds.DataPipeline(*pipeline)"
#295 opened Sep 19, 2023 by Yangr116
Problem with parsing filenames
#288 opened Aug 14, 2023 by gau-nernst
Compatibility with JSONL
#287 opened Aug 9, 2023 by zanussbaum
When I have a duplicate entry I get a secondary error
#286 opened Aug 4, 2023 by enjalot
[Distributed inference] How to effectively perform it with torch and webdataset
#285 opened Aug 3, 2023 by sayakpaul
2
"Issues with 'with_epoch' Configuration Relative to 'batch_size' in Distributed Training Using PyTorch Lightning and WebDataset"
#282 opened Jul 17, 2023 by ljqnb
1
ProTip! Type g p on any issue or pull request to go back to the pull request listing page.