-
Notifications
You must be signed in to change notification settings - Fork 133
Issues: mosaicml/streaming
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Author
Label
Projects
Milestones
Assignee
Sort
Issues list
Writers can finish 'successfully' even if there is a failure uploading from local to remote
bug
Something isn't working
#753
opened Aug 14, 2024 by
srowen
Different lists of examples when shuffle == False
bug
Something isn't working
#749
opened Aug 13, 2024 by
experiencor
Estimate total shards at the beginning of data conversion
enhancement
New feature or request
#742
opened Aug 3, 2024 by
abhijithneilabraham
huge temp files while uploading data using MDS writer
bug
Something isn't working
#734
opened Jul 24, 2024 by
MaxxP0
GCS: Mosiacml-streaming overloads the GCP metadata service when too many processes are used.
bug
Something isn't working
#728
opened Jul 18, 2024 by
smspillaz
Replication changes sample order
bug
Something isn't working
#725
opened Jul 15, 2024 by
CodeCreator
'File exists: "/00000_locals"' when integrated with deepspeed training scripts
bug
Something isn't working
#717
opened Jul 8, 2024 by
Clement25
All processes allocate memory on rank 0 during StreamingDataset initialization in a distributed setting
bug
Something isn't working
#716
opened Jul 2, 2024 by
ohallstrom
Optional dependency for different storages?
enhancement
New feature or request
#709
opened Jun 24, 2024 by
huxuan
Suboptimal usage of 8xH100 GPUs - Streaming dataloader speed significantly fluctuates across batches
bug
Something isn't working
#686
opened May 25, 2024 by
VSehwag
Last entry in the dataset is causing "Relative sample index $x is not present" error
bug
Something isn't working
#677
opened May 20, 2024 by
isidentical
clean_stale_shared_memory duplicating the master process when called in a train.py script
bug
Something isn't working
#663
opened Apr 26, 2024 by
antoinedandi
Support large size index.json (20GB +)
enhancement
New feature or request
#662
opened Apr 25, 2024 by
andreamad8
Does it support Preference data (for training Reward / DPO)?
enhancement
New feature or request
#656
opened Apr 17, 2024 by
ericxsun
Azure Databricks MDS write ops in error: MapInPandas write_mds gives message Spark higher-order functions are not supported in Unity Catalog
bug
Something isn't working
#655
opened Apr 15, 2024 by
wolliq
Out of Memory when using Streaming Dataloader
bug
Something isn't working
#652
opened Apr 13, 2024 by
VikaasVarma
Augment existing dataset
enhancement
New feature or request
#646
opened Apr 3, 2024 by
LWprogramming
GPU utilisation drop between epochs
bug
Something isn't working
#643
opened Mar 29, 2024 by
rishabhm12
Unexpected mds format data for json encoding / how to encode list of strings
bug
Something isn't working
#613
opened Feb 28, 2024 by
ssharpe42
Add support for registering custom Cloud Uploaders
enhancement
New feature or request
#612
opened Feb 28, 2024 by
JAEarly
On the fly sample filtering and limiting of datasets
enhancement
New feature or request
#578
opened Jan 26, 2024 by
ssharpe42
Previous Next
ProTip!
Type g p on any issue or pull request to go back to the pull request listing page.