Skip to content

precompile-loss-v1

@wwwjn wwwjn tagged this 20 Mar 19:30
`datasets` 4.8.x introduced a bug in StepExamplesIterable._iter_arrow
where single-row Arrow batches cause split_dataset_by_node to yield 0
samples for non-zero ranks when **num_shards < world_size**. This breaks
Flux training with the cc12m-test and coco-validation datasets.
Assets 2
Loading