torch_wrappers.md

Wrapper classes for torch Dataloaders, Optimizers, and Schedulers

The internal classes Accelerate uses to prepare objects for distributed training when calling [~Accelerator.prepare].

Datasets and DataLoaders

[[autodoc]] data_loader.prepare_data_loader [[autodoc]] data_loader.skip_first_batches

[[autodoc]] data_loader.BatchSamplerShard [[autodoc]] data_loader.IterableDatasetShard [[autodoc]] data_loader.DataLoaderShard [[autodoc]] data_loader.DataLoaderDispatcher

Optimizers

[[autodoc]] optimizer.AcceleratedOptimizer

Schedulers

[[autodoc]] scheduler.AcceleratedScheduler