Bump accelerate from 0.22.0 to 0.25.0

[dependabot]

Bumps accelerate from 0.22.0 to 0.25.0.

Release notes

Sourced from accelerate's releases.

v0.24.1: Patch Release for Samplers

• Fixes huggingface/accelerate#2091 by changing how checking for custom samplers is done

v0.24.0: Improved Reproducability, Bug fixes, and other Small Improvements

Improved Reproducibility

One critical issue with Accelerate is training runs were different when using an iterable dataset, no matter what seeds were set. v0.24.0 introduces the dataloader.set_epoch() function to all Accelerate DataLoaders, where if the underlying dataset (or sampler) has the ability to set the epoch for reproducability it will do so. This is similar to the implementation already existing in transformers. To use:

dataloader = accelerator.prepare(dataloader)
# Say we want to resume at epoch/iteration 2
dataloader.set_epoch(2)

For more information see this PR, we will update the docs on a subsequent release with more information on this API.

Documentation

• The quick tour docs have gotten a complete makeover thanks to @​MKhalusova. Take a look here
• We also now have documentation on how to perform multinode training, see the launch docs

Internal structure

• Shared file systems are now supported under save and save_state via the ProjectConfiguration dataclass. See #1953 for more info.
• FSDP can now be used for bfloat16 mixed precision via torch.autocast
• all_gather_into_tensor is now used as the main gather operation, reducing memory in the cases of big tensors
• Specifying drop_last=True will now properly have the desired affect when performing Accelerator().gather_for_metrics()

What's Changed

• Update big_modeling.md by @​kli-casia in huggingface/accelerate#1976
• Fix model copy after dispatch_model by @​austinapatel in huggingface/accelerate#1971
• FIX: Automatic checkpoint path inference issue by @​BenjaminBossan in huggingface/accelerate#1989
• Fix skip first batch for deepspeed example by @​SumanthRH in huggingface/accelerate#2001
• [docs] Quick tour refactor by @​MKhalusova in huggingface/accelerate#2008
• Add basic documentation for multi node training by @​SumanthRH in huggingface/accelerate#1988
• update torch_dynamo backends by @​SunMarc in huggingface/accelerate#1992
• Sync states for xpu fsdp by @​abhilash1910 in huggingface/accelerate#2005
• update fsdp docs by @​pacman100 in huggingface/accelerate#2026
• Enable shared file system with save and save_state via ProjectConfiguration by @​muellerzr in huggingface/accelerate#1953
• Fix save on each node by @​muellerzr in huggingface/accelerate#2036
• Allow FSDP to use with torch.autocast for bfloat16 mixed precision by @​brcps12 in huggingface/accelerate#2033
• Fix DeepSpeed version to <0.11 by @​BenjaminBossan in huggingface/accelerate#2043
• Unpin deepspeed by @​muellerzr in huggingface/accelerate#2044
• Reduce memory by using all_gather_into_tensor by @​muellerzr in huggingface/accelerate#1968
• Safely end training even if trackers weren't initialized by @​Ben-Epstein in huggingface/accelerate#1994
• Fix integration CI by @​muellerzr in huggingface/accelerate#2047
• Make fsdp ram efficient loading optional by @​pacman100 in huggingface/accelerate#2037
• Let drop_last modify gather_for_metrics by @​muellerzr in huggingface/accelerate#2048
• fix docstring by @​zhangsibo1129 in huggingface/accelerate#2053
• Fix stalebot by @​muellerzr in huggingface/accelerate#2052

... (truncated)

Commits

• d08c23c Release: v0.25.0
• 0e48b23 allow deepspeed without distributed launcher (#2204)
• 3499cf2 Assemble state dictionary for offloaded models (#2156)
• 68d63ee unpins dvc (#2200)
• 1516379 Better error when device mismatches when calling gather() on CUDA (#2180)
• 0ba3e9b Explicitly disable P2P using launch, and pick up in state if a user will ...
• b04d36c Apply DVC warning to Accelerate (#2197)
• 5fc1b23 Pin DVC (#2196)
• 244122c fsdp refactoring (#2177)
• d25efa7 Don't install comet
• Additional commits viewable in compare view

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.

---

Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR:

• @dependabot rebase will rebase this PR
• @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
• @dependabot merge will merge this PR after your CI passes on it
• @dependabot squash and merge will squash and merge this PR after your CI passes on it
• @dependabot cancel merge will cancel a previously requested merge and block automerging
• @dependabot reopen will reopen this PR if it is closed
• @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
• @dependabot show <dependency name> ignore conditions will show all of the ignore conditions of the specified dependency
• @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
• @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
• @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)