Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

想了解下您那边Accelerate配置是怎样的? #29

Open
xuyu666 opened this issue May 14, 2024 · 0 comments
Open

想了解下您那边Accelerate配置是怎样的? #29

xuyu666 opened this issue May 14, 2024 · 0 comments

Comments

@xuyu666
Copy link

xuyu666 commented May 14, 2024

作者您好:
首先感谢您分享训练代码。在尝试运行您的代码时,我注意到您提供了一些分布式训练的选项。然而,在阅读了您提供的Readme文档之后,我发现自己对于如何具体实施分布式训练仍然存在一些疑问。特别是关于Accelerate库的配置选项以及在训练过程中采用的一些策略(例如使用混合精度训练,即fp16),我希望能获得一些具体的示例来加深理解。谢谢~

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant