We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
因为README-DEV.md脚本直接使用accelerate提示训练内存不足,故修改为deepspeed-stage1启动,其余参数均为默认。因是8卡迭代步长缩小了1/4。
经过实验后我发现:
想咨询下机器不同,且增加了deepspeed有可能让结果变差这么多吗?
The text was updated successfully, but these errors were encountered:
No branches or pull requests
因为README-DEV.md脚本直接使用accelerate提示训练内存不足,故修改为deepspeed-stage1启动,其余参数均为默认。因是8卡迭代步长缩小了1/4。
经过实验后我发现:
想咨询下机器不同,且增加了deepspeed有可能让结果变差这么多吗?
The text was updated successfully, but these errors were encountered: