New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

官方提供预训练模型参数是4个模型并行的文件，这限定模型并行必须是4？ #47

Open

Tron1994 opened this issue Jan 9, 2023 · 1 comment

Tron1994 commented Jan 9, 2023

finetinue的并行训练中模型并行必须设置为4吗，设置为8时会加载失败

Contributor

t1101675 commented Jan 13, 2023

是的，或者可以使用 https://github.com/TsinghuaAI/CPM-1-Generate/blob/main/change_mp.py 来改变并行度

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment