New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

使用Deepseek-lite训练DPO，显示expected mat1 and mat2 to have the same type, but got: float != c10: : BFLoat16 #306

Open

victorShawFan opened this issue May 27, 2024 · 3 comments

victorShawFan commented May 27, 2024

企业微信截图_3e4b1898-9b82-43cc-847e-1404732e4e31

企业微信截图_14e39446-a286-4694-906d-2b5f8dd0cb59

企业微信截图_a14a0465-8a4c-49a6-8f17-0f168c97ca3f

Collaborator

hijkzzz commented May 27, 2024

通常这种情况可以尝试升级 deepspeed 到最新版（但是也不能确定 100% work）

Author

victorShawFan commented May 28, 2024

确实没有work

lixsh6 commented Jun 5, 2024

确实没有work

请问有fix的办法吗？同遇到类似问题

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment