Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

orpo训练较慢 #3786

Closed
LiuChen19960902 opened this issue May 17, 2024 · 3 comments
Closed

orpo训练较慢 #3786

LiuChen19960902 opened this issue May 17, 2024 · 3 comments
Labels
wontfix This will not be worked on

Comments

@LiuChen19960902
Copy link

请问作者有没有遇到orpo全参训练的时候很慢的情况，GPU的利用率很低，只有10%左右。我做其他的训练时候没有遇到过这个问题。
不知道是不是我自己的配置问题
@hiyouga hiyouga added the pending This problem is yet to be addressed. label May 17, 2024
@hiyouga
Copy link
Owner

hiyouga commented May 17, 2024

代码是最新的吗

@LiuChen19960902
Copy link
Author

代码是最新的吗

不是最新的，大概是两个礼拜前更新过一次

@LiuChen19960902
Copy link
Author

我看您最新的代码改版有些大，我自己也在本地做了一些其它的适配。如果更新成最新的代码可能我自己的适配不一定能用了。请问在最新版本前有没有其它的版本可以解决这个问题呢

@hiyouga hiyouga added wontfix This will not be worked on and removed pending This problem is yet to be addressed. labels May 29, 2024
@hiyouga hiyouga closed this as not planned Won't fix, can't repro, duplicate, stale May 29, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
wontfix This will not be worked on
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@hiyouga @LiuChen19960902