Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Loading checkpoint shards: 0%| | 0/2 [00:00<?, ?it/s]Killed #63

Closed
withyou971 opened this issue May 18, 2023 · 6 comments
Closed

Loading checkpoint shards: 0%| | 0/2 [00:00<?, ?it/s]Killed #63

withyou971 opened this issue May 18, 2023 · 6 comments

Comments

@withyou971
Copy link

这个是对内存有什么要求吗,我的机器32g内存是否不够

@csunny
Copy link
Collaborator

csunny commented May 19, 2023

显存多大?要16G以上显存才行~

@withyou971
Copy link
Author

主机32G,显卡24G,使用windows 的wsl ,torch没问题,但是运行起来会因为主机内存不足被kill,这个还是因为显卡不能被使用吗

@withyou971
Copy link
Author

找到原因了,因为loader有判断路径带chatglm,我的刚好带了

@withyou971
Copy link
Author

用7b的模型为什么问两句就会卡住error

@sardetushar
Copy link

找到原因了,因为loader有判断路径带chatglm,我的刚好带了

Can you please explain how did you fix this issue ?

@WWWWWWLLLL
Copy link

找到原因了,因为loader有判断路径带chatglm,我的刚好带了

可以问一下具体怎么解决吗?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants