Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Loading checkpoint shards: 0%| 进度始终为0 无法加载 #1317

Closed
YourFau1t opened this issue Aug 24, 2024 · 1 comment
Closed

Loading checkpoint shards: 0%| 进度始终为0 无法加载 #1317

YourFau1t opened this issue Aug 24, 2024 · 1 comment
Assignees

Comments

@YourFau1t
Copy link

YourFau1t commented Aug 24, 2024

streamlit run main.py之后如下输出:
Setting eos_token is not supported, use the default one.
Setting pad_token is not supported, use the default one.
Setting unk_token is not supported, use the default one.
Loading checkpoint shards: 0%| | 0/7 [00:00<?, ?it/s]
PS D:\ChatGLM3\ChatGLM3-main\composite_demo>
自己就结束了 是什么问题 MODEL_PATH已经修改过了
跪求大佬解答orz

@YourFau1t
Copy link
Author

已解决
由于本人显存过低只有8G,在量化的时候仅仅只修改了basic_demo里的代码,
未修改client.py的model代码,添加完毕后可以正常loaing并启动

@zRzRzRzRzRzRzR zRzRzRzRzRzRzR self-assigned this Sep 2, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants