Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

执行convert.py，直接就退出了，不能成功转换。 #143

Open
tommickey2020 opened this issue Oct 14, 2023 · 9 comments
Open

执行convert.py，直接就退出了，不能成功转换。 #143

tommickey2020 opened this issue Oct 14, 2023 · 9 comments

Comments

@tommickey2020
Copy link

执行convert.py，直接就退出了，不能成功转换。
(chatglmcpp) F:\llmbak\chatglm.cpp-main>python chatglm_cpp/convert.py -i F:\llmbak\chatglm2\chatglm2-6b -t q8_0 -o F:\llmbak\chatglm2\chatglm2-6b-q8-0-ggml.bin
Loading checkpoint shards: 0%| | 0/7 [00:00<?, ?it/s]
(chatglmcpp) F:\llmbak\chatglm.cpp-main>
@tommickey2020 tommickey2020 changed the title python chatglm_cpp/convert.py -i F:\llmbak\chatglm2\chatglm2-6b -t q8_0 -o F:\llmbak\chatglm2\chatglm2-6b-q8-0-ggml.bin 执行convert.py，直接就退出了，不能成功转换。 Oct 14, 2023
@catmeowjiao
Copy link

@li-plus 麻烦处理一下，谢谢！

@catmeowjiao
Copy link

我也这样

@catmeowjiao
Copy link

我正在分析convert.py的源代码

@catmeowjiao
Copy link

奇怪

@catmeowjiao
Copy link

我刚才把transformers降级到4.27.1，但AutoModel加载模型后提示transformers版本4.23.1

@catmeowjiao
Copy link

用chatglm2-6b-int4就不会退出了，但是报错
RuntimeError: Only Tensors of floating point and complex d
@li-plus

@catmeowjiao
Copy link

已解决，很抱歉打扰您

@catmeowjiao
Copy link

我发个新issue告诉大家

@catmeowjiao
Copy link

帮大家避雷（

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@tommickey2020 @catmeowjiao