-
Notifications
You must be signed in to change notification settings - Fork 324
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
openai server非流式请求报错 #311
Comments
启动命令:
|
I ran it on m2 ultra and encountered the same error. |
Fixed by #309. Will release a new version soon. |
我查看了#309的修改方式,直接修改了site-packages中的代码,把encode_messages修改为apply_chat_template,不再报错了 |
我暂时也用相同的方式解决了,多谢! |
已经发布新版本了,可以更新下 python 包,先关了 |
模型:glm4-9b-chat q4_0量化
接口:/v1/chat/completions
请求报文:
后台报错日志:
The text was updated successfully, but these errors were encountered: