Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature] Access to QwQ-32B #2552

Open
AbnerSC opened this issue Mar 13, 2025 · 2 comments
Open

[Feature] Access to QwQ-32B #2552

AbnerSC opened this issue Mar 13, 2025 · 2 comments
Assignees

Comments

@AbnerSC
Copy link

AbnerSC commented Mar 13, 2025

MaxKB Version

1.10.2

Please describe your needs or suggestions for improvements

  1. 申请接入QwQ-32B模型
  2. 包括通过ollama部署的离线接口以及阿里云百炼提供的在线接口

Please describe the solution you suggest

No response

Additional Information

No response

@shaohuzhang1 shaohuzhang1 changed the title [Feature] 接入QwQ-32B [Feature] Access to QwQ-32B Mar 13, 2025
@baixin513
Copy link
Contributor

感谢反馈,应该是该模型不支持非流式输出,添加模型时我们会进行一次对话来校验,该校验使用了非流式对话,所以校验失败了,后续版本考虑一下,添加模型时支持不验证。

@shaohuzhang1
Copy link
Contributor

Bot detected the issue body's language is not English, translate it automatically. 👯👭🏻🧑‍🤝‍🧑👫🧑🏿‍🤝‍🧑🏻👩🏾‍🤝‍👨🏿👬🏿


Thanks for the feedback, it should be that this model does not support non-streaming output. When adding the model, we will conduct a conversation to verify. This verification uses non-streaming conversation, so the verification failed. Consider it later versions. It supports no verification when adding the model.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

3 participants