Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug] Add corresponding model parameters to an error #2454

Closed
daviadong opened this issue Mar 3, 2025 · 4 comments
Closed

[Bug] Add corresponding model parameters to an error #2454

daviadong opened this issue Mar 3, 2025 · 4 comments

Comments

@daviadong
Copy link

Contact Information

No response

MaxKB Version

v1.10.0-lts

Problem Description

使用的本地部署DeepSeek:32B模型,需要使用到模型的num_ctx参数,这个参数实际上模型里面是支持的,

Image 但在对接maxkb后,在模型参数设置里设置完成后,应用中与模型对话就会报错 Image

Image

Steps to Reproduce

1、使用本地部署DeepSeek,并确保可以设置/set parameter num_ctx 8192
2、在maxkb中天际DeepSeek模型,并在模型参数设置,添加temperature、max_tokens、top_p、num_ctx参数
3、在模型中可以正常回答

The expected correct result

在模型参数设置开启num_ctx参数后,可以正常应用

Related log output

Additional Information

No response

@shaohuzhang1 shaohuzhang1 changed the title [Bug] 添加对应模型参数报错 [Bug] Add corresponding model parameters to an error Mar 3, 2025
@Shenguobin0102
Copy link

感谢反馈,会在下个版本支持这个参数设置。

@Shenguobin0102 Shenguobin0102 added this to the v1.10.2 milestone Mar 3, 2025
@shaohuzhang1
Copy link
Contributor

Bot detected the issue body's language is not English, translate it automatically. 👯👭🏻🧑‍🤝‍🧑👫🧑🏿‍🤝‍🧑🏻👩🏾‍🤝‍👨🏿👬🏿


Thanks for the feedback, this parameter setting will be supported in the next version.

@baixin513
Copy link
Contributor

v1.10.2-lts已发布。

@shaohuzhang1
Copy link
Contributor

Bot detected the issue body's language is not English, translate it automatically. 👯👭🏻🧑‍🤝‍🧑👫🧑🏿‍🤝‍🧑🏻👩🏾‍🤝‍👨🏿👬🏿


v1.10.2-lts has been released.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

5 participants