We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
No response
v1.10.0-lts
使用的本地部署DeepSeek:32B模型,需要使用到模型的num_ctx参数,这个参数实际上模型里面是支持的,
1、使用本地部署DeepSeek,并确保可以设置/set parameter num_ctx 8192 2、在maxkb中天际DeepSeek模型,并在模型参数设置,添加temperature、max_tokens、top_p、num_ctx参数 3、在模型中可以正常回答
在模型参数设置开启num_ctx参数后,可以正常应用
The text was updated successfully, but these errors were encountered:
感谢反馈,会在下个版本支持这个参数设置。
Sorry, something went wrong.
Bot detected the issue body's language is not English, translate it automatically. 👯👭🏻🧑🤝🧑👫🧑🏿🤝🧑🏻👩🏾🤝👨🏿👬🏿
Thanks for the feedback, this parameter setting will be supported in the next version.
v1.10.2-lts已发布。
v1.10.2-lts has been released.
zyyfit
No branches or pull requests
Contact Information
No response
MaxKB Version
v1.10.0-lts
Problem Description
使用的本地部署DeepSeek:32B模型,需要使用到模型的num_ctx参数,这个参数实际上模型里面是支持的,
Steps to Reproduce
1、使用本地部署DeepSeek,并确保可以设置/set parameter num_ctx 8192
2、在maxkb中天际DeepSeek模型,并在模型参数设置,添加temperature、max_tokens、top_p、num_ctx参数
3、在模型中可以正常回答
The expected correct result
在模型参数设置开启num_ctx参数后,可以正常应用
Related log output
Additional Information
No response
The text was updated successfully, but these errors were encountered: