-
-
Notifications
You must be signed in to change notification settings - Fork 3.7k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
强烈希望增加实用功能,谢谢 #1347
Comments
+1 我也想问这个问题。。。 @songquanpeng 这个功能还蛮有用,麻烦大佬留意下~ ❤️ 动机场景现在模型列表更新很快,比如
希望支持的功能新增导入渠道默认模型的按钮:
# curl http://localhost:11434/api/tags
{
"models": [
{
"name": "llama3:8b-instruct-q8_0",
"model": "llama3:8b-instruct-q8_0",
"modified_at": "2024-04-23T20:24:46.839698832+08:00",
"size": 8540783746,
"digest": "5a511385d20f9c4c0608fb157ad7a591bbc6a3958fbcceb1e3ffda50606245bf",
"details": {
"parent_model": "",
"format": "gguf",
"family": "llama",
"families": [
"llama"
],
"parameter_size": "8B",
"quantization_level": "Q8_0"
}
},
{
"name": "qwen:0.5b",
"model": "qwen:0.5b",
"modified_at": "2024-04-23T23:50:46.956194293+08:00",
"size": 394998579,
"digest": "b5dc5e784f2a3ee1582373093acf69a2f4e2ac1710b253a001712b86a61f88bb",
"details": {
"parent_model": "",
"format": "gguf",
"family": "qwen2",
"families": [
"qwen2"
],
"parameter_size": "620M",
"quantization_level": "Q4_0"
}
}
]
} |
关联 Issue:#1304
|
我也有一个idea给大佬参考,比如说在前端添加/修改渠道时,自定义输入的模型时,可批量输入,比如说原本那个输入自定义模型名称的框框可以判断输入是否带逗号 |
更灵活的策略还是这里提到的,用 API 来维护渠道: https://github.com/songquanpeng/one-api/blob/main/docs/API.md
看文档,应该还没有完成,需要大家的 PR~ |
可以维护一个在线的xml,各自部署的one-api可以定时更新或者一键手动更新,不用更新整个one-api。 |
这主意不错,维护一个返回 xml 的在线接口,OneAPI 部署后,在设置里更新渠道的支持信息。 汇总下目前 Issue 里的几个建议:
个人比较支持最后一个,不知道大佬 @songquanpeng 有什么计划 ;) |
API是写好的,我抓包看了,发现可以自己写个脚本去管理,比如get获取渠道信息,然后PUT,我觉得可以在用户设置base_url和key时就多一个按钮去调用 /v1/models获取支持的model自动填入
|
如果渠道多的话,要批量修改模型真的很困难,要一个一个调整,如果要是能批量选择渠道或者批量渠道修改更改模型就好了。
The text was updated successfully, but these errors were encountered: