[Feature] It is recommended to add a GPUStack interface to the private model set by the model.

[htl258]

MaxKB Version

v1.10.6-lts

Please describe your needs or suggestions for improvements

模型设置的私有模型中建议加一个GPUStack接口，这个跟Xinference差不多

Please describe the solution you suggest

模型设置的私有模型中建议加一个GPUStack接口

Additional Information

No response

[liqiang-fit2cloud]

GPUStack支持兼容OpenAI接口，所以用OpenAI方式对接即可。

[shaohuzhang1]

Bot detected the issue body's language is not English, translate it automatically. 👯👭🏻🧑‍🤝‍🧑👫🧑🏿‍🤝‍🧑🏻👩🏾‍🤝‍👨🏿👬🏿

---

GPUStack supports compatible with OpenAI interface, so you can use OpenAI to connect.

[htl258]

GPUStack支持兼容OpenAI接口，所以用OpenAI方式对接即可。

向量和重排模型也都支持吗

[shaohuzhang1]

Bot detected the issue body's language is not English, translate it automatically. 👯👭🏻🧑‍🤝‍🧑👫🧑🏿‍🤝‍🧑🏻👩🏾‍🤝‍👨🏿👬🏿

---

GPUStack supports compatible OpenAI interfaces, so use OpenAI to connect.

Are vector and rearrangement models also supported?

[liqiang-fit2cloud]

不确定。
没有计划支持所有平台。

[shaohuzhang1]

Bot detected the issue body's language is not English, translate it automatically. 👯👭🏻🧑‍🤝‍🧑👫🧑🏿‍🤝‍🧑🏻👩🏾‍🤝‍👨🏿👬🏿

---

uncertain.
There is no plan to support all platforms.