Skip to content

Support for OpenAI-compatible API server #2502

@shamil

Description

@shamil

As I understand it, the API server isn't OpenAI-compatible right now. Are there any plans to change that?

It would be great to have a standard /v1/chat/completions endpoint so we can plug third-party UIs like Open WebUI straight into the API Server.

Metadata

Metadata

Assignees

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions