Skip to content

feat(example): add OpenAI-compatible embeddings endpoint#2281

Merged
abetlen merged 4 commits into
mainfrom
feat/server-embeddings-api
Jun 7, 2026
Merged

feat(example): add OpenAI-compatible embeddings endpoint#2281
abetlen merged 4 commits into
mainfrom
feat/server-embeddings-api

Conversation

@abetlen

@abetlen abetlen commented Jun 7, 2026

Copy link
Copy Markdown
Owner

Add OpenAI-compatible embeddings support to the server example.

  • Adds POST /v1/embeddings with string, token, batched, float, base64, and dimensions support.
  • Auto-detects pooled embedding GGUFs from model metadata while preserving explicit embedding overrides.
  • Runs embedding requests when the scheduler is idle and adds a small BGE config plus README docs.

@abetlen abetlen marked this pull request as ready for review June 7, 2026 22:09
@abetlen abetlen merged commit fe927bd into main Jun 7, 2026
15 checks passed
@abetlen abetlen deleted the feat/server-embeddings-api branch June 7, 2026 22:09
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant