Skip to content

v1.4.495

Choose a tag to compare

View all tags
@github-actions github-actions released this 30 Sep 18:04
· 59 commits to main since this release
v1.4.495
6f594f1

Changes

PR #2204 by ericcurtin: feat: add llmman to the OpenAI-compatible providers

  • Added llmman as an OpenAI-compatible provider, enabling local models distributed as OCI artifacts to be served through an OpenAI-compatible API on port 17434.
  • Implemented the integration with a single ProviderMap entry, following the LiteLLM precedent for a localhost BaseURL and requiring no special handling.
  • Extended the existing TestCreateClient table with a new case covering the llmman provider.
Assets 11
Loading