Skip to content

v266

Latest
Latest

Choose a tag to compare

View all tags
@github-actions github-actions released this 22 Oct 20:11
v266
c099777

This release includes security dependency updates and requested quality of life changes from users:

  • the UI no longer expects to be run under a root path making it easier to serve llama-swap behind another proxy
  • the max request size is configurable now. Users should be free to OOM as much as they want. llama-swap ain't your mom!
  • allow manual override of values in /v1/audio/voices. This is a non-standard endpoint but makes working with upstream audio engines a bit nicer

Details below:

  • PR #1224 cmd/kubeswap: attach DRA ResourceClaims and mount NFS volumes: add repeatable --resource-claim and NFS --volume support so Kubernetes backends can share a DRA GPU claim and mount models without a static PV and PVC for each export (#1222) by @gabrielcosi
  • PR #1225 Add voices override for speech models: let local models configure capabilities.voices so /v1/audio/voices returns a reliable list without starting the model or querying the upstream server (#1207) by @mostlygeek
  • PR #1228 ui,server: serve the UI under a reverse proxy base path: use relative asset, API and redirect paths so the UI works behind a prefix-stripping reverse proxy without routing its endpoints at the proxy root (#1227) by @mostlygeek
  • PR #1249 internal/server: make the request body size limit configurable: add maxRequestBodyMB for model endpoints and Tailcat, replacing the fixed 250 MB cap while retaining 250 MB as the default (#1245) by @mostlygeek
  • PR #1257 AGENTS.md, go.mod: use go 1.27.3, trim AGENT rules: raise the Go version to 1.27.3, update dependencies and simplify contributor instructions by @mostlygeek
Assets 9
Loading