Skip to content

v0.25.0

Choose a tag to compare

View all tags
@github-actions github-actions released this 04 Oct 23:52
· 7 commits to main since this release
v0.25.0
1315c49
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

Container images

ghcr.io/codemug/sous-api:0.25.0
ghcr.io/codemug/sous-souslet:0.25.0

linux/amd64 and linux/arm64.

Changes

  • fix(metrics, grpcserver): what two reviews of the metrics listener found
  • feat(metrics): back off from a hung model, take scrapes in turn, test real vLLM output
  • feat(metrics): federate every vLLM model's /metrics behind -metrics-listen
Assets 2
Loading