Skip to content

v4.40.1

Choose a tag to compare

View all tags
@github-actions github-actions released this 18 Sep 18:43
v4.40.1
c976072
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

Fixed

  • (model-serving) Triton's kernel cache lives on the cache claim beside vLLM's compiled graphs — TRITON_CACHE_DIR=/mnt/vllm-cache/triton on the runtime container in #573 by @teemow

Full Changelog: v4.40.0...v4.40.1

Assets 2
Loading