Skip to content

v4.31.0

Choose a tag to compare

View all tags
@github-actions github-actions released this 18 Sep 00:05
v4.31.0
324e260
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

Added

  • (model-serving) The cache outlives a pool teardown — the serving namespace is kept while the cache is on, the claim gets a fast gp3 StorageClass of its own by default, and vLLM's compile cache lives on the claim (VLLM_CACHE_ROOT) in #538 by @teemow

Full Changelog: v4.30.3...v4.31.0

Assets 2
Loading