Skip to content

llm-scaler-vllm beta release 0.21.0-b1

Pre-release
Pre-release

Choose a tag to compare

View all tags
@Wesley-Du Wesley-Du released this 10 Jul 08:43
vllm-0.21.0-b1
daeb01f
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

Highlights

Resources

What’s new

  • vLLM:
    • Upgrade to vLLM 0.21.0
    • Experimentally support XPU graph
    • Support diffusiongemma-26B-A4B-it
    • Support gemma-4-12B-it, gemma-4-31B-it, gemma-4-26B-A4B-it
Assets 2
Loading