Skip to content

v0.1.3 - MTP Graph Safety

Choose a tag to compare

View all tags
@weicj weicj released this 05 Jun 14:47
v0.1.3
41f231a
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

v0.1.3 - MTP Graph Safety

  • Adds graph-safety handling for Native MTP + hybrid Mamba/GDN models.
  • Production profiles now fall back from full decode CUDA Graph replay to PIECEWISE/NONE for this risky combination.
  • Keeps the old peak-throughput path available for explicit benchmark profiles via VLLM_ALLOW_MAMBA_SPEC_FULL_CUDAGRAPH=1.
  • Updates VERSION, CHANGELOG.md, and README release markers to v0.1.3.
Assets 2
Loading