Skip to content

v0.22.1rc1

Pre-release
Pre-release

Choose a tag to compare

View all tags
@MengqingCao MengqingCao released this 30 Jun 13:45
v0.22.1rc1
5f6faa0
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

We're excited to announce the release of v0.22.1rc1 for vLLM Ascend. This is the first release candidate for the v0.22.1 release line, building on v0.21.0rc1 and aligning the plugin with upstream vLLM v0.22.1. Please follow the official doc to get started.

Highlights

  • Mooncake Connector for DeepSeek V4 / Hybrid KV Cache: Mooncake connector now supports DeepSeek V4 and hybrid KV cache disaggregated prefill scenarios with correct block stride handling, compressed KV transfer calculation, and hybrid Mamba token alignment. #10342
  • HCCL Weight Transfer for RL Workloads: Added an HCCL-based weight transfer backend for Ascend NPU so trainer and inference workers can synchronize weights in RL pipelines without a CUDA/NCCL dependency. #9152
  • Ascend 950 Expansion: Extended Ascend 950 support with W8A8/W4A8 dynamic quantization and platform-specific CPU binding support. #10236 #10483

Features

  • Added multimodal input support for DFlash workloads. #9340
  • P-Eagle and PARD are now stable parallel speculative decoding methods and have passed validation testing.
  • Added KV consumer partial-group caching for hybrid Mamba models. #10009
  • Added MiniMax M2 C8 cache-scale support in GQA load_weights. #10461
  • [Experimental] Added SSD support for multiple DP ranks on the same machine to avoid local-rank path collisions in Mooncake offload directories. #10477

Hardware and Operator Support

  • Added W8A8/W4A8 dynamic quantization support for Ascend 950. #10236
  • Added Ascend 950 CPU binding support for Ascend 950 server topology and process layout. #10483

Performance

  • Optimized split_qkv_tp_rmsnorm_rope with grid-stride loading and host-side reciprocal precomputation; the PR reports about a 5x kernel speedup on the tested MiniMax-M2.5 W8A8 QuaRot prefill workload. #9830
  • Reused prebuilt chunk host metadata for Ascend chunk ops to reduce host-device synchronization overhead on Qwen3.5 workloads. #9310
  • Skipped compute_slot_mapping for Mamba groups to reduce unnecessary work in hybrid cache paths. #10492
  • Enabled multistream DSV4 DSA overlap and removed redundant DSA v1 code paths. #10518

Documentation

  • Refreshed the context parallel, EPLB, and speculative decoding documentation. #10332
  • Added Kimi 2.6 and GLM5.2 documentation. #9969 #10544

Known Issues

  • MiniMax 2.7 dual-node 16-card deployments may hang or crash after 10-20 minutes under load. #10591
  • Llama LoRA can still hit an einsum tensor-dimension mismatch on Ascend. #10577
  • Qwen3.x with PD disaggregation plus MTP could still show precision issues because former KVCache blocks may remain dirty. #10961
  • In A3 four-machine 2P1D deployments, Kimi-K2.6 can trigger Error in KVCacheTransferThread. error=unhashable type: 'list' on the D node under concurrent terminal-bench2 testing. #10962
  • With CANN 9.0.0, GLM5.1 1P1D four-machine deployments may hang during 140K-context performance tests, and Kimi-K2.5 with MC2 enabled may hit OOM on single-node A3. #10963
  • Multi-level pooling remains an experimental feature and still has known issues, including DeepSeek-V4-Flash startup failures with Layerwise masks and service hangs in some Mooncake SSD scenarios. #10964

New Contributors

Full Changelog: v0.19.1rc1...v0.22.1rc1

Contributors

ztzx3156, ljy19911228, and 41 other contributors
Assets 2
Loading