Skip to content

v0.26.0rc1

Latest

Choose a tag to compare

@jiangkuaixue123 jiangkuaixue123 released this 19 Aug 14:49
· 155 commits to main since this release
85e826e

Highlights

v0.26.0rc1 upgrades the AFD Plugin from the vLLM 0.19.1 runtime contract to vLLM 0.26.0 across both CUDA and Ascend NPU backends.

  • Runtime upgrade: Aligns GPU and NPU model runners, connectors, CUDA/ACL graph execution, DBO, and compatibility patches with the vLLM and vLLM-Ascend 0.26 APIs.
  • Expanded CUDA model support: Adds AFD integrations for Qwen3 MoE, Qwen3.5/3.6 MoE, and DeepSeek V4 while preserving native model construction and weight-loading behavior.
  • Improved NPU async execution: Ports token-balanced, two-stage Async CAM MoE ubatching to v0.26, restores correct first-request startup behavior, and adds focused recipes, tests, and troubleshooting guidance.
  • Performance and reliability: Overlaps Attention and FFN model loading, fixes CUDA metadata handling for asymmetric topologies and multi-ubatch DBO, and strengthens connector/runtime lifecycle behavior.
  • Stronger validation: Introduces Buildkite CUDA unit and DeepSeek-V2-Lite E2E gates and expands GPU/NPU coverage across eager, graph, DBO, topology, and model scenarios.

What's Changed

New Contributors

Full Changelog: v0.19.1rc1...v0.26.0rc1