[NPU] Adapt vLLM-Ascend 0.23 runtime - #9959
Conversation
There was a problem hiding this comment.
Pull request overview
Adapts the NPU integration and documentation for vLLM-Ascend 0.23.0.
Changes:
- Registers wheel-bundled custom OPPs before TorchNPU initialization.
- Detects native fused-MoE and packed-LoRA capabilities.
- Updates Chinese and English installation instructions.
Reviewed changes
Copilot reviewed 4 out of 4 changed files in this pull request and generated 1 comment.
| File | Description |
|---|---|
swift/model/npu_patch/vllm_ascend_lora.py |
Adds native LoRA capability detection. |
swift/model/npu_patch/env.py |
Bootstraps the custom OPP environment. |
docs/source/BestPractices/NPU-support.md |
Updates Chinese NPU installation guidance. |
docs/source_en/BestPractices/NPU-support.md |
Updates English NPU installation guidance. |
💡 Add a code-review agent skill or configure MCP servers for context-aware, tailored reviews. Learn more in the docs.
| try: | ||
| from vllm_ascend.lora.fused_moe import AscendFusedMoEWithLoRA | ||
| except (ImportError, AttributeError): | ||
| return False | ||
| return AscendFusedMoEWithLoRA is not None |
|
Could you confirm whether the earlier vllm_ascend patch can be safely removed starting from version 0.23? |
For now, could we keep compatibility with vLLM-Ascend 0.18 as well? Removing the legacy patch would require additional validation to ensure there are no regressions for existing NPU users. We can handle the cleanup in a follow-up PR once that verification is complete. |
PR type
PR information
Adapt the NPU runtime integration to vLLM-Ascend 0.23.0.
Changes
vllm-ascendwheel beforetorch_npuinitializes CANN.Compatibility
Please install CANN, PyTorch, TorchNPU, and vLLM-Ascend according to the official compatibility matrix.
Experiment results