Does this project support the deployment of deepseek-v3 and deepseek-r1 on Ascend?

[Kangzf1996]

Does this project support the deployment of deepseek-v3 and deepseek-r1 on Ascend?
请问现在是否支持deepseek-v3和deepseek-r1在ascend的部署？

[Yikun]

Hi, vllm-ascend is still in progress, the initial support of deepseek-v3/r1 will be ready on later Q1.

[Zhaojp-Frank]

Hi, vllm-ascend is still in progress, the initial support of deepseek-v3/r1 will be ready on later Q1.

hi, glad to hear it's on roadmap and will be available shortly !!

so what's the current support status?
It'll be very helpful and very clear for other if created a seperate page to track the stauts, e.g., supported feature; todo list

• currently is it able to deployed with multi-node? support MLA, EP?

[Yikun]

@Zhaojp-Frank Thanks for your suggestion! We will add soon. cc @wangxiyuan are working on this.

Currently, only has a very initial version for common feature here:

https://github.com/vllm-project/vllm-ascend/tree/main/docs/source/features

It'll be very helpful and very clear for other if created a seperate page to track the stauts

• For Roadmap on: vLLM Ascend Roadmap Q1 2025 #71
• For Deepseek on: [New Model]: DeepSeek V3 / R1 #72
• Feature support info on: https://vllm-ascend.readthedocs.io/en/latest/features/suppoted_features.html

[wangxiyuan]

Deekseek V3/R1 is supprted in v0.7.1rc1. You can take a try and let us know if you hit any issue. Thanks.
https://github.com/vllm-project/vllm-ascend/releases/tag/v0.7.1rc1

[gameofdimension]

Deekseek V3/R1 is supprted in v0.7.1rc1. You can take a try and let us know if you hit any issue. Thanks. https://github.com/vllm-project/vllm-ascend/releases/tag/v0.7.1rc1

can you please take a look at this problem #106 (comment)

[wangxiyuan]

I'll close this issue. Let's move to the detail issue. Thanks.