[Feature]: Support DeepSeek V4 flash with Triton fallback

[bbbearxyz]

🚀 The feature, motivation and pitch

Support DeepSeek V4 on SM120

🚀 The feature, motivation and pitch

I am trying to run DeepSeek V4 / DeepSeek-V4-Flash on NVIDIA SM120 GPUs. Currently, the DeepSeek V4 path depends on optimized kernels such as DeepGEMM and FlashMLA, but these kernels do not appear to support SM120 yet.

Because of this, DeepSeek V4 cannot run on SM120 even though the GPUs have enough memory and compute capability for the model. It would be very helpful if vLLM could support DeepSeek V4 on SM120, or provide a compatible execution path when DeepGEMM / FlashMLA are unavailable for this architecture.

SM120 GPUs are becoming available in workstation and server environments, so supporting this architecture would make DeepSeek V4 usable on newer NVIDIA hardware.

Alternatives

The current alternatives seem to be:

• Use GPU architectures already supported by DeepGEMM / FlashMLA.
• Wait for DeepGEMM / FlashMLA to add SM120 support.
• Maintain a local patch to bypass unsupported kernel paths.

I am not sure whether SM120 support is currently planned for DeepSeek V4 in vLLM.

Additional context

Environment:

• GPU: NVIDIA RTX PRO 6000 96GB x 2
• GPU architecture: SM120
• Model: DeepSeek V4 / DeepSeek-V4-Flash
• Backend: vLLM DeepSeek V4 branch
• Expected behavior: DeepSeek V4 can run on SM120

Alternatives

No response

Additional context

No response

Before submitting a new issue...

• Make sure you already searched for relevant issues, and asked the chatbot living at the bottom right corner of the documentation page, which can answer lots of frequently asked questions.

[bbbearxyz]

I support DeepSeek V4 Flash on SM120 by implementing many of DeepSeek V4’s Triton functions. I think adding this many functions in a single PR may carry some risk, but I don’t have a better approach at the moment. If anyone has experience in this area, I’d appreciate suggestions for a more elegant way to implement SM120 support.

[7801943]

does it works on A100 hardware?