[Feature] Add support for block FP8 on SM120 (NVIDIA 5090 and RTX PRO 6000?)

[voipmonitor]

Checklist

• 1. If the issue you raised is not a feature but a question, please raise a discussion at https://github.com/sgl-project/sglang/discussions/new/choose Otherwise, it will be closed.
• 2. Please use English, otherwise it will be closed.

Motivation

to my knoladge the FP8 blockwise on blackwell sm120 is not supported by the sglang yet so we are not able to run GLM-45*-FP8 and other FP8 models on RTX 6000 PRO and RTX 5090. Since the vllm recently added the feature in this PR- vllm-project/vllm#22131 - it would be nice to backport it also to the sglang.

Related resources

No response

[YanxingLiu]

to my knoladge the FP8 blockwise on blackwell sm120 is not supported by the sglang yet so we are not able to run GLM-45*-FP8 and other FP8 models on RTX 6000 PRO and RTX 5090. Since the vllm recently added the feature in this PR- vllm-project/vllm#22131 - it would be nice to backport it also to the sglang.

Can I ask if SGlang now supports FP8 on SM120 GPUs?