Skip to content

[TRTLLM-8777][feat] Update DeepGEMM to the latest commit to include optimizations for DeepSeek-v3.2 #9380

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 2 commits into from
Nov 25, 2025
Merged

[TRTLLM-8777][feat] Update DeepGEMM to the latest commit to include optimizations for DeepSeek-v3.2 #9380

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
d2a67f1
update deepgemm to the latest commit.
lfr-0531 Nov 23, 2025
06688eb
Update deepgemm commit that fixes sm90 MQA.
lfr-0531 Nov 24, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion 3rdparty/CMakeLists.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -39,7 +39,7 @@ FetchContent_Declare(
FetchContent_Declare(
deepgemm
GIT_REPOSITORY https://github.com/ruoqianguo/DeepGEMM
GIT_TAG 9fa5965e265e27995f539e0dd73a06351a8a9eaf
GIT_TAG 6cb8161516302550785d9af924d2778afef1f3f6 # swapab_sm100 branch
GIT_SUBMODULES_RECURSE
ON
SOURCE_SUBDIR
Expand Down
10 changes: 5 additions & 5 deletions tests/unittest/_torch/attention/sparse/test_dsa_indexer.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -308,9 +308,9 @@ def test_deepgemm_fp8_mqa_logits_basic():
"""
torch.manual_seed(0)

num_heads, head_dim = 32, 128
seq_len = 512
seq_len_kv = 1024
num_heads, head_dim = 64, 128
seq_len = 2048
seq_len_kv = 4096
#[seq_len, num_heads, head_dim]
q = torch.randn(
seq_len,
Expand All @@ -335,8 +335,8 @@ def test_deepgemm_fp8_mqa_logits_basic():
)
# ks[i] -> ke[i] for each q[i]
ks = torch.zeros(seq_len, dtype=torch.int, device="cuda")
ke = torch.arange(seq_len, dtype=torch.int, device="cuda") + (
seq_len_kv - seq_len) + 1 # +1 for exclusive end
ke = torch.arange(seq_len, dtype=torch.int,
device="cuda") + (seq_len_kv - seq_len)

# Convert to FP8
q_fp8 = q.to(torch.float8_e4m3fn)
Expand Down