Skip to content

Pull requests: flashinfer-ai/flashinfer

New pull request New
42 Open 1,061 Closed
42 Open 1,061 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Trtllm-gen Fp4 MoE Autotunner
#1475 opened Aug 12, 2025 by IwakuraRein • Draft
3 of 5 tasks
8
Fix TRTLLM NVFP4-out attention kernel scale factor dim issue
#1460 opened Aug 11, 2025 by elvischenv Loading…
4 of 5 tasks
13
feat(attention): add RoPE offset support for batch prefill
#1457 opened Aug 11, 2025 by MengAiDev Loading…
3 tasks done
4
Fix cuda-python v13.0 import compatibility
#1455 opened Aug 11, 2025 by yongwww Loading…
3 of 5 tasks
7
feat: enable trtllm-gen attn speculative decoding verify by decode
#1453 opened Aug 11, 2025 by yyihuang • Draft
5 tasks
@yzh119 @yyihuang
4
benchmark: add allreduce_fusion benchmark
#1450 opened Aug 10, 2025 by yyihuang • Draft
5 tasks
@yyihuang
6
refactor: unify autotuner for fp4 gemm backends
#1439 opened Aug 8, 2025 by ttyio Loading…
3 of 5 tasks
4
misc: Fix persistent kernel compilation
#1430 opened Aug 8, 2025 by Edenzzzz Loading…
5 tasks
3
Sink attention AoT
#1427 opened Aug 8, 2025 by nandor Loading…
5 tasks done
7
Restore llama4 fc2 required kernels
#1417 opened Aug 8, 2025 by aleozlx Loading…
5 tasks done
6
refactor: update trtllm-gen attn interface
#1407 opened Aug 7, 2025 by yyihuang • Draft
5 tasks
@yyihuang
4
gpt-oss: Add MXFP8 x MXFP4 CUTLASS MOE for SM100 and BF16 x MXFP4 CUTLASS for SM90 + SwigluBias Activation
#1396 opened Aug 6, 2025 by djmmoss Loading…
4 of 5 tasks
3
misc: Customize kv lens buffer size for sparse attention
#1383 opened Aug 5, 2025 by Edenzzzz Loading…
5 tasks
1
6
Removes MPI dependency from MNNVL AllReduce
#1379 opened Aug 4, 2025 by pranavm-nvidia Loading…
5 tasks
6
feat: Support sliding window for persistent kernel
#1368 opened Aug 3, 2025 by Edenzzzz Loading…
5 tasks
7
feat: support dynamic scale factor interface for trtllm-gen attn
#1342 opened Jul 29, 2025 by yyihuang • Draft
3 of 5 tasks
@yzh119
3
Add moe benchmark routine
#1327 opened Jul 25, 2025 by aleozlx • Draft
3 of 5 tasks
6
Add k_scale and v_scale to persistent attention
#1322 opened Jul 24, 2025 by Edenzzzz Loading…
5 tasks
9
[WIP] Add benchmark scripts to different moe gemms
#1315 opened Jul 24, 2025 by fzyzcjy • Draft
5 tasks
8
Wrap cudnn backend to unified interface
#1312 opened Jul 23, 2025 by cyx-6 Loading…
5 tasks
5
Api regression test for trtllmgen fp8 moe
#1308 opened Jul 23, 2025 by aleozlx Loading…
5 tasks done
7
fix: a workaround to make fp8 kv-cache work for prefill
#1304 opened Jul 22, 2025 by chenyang78 Loading…
2 tasks
20
use NVSHMEM4Py instead of custom bindings for NVSHMEM MNNVL Allreduce
#1263 opened Jul 15, 2025 by Amir-19 Loading…
5 tasks
13
bugfix: fix fp32 acc threshold for qk using math::inf according to dtype by AIDC-AI
#1247 opened Jul 14, 2025 by yongchaoding Loading…
5 tasks done
5
Add the keyword "template" to member template specialization appears after . or -> in a post-fix expression which is a requirement in C++ standard
#1246 opened Jul 14, 2025 by tomflinda Loading…
9
ProTip! Type g p on any issue or pull request to go back to the pull request listing page.