Skip to content

Pull requests: flashinfer-ai/flashinfer

New pull request New
24 Open 867 Closed
24 Open 867 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

feat: add trtllm-gen mla cubin
#1222 opened Jul 7, 2025 by yyihuang • Draft
3 tasks done
8
Enable cudnn decode and add tests for the cudnn decode kernel
#1221 opened Jul 7, 2025 by Anerudhan • Draft
5
Feature/sm100 low latency nvfp4 kernels priority: high
#1214 opened Jul 4, 2025 by azhurkevich Loading…
1 of 5 tasks
@yzh119 @zhyncs
6
[comm] TRT-LLM's Multi-Node NVLink All-Reduce Kernel
#1213 opened Jul 4, 2025 by nvmbreughe Loading…
3 tasks
6
trtllmgen-moe-fp8
#1212 opened Jul 3, 2025 by aleozlx Loading…
5 tasks done
16
Add DeepGEMM kernels
#1209 opened Jul 2, 2025 by cyx-6 Loading…
5 tasks
6
Add ruff to pre-commit
#1201 opened Jul 1, 2025 by cyx-6 • Draft
5 tasks
4
Gen decode kernel update
#1189 opened Jun 28, 2025 by wenscarl Loading…
5 tasks
18
Fix trtllm gen fmha kernel launch for bf16
#1188 opened Jun 27, 2025 by pavanimajety • Draft
5 tasks
5
jit: supporting transform output in attention jit template
#1184 opened Jun 27, 2025 by yzh119 • Draft
5 tasks
4
Add mypy to pre-commit
#1179 opened Jun 26, 2025 by cyx-6 • Draft
5 tasks
5
Use flashinfer softmax in top_k_top_p_sampling_from_logits
#1171 opened Jun 24, 2025 by lgeiger Loading…
5 tasks done
11
[wip] Multimem allreduce cutlass dsl
#1169 opened Jun 23, 2025 by Amir-19 • Draft
5 tasks
11
Port AllGather/ReduceScatter from TensorRT-LLM
#1145 opened Jun 15, 2025 by wenscarl Loading…
5 tasks
22
[wip] refactor: add more features to vec_t
#1142 opened Jun 12, 2025 by yzh119 • Draft
5 tasks
28
[WIP] refactor: unifying return status of different backend implementation
#1141 opened Jun 12, 2025 by yzh119 Loading…
5 tasks
2
[wip] ci: update pre-commits
#1094 opened May 26, 2025 by yzh119 Loading…
5 tasks
feat: add mla custom mask
#1017 opened Apr 13, 2025 by yyihuang • Draft
FlashInfer Windows support
#964 opened Mar 21, 2025 by SystemPanic Loading…
[RFC] Redesigned CMake build infrastructure for C++ API
#944 opened Mar 14, 2025 by diptorupd Loading…
6
initial support blackwell
#747 opened Jan 21, 2025 by johnnynunez Loading…
10
[WIP][AMDGPU] try rocm POC
#491 opened Sep 4, 2024 by yiakwy-xpu-ml-framework-team • Draft
16
perf: Fail fast on empty query for BatchPrefillWithPagedKVCacheKernel
#377 opened Jul 17, 2024 by Yard1 • Draft
2
perf: use cub's native BlockLoad/BlockStore for sampling kernels
#309 opened Jun 17, 2024 by yzh119 • Draft
ProTip! Adding no:label will show everything without a label.