Skip to content

Pull requests: vllm-project/vllm

New pull request New
742 Open 9,302 Closed
742 Open 9,302 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

[Misc] fix pre-commit fail about qwen2_5 qwen Related to Qwen models
#19834 opened Jun 19, 2025 by andyxning Loading…
4 tasks
4
[WIP] Async Scheduler Prototype needs-rebase qwen Related to Qwen models structured-output v1
#19831 opened Jun 19, 2025 by LucasWilkinson • Draft
4 tasks
16
FP8 custom ops v1
#19830 opened Jun 19, 2025 by ProExpertProg • Draft
4 tasks
8
Move Gemma's stacked_params_mapping to class scope
#19829 opened Jun 19, 2025 by yhtang • Draft
7
[Feature]Compute-communication overlap
#19827 opened Jun 19, 2025 by Jacki1223 Loading…
9
[Core] Add Flashinfer TRTLLM Backend for Flashinfer decode path (SM100). v1
#19825 opened Jun 19, 2025 by pavanimajety • Draft
1 of 4 tasks
5
WIP [P/D] Use ThreadPoolExecutor to do handshake for each P-D pair needs-rebase v1
#19823 opened Jun 19, 2025 by lk-chen Loading…
2 of 4 tasks
1
13
[Bugfix] Enable PP with AITER+V1 qwen Related to Qwen models rocm Related to AMD ROCm v1
#19822 opened Jun 18, 2025 by qli88 Loading…
2
[Feature] Integrate new deepgemm deepseek Related to DeepSeek models ready ONLY add when PR is ready to merge/full CI is needed
#19820 opened Jun 18, 2025 by yewentao256 Loading…
7
LoRA support on llama4 llama Related to Llama models
#19819 opened Jun 18, 2025 by frank-wei Loading…
1 of 4 tasks
8
[Kernel] Add Conch backend for mixed-precision linear layer ci/build
#19818 opened Jun 18, 2025 by jmanning-stackav Loading…
6
Introduce RayCudaCommunicator as Ray Compiled Graph communicator
#19816 opened Jun 18, 2025 by ruisearch42 • Draft
4 tasks
14
Improve quant config semantic clarity, add Nvidia ModelOpt config adaptation
#19815 opened Jun 18, 2025 by Edwardf0t1 Loading…
3 of 4 tasks
6
[MISC] add cpu_kvcache_space_bytes to CacheConfig
#19812 opened Jun 18, 2025 by andyxning Loading…
4 tasks
6
raise exception for pin_lora ready ONLY add when PR is ready to merge/full CI is needed
#19809 opened Jun 18, 2025 by andyxning Loading…
4 tasks
4
[Misc] DeepSeek Decode Optimizations
#19807 opened Jun 18, 2025 by varun-sundar-rabindranath • Draft
5
[Misc] Enable fp8_dispatch for DeepEP qwen Related to Qwen models
#19806 opened Jun 18, 2025 by varun-sundar-rabindranath Loading…
5
Allow to override KV cache memory calculation v1
#19804 opened Jun 18, 2025 by da-x Loading…
4
[Misc] [ROCm] Prevent surplus tensor reshape ready ONLY add when PR is ready to merge/full CI is needed rocm Related to AMD ROCm v1
#19803 opened Jun 18, 2025 by zsolt-borbely-htec Loading…
5
[Minor] Allow redirecting model path for HfRunner in test qwen Related to Qwen models ready ONLY add when PR is ready to merge/full CI is needed
#19795 opened Jun 18, 2025 by Isotr0py Loading…
3 of 4 tasks
3
Add SM120 to the Dockerfile ci/build ready ONLY add when PR is ready to merge/full CI is needed
#19794 opened Jun 18, 2025 by mgoin Loading…
11
[DP] Support external DP Load Balancer mode frontend v1
#19790 opened Jun 18, 2025 by njhill • Draft
8
Mark invariant normalizer in Gemma as non-persistent force-merge ready ONLY add when PR is ready to merge/full CI is needed
#19788 opened Jun 18, 2025 by yhtang Loading…
9
[Ray] v1 Change device str for platform compatibility v1
#19785 opened Jun 18, 2025 by 1StepForever Loading…
3 of 4 tasks
4
[WIP] Splitting attention _fwd_grouped_kernel_stage1 to improve occupancy
#19774 opened Jun 17, 2025 by ekuznetsov139 Loading…
9
ProTip! What’s not been updated in a month: updated:<2025-05-18.