Skip to content

Pull requests: vllm-project/vllm

New pull request New
489 Open 6,433 Closed
489 Open 6,433 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

[ROCm][Kernel] MoE weights padding
#14454 opened Mar 7, 2025 by gshtras Loading…
1
[VLM] Add TP support for Phi-4-MM
#14453 opened Mar 7, 2025 by Isotr0py • Draft
2
[Attention] Default to FlashMLA backend for MLA
#14451 opened Mar 7, 2025 by LucasWilkinson Loading…
1
[ROCm] Fix kernel cache miss in Triton FA
#14448 opened Mar 7, 2025 by hyoon1 Loading…
1
[WIP][Kernel] moe wna16 marlin kernel ci/build
#14447 opened Mar 7, 2025 by jinzhen-lin • Draft
1
[Core][LoRA] Add ignore layer for LoRA
#14445 opened Mar 7, 2025 by jeejeelee • Draft
1
[WIP] Support models with mrope (Qwen2VL) on TPU v1
#14442 opened Mar 7, 2025 by mgoin • Draft
1
[Feature]: PD separation supports prefix caching #12257
#14440 opened Mar 7, 2025 by skyCreateXian Loading…
1
Add training doc signposting to TRL documentation Improvements or additions to documentation
#14439 opened Mar 7, 2025 by hmellor Loading…
6
[BUGFIX] fix the need_recv method of model_runner
#14436 opened Mar 7, 2025 by maobaolong Loading…
1
[Usage] Refactor speculative decoding configuration and tests documentation Improvements or additions to documentation speculative-decoding
#14434 opened Mar 7, 2025 by ShangmingCai Loading…
@comaniac @LiuXiaoxuanPKU @WoosukKwon
4
[Kernel] [V1] Further optimizations to ROCm (Triton) Backend to better handle GQA.
#14431 opened Mar 7, 2025 by tdoublep Loading…
1
[Bugfix][Kernel]: Fix AllSpark kernel compilation errors and enable for CUDA < 12.0 ci/build
#14430 opened Mar 7, 2025 by wyajieha Loading…
1
[Refactor][Reasoning] Keep all logic about reasoning into one class documentation Improvements or additions to documentation frontend structured-output
#14428 opened Mar 7, 2025 by gaocegege Loading…
1
2
[Bugfix] Fix When choice the specified tool call, it returns a ToolCa… ci/build frontend
#14427 opened Mar 7, 2025 by liuwwang Loading…
1
[Bugfix][V1] Exclude HBM used by other processes when calculating peak memory during profile runs v1
#14419 opened Mar 7, 2025 by yeqcharlotte Loading…
@youkaichao
4
[Misc] Add get_stream_cls() method for Platform class speculative-decoding
#14411 opened Mar 7, 2025 by shen-shanshan Loading…
1
[rlhf] support named placement group documentation Improvements or additions to documentation
#14410 opened Mar 7, 2025 by youkaichao • Draft
3
Clean up Engine Args & Documentation documentation Improvements or additions to documentation
#14409 opened Mar 7, 2025 by vincent-4 • Draft
1
Remove all references to PA in Engine v1 frontend v1
#14408 opened Mar 7, 2025 by vincent-4 Loading…
1
[Misc] add disable_progress_bar to reduce logs
#14407 opened Mar 7, 2025 by aarnphm Loading…
9
[Bugfix] Make the fused_moe code compatible with non-triton supported hardware
#14400 opened Mar 7, 2025 by shen-shanshan Loading…
1
[Kernel] Update cutlass FP8 blockwise to use upstream CUTLASS ci/build
#14395 opened Mar 7, 2025 by LucasWilkinson • Draft
1
A different take
#14393 opened Mar 7, 2025 by drisspg • Draft
1
[neuron] add reshape_and_cache
#14391 opened Mar 7, 2025 by liangfu Loading…
2
ProTip! Find all pull requests that aren't related to any open issues with -linked:issue.