Skip to content

Pull requests: vllm-project/vllm

New pull request New
700 Open 9,131 Closed
700 Open 9,131 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

fix: Properly set engine_id when using multi connector in dynamo
#19487 opened Jun 11, 2025 by Missmiaom Loading…
4
[Misc] Fix misleading ROCm warning rocm Related to AMD ROCm
#19486 opened Jun 11, 2025 by jeejeelee Loading…
3 of 4 tasks
3
[Core] Do not copy array during hashing multi-modality Related to multi-modality (#4194) v1
#19484 opened Jun 11, 2025 by lgeiger Loading…
10
[V1] Logit processors for rejection sampler v1
#19482 opened Jun 11, 2025 by southfreebird Loading…
12
[V1][Metrics] Add instance_id (hostname) label for prometheus metrics v1
#19469 opened Jun 11, 2025 by reidliu41 Loading…
4 tasks
1
2
[BugFix] Destroy nccl Comm to fix cuda memory leak of destroy_model_parallel
#19465 opened Jun 11, 2025 by wcsjtu Loading…
3 of 4 tasks
2
[WIP][Perf] Improve/Fix-regression for FA3 in QPS regimes ci/build ready ONLY add when PR is ready to merge/full CI is needed
#19463 opened Jun 11, 2025 by LucasWilkinson Loading…
2 of 4 tasks
2
[doc] fix TPU getting started page documentation Improvements or additions to documentation
#19457 opened Jun 11, 2025 by davidxia Loading…
8
[Misc] Add logfmt8 quantization support
#19456 opened Jun 11, 2025 by anniehu17 • Draft
4 tasks
2
[Bugfix] Update the example code, make it work with the latest lmcache documentation Improvements or additions to documentation ready ONLY add when PR is ready to merge/full CI is needed
#19453 opened Jun 11, 2025 by runzhen Loading…
4
Enforce contiguous input for dynamic_per_token FP8/INT8 quant
#19452 opened Jun 11, 2025 by mgoin Loading…
7
[BugFix] Work-around incremental detokenization edge case error bug Something isn't working v1
#19449 opened Jun 10, 2025 by njhill Loading…
1
8
Draft: WIP NixlConnector drop ZMQ in favor of HTTP metadata exchanges frontend needs-rebase v1
#19447 opened Jun 10, 2025 by wseaton Loading…
2 of 7 tasks
25
[V1] Change return type on get_multimodal_embeddings() llama Related to Llama models ready ONLY add when PR is ready to merge/full CI is needed v1
#19446 opened Jun 10, 2025 by russellb Loading…
40
[Kernel] Integrate IBM/Applied-AI fused moe kernels
#19443 opened Jun 10, 2025 by varun-sundar-rabindranath • Draft
15
[Misc] Update lmcache connector with the latest connector apis
#19441 opened Jun 10, 2025 by YaoJiayi Loading…
3
[Chore] debloat some initial logs frontend ready ONLY add when PR is ready to merge/full CI is needed
#19438 opened Jun 10, 2025 by aarnphm Loading…
8
[BugFix] Honor enable_caching in connector-delayed kvcache load case bug Something isn't working v1
#19435 opened Jun 10, 2025 by njhill Loading…
7
[WIP][FP8] ScaledMM refactor needs-rebase
#19434 opened Jun 10, 2025 by ProExpertProg • Draft
4 tasks
8
Fixed power build by building numba from source ci/build
#19433 opened Jun 10, 2025 by npanpaliya Loading…
4 tasks
3
[Quantization] Improve AWQ logic
#19431 opened Jun 10, 2025 by jeejeelee Loading…
4 tasks
5
[Bugfix]: fix JSON decode error when tool call argument is empty frontend
#19428 opened Jun 10, 2025 by my-git9 Loading…
1
3
Mistral tool parser streaming update frontend tool-calling
#19425 opened Jun 10, 2025 by avigny Loading…
7
[Misc][Benchmarking] Add variable request-rate ("ramp-up") to the benchmarking client.
#19423 opened Jun 10, 2025 by dtransposed Loading…
20
Added FP8 support quantization support to DualChunkFlashAttentionBackend
#19420 opened Jun 10, 2025 by ExtReMLapin Loading…
8
ProTip! What’s not been updated in a month: updated:<2025-05-11.