Search results

[RFC][PP]: Integrate Token Throttling into vLLM

RFC

Status: Open.

#20298 In vllm-project/vllm;

· gty111 opened on Jul 1, 2025

[Feature]: rest api multimodal placeholder prompts

feature requestNew feature or requestNew feature or request

Status: Open.

#20293 In vllm-project/vllm;

· roadr opened on Jul 1, 2025

[Bug]: vLLM Crashes When Using N-gram Speculative Decoding with LoRA

bugSomething isn't workingSomething isn't working

Status: Open.

#20284 In vllm-project/vllm;

· Kovbo opened on Jun 30, 2025

[RFC][UX][torch.compile][CUDAGraph]: Overhaul <code>CompilationConfig</code> and improve CLI <code>-O&lt;n&gt;</code>

RFC

Status: Open.

#20283 In vllm-project/vllm;

· ProExpertProg opened on Jun 30, 2025

[Usage]: NCCL Hang/Deadlock with Mixed GPU Setup (RTX 5070 &amp; RTX 3080)

usageHow to use vllmHow to use vllm

Status: Open.

#20282 In vllm-project/vllm;

· haperezf opened on Jun 30, 2025

[Installation]: Source installation failing on H100

installationInstallation problemsInstallation problems

Status: Open.

#20276 In vllm-project/vllm;

· buddhapuneeth opened on Jun 30, 2025

remove the extra ":" while saving the results

Status: Open.

#20274 In vllm-project/vllm;

· bmdivakar opened on Jun 30, 2025

[RFC]: Online inference benchmark tool for multi-turn conversations

RFC

Status: Open.

#20265 In vllm-project/vllm;

· pliops-daniels opened on Jun 30, 2025

[Performance]: vllm taking high startup time even with persisting the torch compile between pod scaling

performancePerformance-related issuesPerformance-related issues

Status: Open.

#20264 In vllm-project/vllm;

· MonishaGGowda opened on Jun 30, 2025

[Bug]: Prefix caching ignores visual input, causing incorrect multimodal outputs under concurrency

bugSomething isn't workingSomething isn't working

Status: Open.

#20261 In vllm-project/vllm;

· Richar-Du opened on Jun 30, 2025

[Usage]: Triton compilation error (f16 to f16 conversion) on Tesla T4 with Qwen2.5-0.5B-Instruct and LoRA

usageHow to use vllmHow to use vllm

Status: Open.

#20259 In vllm-project/vllm;

· MarkYav opened on Jun 30, 2025

[Feature]: Limit total GPU memory

feature requestNew feature or requestNew feature or request

Status: Open.

#20256 In vllm-project/vllm;

· vitush93 opened on Jun 30, 2025