Skip to content

Issues: vllm-project/vllm

[Roadmap] vLLM Roadmap Q1 2025
#11862 opened Jan 8, 2025 by simon-mo
Open 7
[V1] Feedback Thread
#12568 opened Jan 30, 2025 by simon-mo
Open 64
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Clear current search query, filters, and sorts
1,453 Open 5,724 Closed
1,453 Open 5,724 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

vLLM's V1 Engine Architecture RFC
#8779 opened Sep 24, 2024 by simon-mo
1 task done
11 🚀 30
[Roadmap] vLLM Roadmap Q1 2025
#11862 opened Jan 8, 2025 by simon-mo
22 of 38 tasks
7 🚀 29
[RFC]: Hybrid Memory Allocator RFC
#11382 opened Dec 20, 2024 by heheda12345
1 task done
🚀 13
[RFC]: Automate Speculative Decoding RFC stale Over 90 days of inactivity
#4565 opened May 2, 2024 by LiuXiaoxuanPKU
19 🚀 11
[RFC]: A Graph Optimization System in vLLM using torch.compile RFC stale Over 90 days of inactivity
#6378 opened Jul 12, 2024 by bnellnm
8 🚀 8
[RFC]: Add support for IBM Spyre accelerator RFC
#9652 opened Oct 24, 2024 by tdoublep
1 of 6 tasks
5 🚀 8
[RFC]: Implement disaggregated prefilling via KV cache transfer RFC
#5557 opened Jun 14, 2024 by KuntaiDu
17 🚀 8
[RFC]: Pipeline-Parallelism for vLLM V1 RFC v1
#11945 opened Jan 10, 2025 by ruisearch42
1 task done
@youkaichao
17 🚀 6
[RFC]: Disaggregated prefilling and KV cache transfer roadmap RFC
#10818 opened Dec 2, 2024 by KuntaiDu
4 of 28 tasks
@KuntaiDu
19 🚀 6
[Feature]: DeepSeek-R1 tool choice && Function Call feature request New feature or request
#12297 opened Jan 22, 2025 by warlockedward
1 task done
🚀 6
[RFC]: Implement disaggregated prefilling using Mooncake RFC stale Over 90 days of inactivity
#10727 opened Nov 28, 2024 by alogfans
1 task done
1 🚀 5
[Roadmap] vLLM Roadmap Q4 2024
#9006 opened Oct 1, 2024 by simon-mo
22 of 40 tasks
26 🚀 4
[New Model]: support minimax-01 new model Requests to new models
#12073 opened Jan 15, 2025 by liyawei87
1 task done
🚀 4
[Feature]: Integrate Writing in the Margins inference pattern ($5,000 Bounty) feature request New feature or request unstale Recieved activity after being labelled stale
#9807 opened Oct 29, 2024 by melisa-writer
1 task done
16 🚀 3
[RFC]: Hardware pluggable RFC
#11162 opened Dec 13, 2024 by wangxiyuan
1 task done
2 🚀 3
Add support for ReFT feature request New feature or request stale Over 90 days of inactivity
#4413 opened Apr 27, 2024 by RonanKMcGovern
5 🚀 2
[Feature]: Multi-Token Prediction (MTP) feature request New feature or request
#12181 opened Jan 18, 2025 by casper-hansen
1 task done
🚀 2
[Feature]: Add qwen2.5-VL-7B-Instruct video support feature request New feature or request
#13050 opened Feb 10, 2025 by kelvinzhao1
1 task done
11 🚀 2
[RFC]: Async KV Cache Transfer for Disaggregated Inference RFC
#13020 opened Feb 10, 2025 by VertexC
1 task done
1 🚀 2
[RFC]: Enhancing LoRA Management for Production Environments in vLLM RFC stale Over 90 days of inactivity
#6275 opened Jul 10, 2024 by Jeffwan
8 🚀 2
[RFC]: [V1] TPU support and multiple architecture support RFC v1
#12480 opened Jan 27, 2025 by alexm-redhat
1 task done
@alexm-redhat
5 🚀 1
[Feature]: support for Cambricon MLU feature request New feature or request unstale Recieved activity after being labelled stale
#9649 opened Oct 24, 2024 by a120092009
1 task done
4 🚀 1
[Feature]: Expose option to load new model weights from disk feature request New feature or request
#12774 opened Feb 5, 2025 by edbeeching
1 task done
2 🚀 1
[Bug]: [v0.6.5] Streaming tool call responses with the hermes template is inconsistent with the non-stream version. bug Something isn't working
#11392 opened Dec 21, 2024 by elementary-particle
1 task done
1
4 🚀 1
[Performance]: How to Improve Performance Under Concurrency performance Performance-related issues
#9722 opened Oct 26, 2024 by ljwps
1 task done
4 🚀 1
ProTip! Updated in the last three days: updated:>2025-03-14.