Skip to content

Pull requests: vllm-project/vllm

New pull request New
260 Open 1,753 Closed
260 Open 1,753 Closed
Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Milestones
Filter by milestone
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

[Bugfix] Fix arguments passed to Sequence in stop checker test
#5092 opened May 29, 2024 by DarkLight1337 Loading…
[Core][Optimization] remove vllm-nccl
#5091 opened May 28, 2024 by youkaichao Loading…
New vllm CLI
#5090 opened May 28, 2024 by EthanqX Loading…
[Model] Support MAP-NEO model
#5081 opened May 28, 2024 by xingweiqu Loading…
[Core][CUDA Graph] add output buffer for cudagraph to reduce memory footprint
#5074 opened May 27, 2024 by youkaichao Loading…
5
[CI/Build][Misc] Add scripts that performs a fair comparison between vLLM and alternatives (TGI and TRT)
#5073 opened May 27, 2024 by KuntaiDu Loading…
1 of 4 tasks
2
[Misc] Add a test case for 'microsoft/Phi-3-small-8k-instruct', because special tokens can cause a crash
#5068 opened May 27, 2024 by AllenDou Loading…
[WIP] Hete spec decode
#5065 opened May 27, 2024 by jiqing-feng • Draft
[Model] Add Internlm2 LoRA support
#5064 opened May 27, 2024 by Isotr0py Loading…
2
1
[Frontend] Add tokenize/detokenize endpoints
#5054 opened May 26, 2024 by sasha0552 Loading…
5
[Bugfix] Adds outlines performance improvement
#5053 opened May 26, 2024 by lynkz-matt-psaltis • Draft
Chat method for offline llm
#5049 opened May 25, 2024 by nunjunj Loading…
1
1
Use TORCH_LIBRARY instead of PYBIND11_MODULE for custom ops
#5047 opened May 25, 2024 by bnellnm • Draft
Bump version to v0.4.3
#5046 opened May 25, 2024 by simon-mo Loading…
ci draft
#5040 opened May 24, 2024 by khluu • Draft
[Model] Enable FP8 QKV in MoE and refine kernel tuning script
#5039 opened May 24, 2024 by comaniac Loading…
2
[Core] Change LoRA embedding sharding to support loading methods
#5038 opened May 24, 2024 by Yard1 Loading…
4
[Kernel] Dynamic Per-Token Activation Quantization
#5037 opened May 24, 2024 by dsikka • Draft
[Kernel][RFC] Refactor the punica kernel based on Triton
#5036 opened May 24, 2024 by jeejeelee • Draft
2 of 3 tasks
10
[CI/Build] CMakeLists: build all extensions' cmake targets at the same time
#5034 opened May 24, 2024 by dtrifiro Loading…
4
[FRONTEND] OpenAI tools support named functions
#5032 opened May 24, 2024 by br3no Loading…
1
2
[Bugfix] logprobs is not compatible with the OpenAI spec #4795
#5031 opened May 24, 2024 by Etelis Loading…
1
11
[BUGFIX] [FRONTEND] Correct chat logprobs
#5029 opened May 24, 2024 by br3no Loading…
1
23
[Bugfix][Frontend] Fix format of returned logprobs for OpenAI Chat Completions API
#5026 opened May 24, 2024 by DarkLight1337 Loading…
1
2
[Kernel] Initial commit containing new Triton kernels for multi lora serving.
#5025 opened May 24, 2024 by FurtherAI Loading…
2
ProTip! What’s not been updated in a month: updated:<2024-04-28.