- [x] https://github.com/vllm-project/vllm/pull/27615 - [x] https://github.com/vllm-project/vllm/pull/27756 - [x] https://github.com/vllm-project/vllm/pull/26866 - [x] https://github.com/vllm-project/vllm/pull/27910 - [x] https://github.com/vllm-project/vllm/pull/27922 - [x] https://github.com/vllm-project/vllm/pull/27648 - [x] https://github.com/vllm-project/vllm/pull/28012 - perf fix for regression in `#26866` - [x] https://github.com/vllm-project/vllm/pull/28250 - [x] https://github.com/vllm-project/vllm/pull/28706 - [x] https://github.com/vllm-project/vllm/pull/28744 - [x] https://github.com/vllm-project/vllm/pull/28787 - [x] https://github.com/vllm-project/vllm/pull/24799 - [x] https://github.com/vllm-project/vllm/pull/29355 - [x] https://github.com/vllm-project/vllm/pull/29372 - [x] Address general duplicate request ids issue: - https://github.com/vllm-project/vllm/pull/27987 - [x] https://github.com/vllm-project/vllm/pull/31332 - [x] https://github.com/vllm-project/vllm/pull/31373 - [x] https://github.com/vllm-project/vllm/pull/27614 - [ ] Follow-on async scheduling + spec decode hardening/compatibility issues (in parallel) - [x] https://github.com/vllm-project/vllm/pull/29223 - [ ] https://github.com/vllm-project/vllm/pull/29821 - [ ] Explore Async Scheduling + Pipeline Parallel
[AsyncScheduling] Make async overlap work with logprobs #27615
[BugFix] Handle unscheduled requests properly when async scheduling #27756
[Core] Async scheduling + structured outputs compatibility #26866
[BugFix] Fix mixed penalties batch with async scheduling #27910
[AsyncScheduling] Don't schedule past request max_tokens #27922
[KV offload] Offloading connector async scheduling support #27648
[PerfFix] Avoid separate thread for MP executor shm spin #28012 - perf fix for regression in
#26866[Core] Rework handling of async scheduling config #28250
[BugFix] Fix multi-modal async scheduling race condition #28706
[Test] Rework e2e async scheduling tests #28744
[BugFix] Fix async scheduling + chunked prefill + preemption #28787
[Core] Async Scheduling X Spec Decoding Compatibility #24799
[BugFix] Fix duplicate req id tool-call race condition #29355
[BugFix] Use unique ids for different transcription prompts #29372
Address general duplicate request ids issue:
[BugFix] Fix async scheduling + reasoning with struct output #31332
[BugFix] Re-fix async multimodal cpu tensor race condition #31373
[Core] Enable async scheduling by default #27614
Follow-on async scheduling + spec decode hardening/compatibility issues (in parallel)
Explore Async Scheduling + Pipeline Parallel