v0.5.0rc1

What's Changed

• [Feat] Adding an environment variable input by @Menglths in #837
• [opt] Add parallel size check in CI by @flesher0813 in #844
• [fix]Add timeout in PosixStore working thread by @qyh111 in #849
• [feat] Ascend: add mmap-based Host memory for O_DIRECT support by @mag1c-h in #850
• [opt] Remove redundant step(Install GTest) from the workflow. by @mag1c-h in #851
• [opt] Cancel the Load/Dump task proactively after it times out. by @mag1c-h in #853
• [Feat] Add mindie-llm support by @nrj868 in #848
• [opt] Cancel all timed-out tasks at once. by @mag1c-h in #859
• [bugfix] Update seq_lens_list only on NPU path by @wangwenxin0312 in #860
• [feat] Store provides the ability to configure CPU affinity. by @mag1c-h in #852
• [opt] Optimize GSA by fusing operators by @Fengli5355 in #861
• [feat] Support kvcsstore by @ayaka836 in #855
• [feat] Add NUMA-aware CPU core split for vllm worker and store threads by @wangwenxin0312 in #854
• [Bugfix] fix offline patch by @Infinite666 in #864
• [fix] Update patch to track mindie changes by @nrj868 in #863
• [CI] Add gsa online test by @dante159753 in #857
• [opt] stack-protector on EmptyStore by @mag1c-h in #866
• [opt] Enhance NPU CPU affinity resolution with NUMA fallback by @wangwenxin0312 in #865
• [bugfix] Get all CPUs for the device's local socket by @wangwenxin0312 in #869
• add timeout for PR gate pipeline by @dante159753 in #862
• [refactor] Remove NVML-based CPU affinity setting by @wangwenxin0312 in #870
• [feat] Add tensor parallel size support and update GPU memory utilization for online inference tests by @hmy98213 in #874
• [fix]Submit layerwise KV load tasks one layer at a time by @qyh111 in #783
• [feat] log with rate limit by @Lijiachen1018 in #821
• [Feat] adapt for DSA model on CUDA platform by @sumingZero in #871
• [Build] Update UCM Dockerfiles for vLLM/vLLM-Ascend v0.17.0 by @yuanzhg078 in #876
• [Usage] Move use layerwise and hit ratio into config file by @harrisonyhq in #784
• [test] multi-processor test on AIO and Shm by @mag1c-h in #873
• [Feature] Garbage Collection by @UESTC-AHao in #777
• [CI] add test set config by @dante159753 in #877
• [bugfix] Fix MLA block_table row mapping by @wangwenxin0312 in #882
• [doc] Update support matrix. by @yuanzhg078 in #880
• release 0.5.0rc1 by @yuanzhg078 in #881
• [doc] Update framework version compatibility notes by @yuanzhg078 in #885

New Contributors

• @nrj868 made their first contribution in #848

Full Changelog: v0.4.0...v0.5.0rc1