Tags: neuralmagic/vllm
Tags
Add think chunk (vllm-project#21333) Signed-off-by: Julien Denize <julien.denize@mistral.ai>
Add think chunk (vllm-project#21333) Signed-off-by: Julien Denize <julien.denize@mistral.ai>
Enable v1 metrics tests (vllm-project#20953) Signed-off-by: Seiji Eicher <seiji@anyscale.com>
[Misc] Slight improvement of the BNB (vllm-project#19418) Signed-off-by: Jee Jee Li <pandaleefree@gmail.com> Co-authored-by: Isotr0py <2037008807@qq.com> Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
[Misc] Slight improvement of the BNB (vllm-project#19418) Signed-off-by: Jee Jee Li <pandaleefree@gmail.com> Co-authored-by: Isotr0py <2037008807@qq.com> Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
[Misc] Fix a config typo in disable_hybrid_kv_cache_manager configura… …tion (vllm-project#19383) Signed-off-by: Siyuan Liu <lsiyuan@google.com>
[BugFix] FA2 MLA Accuracy Issue (vllm-project#18807) Signed-off-by: LucasWilkinson <lwilkinson@neuralmagic.com>
PreviousNext