Skip to content

gpt_server v0.7.0

Choose a tag to compare

@shell-nlp shell-nlp released this 01 Feb 15:33
· 33 commits to main since this release

gpt_server v0.7.0

What's Changed

  1. 升级 vllm==0.15.0 lmdeploy==0.11.1 sglang==0.5.8
  2. 修改了 vllm 后端的架构