https://github.com/sgl-project/sglang SGLang is much faster than vllm and lmdeploy, and is integrated by llamafactory, lighteval and many other famous projects. SGLang 比 vllm 和 lmdeploy 快得多,并且被 llamafactory、lighteval 和许多其他著名项目集成。
Activity
Jintao-Huang commentedon Mar 15, 2025
会支持的
xihuai18 commentedon Apr 8, 2025
any process in supporting SGLang? @Jintao-Huang