Skip to content

sgl-project/sglang

Error
Looks like something went wrong!

About

SGLang is a fast serving framework for large language models and vision language models.

docs.sglang.ai/

Topics

cuda inference pytorch transformer moe llama vlm llm llm-serving llava deepseek-llm deepseek llama3 llama3-1 deepseek-v3 deepseek-r1 deepseek-r1-zero qwen3 llama4

Resources

Readme

License

Apache-2.0 license
Activity
Custom properties

Stars

14.8k stars

Watchers

105 watching

Forks

1.9k forks
Report repository

Releases 23

Release v0.4.6 Latest
Apr 27, 2025
+ 22 releases

Packages

No packages published

Contributors 459

+ 445 contributors

Languages