Skip to content

vllm-project/vllm

Error
Looks like something went wrong!

About

A high-throughput and memory-efficient inference and serving engine for LLMs

docs.vllm.ai

Topics

amd cuda inference pytorch transformer llama gpt rocm model-serving tpu hpu mlops xpu llm inferentia llmops llm-serving qwen deepseek trainium

Resources

Readme

License

Apache-2.0 license

Code of conduct

Code of conduct

Security policy

Security policy
Activity
Custom properties

Stars

49.2k stars

Watchers

390 watching

Forks

7.9k forks
Report repository

Releases 63

v0.9.0.1 Latest
May 30, 2025
+ 62 releases

Sponsor this project

  •  
Learn more about GitHub Sponsors

Contributors 1,198

+ 1,184 contributors

Languages