Skip to content

abacusai/vllm

Error
Looks like something went wrong!

About

A high-throughput and memory-efficient inference and serving engine for LLMs

Resources

License

Code of conduct

Security policy

Stars

Watchers

Forks

Packages

No packages published

Languages

  • Python 84.3%
  • Cuda 10.4%
  • C++ 3.5%
  • C 0.7%
  • Shell 0.6%
  • CMake 0.4%
  • Dockerfile 0.1%