Skip to content

boshallen/lmdeploy

Error
Looks like something went wrong!

About

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Python 47.2%
  • C++ 34.4%
  • Cuda 16.7%
  • CMake 1.4%
  • Shell 0.3%
  • Dockerfile 0.0%