Skip to content

sleepwalker2017/lmdeploy

Error
Looks like something went wrong!

About

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • C++ 49.9%
  • Cuda 34.7%
  • Python 12.7%
  • CMake 2.3%
  • Shell 0.3%
  • C 0.1%