Skip to content

VPTQ/llama.cpp

Error
Looks like something went wrong!

About

LLM inference in C/C++

Resources

License

Security policy

Stars

Watchers

Forks

Packages

No packages published

Languages

  • C++ 57.7%
  • C 20.2%
  • Cuda 7.4%
  • Python 6.8%
  • Metal 2.5%
  • Objective-C 2.2%
  • Other 3.2%