Skip to content

VPTQ/ik_llama.cpp

Error
Looks like something went wrong!

About

llama.cpp clone with additional SOTA quants and improved CPU performance

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • C++ 57.9%
  • C 19.4%
  • Cuda 7.8%
  • Python 6.2%
  • Metal 3.5%
  • Objective-C 2.5%
  • Other 2.7%