Popular repositories

1. llama.cpp llama.cpp Public

   Forked from ggerganov/llama.cpp

   Port of Facebook's LLaMA model in C/C++

   C++ 2

2. ggml ggml Public

   Forked from ggerganov/ggml

   Tensor library for machine learning

   C

3. AutoAWQ AutoAWQ Public

   Forked from casper-hansen/AutoAWQ

   AutoAWQ implements the AWQ algorithm for 4-bit quantization with a 2x speedup during inference.

   C++

4. text-generation-inference text-generation-inference Public

   Forked from huggingface/text-generation-inference

   Large Language Model Text Generation Inference

   Python

5. peft peft Public

   Forked from huggingface/peft

   🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

   Python

6. AutoGPTQ AutoGPTQ Public

   Forked from AutoGPTQ/AutoGPTQ

   An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.

   Python