Pinned

1. vllm-gptq vllm-gptq Public

   Forked from vllm-project/vllm

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python 122 15

2. exl2-for-all exl2-for-all Public

   EXL2 quantization generalized to other models.

   Python 6

3. QuIP-for-all QuIP-for-all Public

   QuIP quantization

   Python 34 2

4. llama-cpp-torch llama-cpp-torch Public

   llama.cpp to PyTorch Converter

   Cuda 10 5