Pinned

1. PygmalionAI/aphrodite-engine PygmalionAI/aphrodite-engine Public

   PygmalionAI's large-scale inference engine

   Python 596 77

2. pygmalion.cpp pygmalion.cpp Public archive

   C/C++ implementation of PygmalionAI/pygmalion-6b

   C 57 5

3. sparsegpt-for-LLaMA sparsegpt-for-LLaMA Public

   Forked from IST-DASLab/sparsegpt

   Code for the paper "SparseGPT: Massive Language Models Can Be Accurately Pruned in One-Shot" with LLaMA implementation.

   Python 66 4

4. RPTQ-for-LLaMA RPTQ-for-LLaMA Public

   Forked from hahnyuan/RPTQ4LLM

   Efficient 3bit/4bit quantization of LLaMA models

   Python 18

5. gptq-gptj gptq-gptj Public

   Forked from IST-DASLab/gptq

   Code for the paper "GPTQ: Accurate Post-training Quantization of Generative Pretrained Transformers" with GPT-J implementation.

   Python 15 4

6. VNParser VNParser Public

   Project aimed at make a universal VN parser

   Python 4