Pinned

1. PygmalionAI/aphrodite-engine PygmalionAI/aphrodite-engine Public

   PygmalionAI's large-scale inference engine

   Python 689 83

2. pygmalion.cpp pygmalion.cpp Public archive

   C/C++ implementation of PygmalionAI/pygmalion-6b

   C 57 5

3. sparsegpt-for-LLaMA sparsegpt-for-LLaMA Public

   Forked from IST-DASLab/sparsegpt

   Code for the paper "SparseGPT: Massive Language Models Can Be Accurately Pruned in One-Shot" with LLaMA implementation.

   Python 68 4

4. tplib tplib Public

   A torch-based, universal tensor-parallel library.

   Python

5. huggingface/transformers huggingface/transformers Public

   🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

   Python 127k 25.2k

6. vllm-project/vllm vllm-project/vllm Public

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python 20.7k 2.9k