Pinned

1. vllm-project/vllm vllm-project/vllm Public

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python 18.9k 2.5k

2. skypilot-org/skypilot skypilot-org/skypilot Public

   SkyPilot: Run LLMs, AI, and Batch jobs on any cloud. Get maximum savings, highest GPU availability, and managed execution—all with a simple interface.

   Python 5.7k 396

3. retraining-free-pruning retraining-free-pruning Public

   [NeurIPS 2022] A Fast Post-Training Pruning Framework for Transformers

   Python 145 21