Popular repositories Loading

1. MoE MoE Public

   MoE layer for pytorch

   C++ 1

2. AutoAWQ AutoAWQ Public

   Forked from casper-hansen/AutoAWQ

   AutoAWQ implements the AWQ algorithm for 4-bit quantization with a 2x speedup during inference. Documentation:

   Python 1

3. Megatron-LM Megatron-LM Public

   Forked from NVIDIA/Megatron-LM

   Ongoing research training transformer models at scale

   Python

4. vllm vllm Public

   Forked from vllm-project/vllm

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python

5. DeepSpeed DeepSpeed Public

   Forked from microsoft/DeepSpeed

   DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

   Python

6. Hands-on-GEMM Hands-on-GEMM Public

   Forked from AyakaGEMM/Hands-on-GEMM

   Cuda