Popular repositories Loading

1. DeepSpeed DeepSpeed Public

   DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

   Python 37.3k 4.3k

2. DeepSpeedExamples DeepSpeedExamples Public

   Example models using DeepSpeed

   Python 6.3k 1.1k

3. Megatron-DeepSpeed Megatron-DeepSpeed Public

   Forked from NVIDIA/Megatron-LM

   Ongoing research training transformer language models at scale, including: BERT & GPT-2

   Python 2k 350

4. DeepSpeed-MII DeepSpeed-MII Public

   MII makes low-latency and high-throughput inference possible, powered by DeepSpeed.

   Python 2k 177

5. DeepSpeed-Kernels DeepSpeed-Kernels Public

   C++ 60 12

6. deepspeed-gpt-neox deepspeed-gpt-neox Public

   Forked from EleutherAI/gpt-neox

   An implementation of model parallel autoregressive transformers on GPUs, based on the DeepSpeed library.

   Python 19 3