Popular repositories

1. ps_pytorch ps_pytorch Public

   implement distributed machine learning with Pytorch + OpenMPI

   Python 52 15

2. PyTorch-parameter-server PyTorch-parameter-server Public

   Implementation of Parameter Server using PyTorch communication lib

   Python 42 13

3. Cuttlefish Cuttlefish Public

   The implementation for MLSys 2023 paper: "Cuttlefish: Low-rank Model Training without All The Tuning"

   Python 40 5

4. ATOMO ATOMO Public

   Atomo: Communication-efficient Learning via Atomic Sparsification

   Python 25 5

5. Draco Draco Public

   DRACO: Byzantine-resilient Distributed Training via Redundant Gradients

   Python 23 11

6. DETOX DETOX Public

   DETOX: A Redundancy-based Framework for Faster and More Robust Gradient Aggregation

   Python 16 2