Skip to content
Gossip Algorithms and Decentralized SGD with Communication Compression
Branch: master
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Type Name Latest commit message Commit time
Failed to load latest commit information.


Code for the main experiments of the paper Decentralized Stochastic Optimization and Gossip Algorithms with Compressed Communication.

Datasets and Setup

First you need to download datasets from LIBSVM library and convert them into pickle format. For that from

cd data
wget -t inf
wget -t inf
cd ../code

If you get memory error, you can leave rcv1 dataset in the sparse format, but this would slow down training time.

Reproduce the results

For running experiments with the epsilon dataset

python final


If you use this code, please cite the following paper:

  author = {Anastasia Koloskova and Sebastian U. Stich and Martin Jaggi},
  title = {Decentralized Stochastic Optimization and Gossip Algorithms with Compressed Communication},
  booktitle = {ICML 2019 - Proceedings of the 36th International Conference on Machine Learning},
  url = {},
  series = {Proceedings of Machine Learning Research},
  publisher = {PMLR}, 
  volume = {97},
  pages = {3479--3487},
  year = {2019}
You can’t perform that action at this time.