3PC: Three Point Compressors for Communication-Efficient Distributed Training and a Better Theory for Lazy Aggregation
This repository contains Python 3 source code for the experimental part of the paper titled "3PC: Three Point Compressors for Communication-Efficient Distributed Training and a Better Theory for Lazy Aggregation" (arXiv, ICML).
In case you find the paper or code useful for your research, please consider citing it in your work.
@inproceedings{richtarik20223pc,
title={3PC: Three point compressors for communication-efficient distributed training and a better theory for lazy aggregation},
author={Richt{\'a}rik, Peter and Sokolov, Igor and Gasanov, Elnur and Fatkhullin, Ilyas and Li, Zhize and Gorbunov, Eduard},
booktitle={International Conference on Machine Learning},
pages={18596--18648},
year={2022},
organization={PMLR}
}