Skip to content


Switch branches/tags

Name already in use

A tag already exists with the provided branch name. Many Git commands accept both tag and branch names, so creating this branch may cause unexpected behavior. Are you sure you want to create this branch?

Latest commit


Git stats


Failed to load latest commit information.
Latest commit message
Commit time

Materials regarding decentralized AI research.

Consensus Optimization

This includes literatures on consensus optimization (mainly from mainly control community). Hopefully one can borrow theory from them to build fully decentralized algorithms.

  • Dual averaging for distributed optimization: Convergence analysis and network scaling
    2012 IEEE Transactions on Automatic control. Duchi, John C and Agarwal, Alekh and Wainwright, Martin J

  • On the convergence of decentralized gradient descent.
    2016 SIAM Journal on Optimization. Yuan, Kun and Ling, Qing and Yin, Wotao

  • DSA: Decentralized double stochastic averaging gradient algorithm
    2016 JMLR. Mokhtari, Aryan and Ribeiro, Alejandro.

Decentralized SGD

  • Can decentralized algorithms outperform centralized algorithms? a case study for decentralized parallel stochastic gradient descent.
    NIPS 2017. Xiangru Lian, Ce Zhang, Huan Zhang, Cho-Jui Hsieh, Wei Zhang, and Ji Liu

  • D^2: Decentralized training over decentralized data.
    ICML 2018. Hanlin Tang, Xiangru Lian, Ming Yan, Ce Zhang, and Ji Liu.

Decentralized Linear Learning

  • COLA: Decentralized Linear Learning
    NIPS 2018. *Lie He, *An Bian, Martin Jaggi

Federated Learning & Optimization

This is one recent setting proposed to solve one existing decentralized data setting, but the algorithms therein are still centralized algorithms.

  • Communication-Efficient Learning of Deep Networks from Decentralized Data
    2017 AISTATS. McMahan, Brendan and Moore, Eider and Ramage, Daniel and Hampson, Seth and y Arcas, Blaise Aguera

Mobile AI

This is one emerging setting where one wants to learn an intelligent model for mobile devices, such as mobile phones, tablets etc.

Gossip Algorithm

  • Randomized gossip algorithms
    2006 EEE transactions on information theory. Boyd, Stephen and Ghosh, Arpita and Prabhakar, Balaji and Shah, Devavrat

  • Gossip algorithms
    2009 Foundations and Trends in Networking. Shah, Devavrat



Interplanetary File System (IPFS)


Materials regarding decentralized AI.






No releases published


No packages published