Skip to content
master
Switch branches/tags
Go to file
Code

Latest commit

 

Git stats

Files

Permalink
Failed to load latest commit information.
Type
Name
Latest commit message
Commit time
 
 
 
 
 
 
 
 

README.md

TSSM: Distributed Deep Learning via Tunable Subnetwork Splitting Method

This is a simple demo of Tunable Subnetwork Splitting Method (TSSM) as described in our paper:

Junxiang Wang, Zheng Chai, Yue Cheng, and Liang Zhao. Tunable Subnetwork Splitting for Model-parallelism of Neural Network Training. (ICML 2020 Workshop: Beyond First Order Methods in Machine Learning)

Installation

python setup.py install

Requirements

tensorflow 2.1.0

numpy 1.18.1

scipy 1.4.1

keras 2.3.1

tensorflow_datasets 1.3.2

Run the Demo

python main.py

Data

Three benchmark datasets MNIST, Fashion-MNIST, kMNIST are included in this package.

Cite

Please cite our paper if you use this code in your own work:

@article{wang2020,

author = {Wang, Junxiang and Zheng Chai and Yue Chen and Zhao, Liang},

title = {Tunable Subnetwork Splitting for Model-parallelism of Neural Network Training},

year = {2020},

booktitle = {ICML 2020 Workshop: Beyond First Order Methods in Machine Learning},

}

About

No description, website, or topics provided.

Resources

Releases

No releases published

Packages

No packages published

Languages