Skip to content

shreyas88/parallel-mlp-pytorch

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

64 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

run.py: contains the main script
dist_utils.py: Utility to launch pytorch distributed process
column_parallel.py: Column parallel MLP layer
row_parallel.py : Row parallel MLP layer
base_mlp.py: Standard reference implementation

About

parallel-mlp-pytorch

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages