Skip to content

tmyok/pytorch_DDP_example

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

7 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

pytorch_DDP_example

Example of distributed dataparallel training in PyTorch.

  1. Preprocess

    python3 dataset.py
    
  2. Training

    python3 -m torch.distributed.launch --nproc_per_node=2 train.py
    
  3. Evaluate

    python3 -m torch.distributed.launch --nproc_per_node=1 inference.py
    

About

Example of distributed dataparallel training in PyTorch.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published