DDP

dataset

use:cifar10

you can use:

python -m torch.distributed.launch --nproc_per_node=4 --nnodes=1 --master_port 29501 train.py
to train model on 4 gpu

Name		Name	Last commit message	Last commit date
Latest commit History 2 Commits
1gpu_5epoch		1gpu_5epoch
2gpu_5epoch		2gpu_5epoch
4gpu_5epoch		4gpu_5epoch
README.md		README.md
net.pt		net.pt
resnet50_1.params		resnet50_1.params
test.py		test.py
train.py		train.py