Skip to content

Latest commit

 

History

History
23 lines (21 loc) · 388 Bytes

README.md

File metadata and controls

23 lines (21 loc) · 388 Bytes
Raw

Toy Example

Rank 0

$ python3 -m torch.distributed.launch \
    --nproc_per_node=1 \
    --nnodes=2 \
    --node_rank=0 \
    --master_addr="127.0.0.1" \
    --master_port=1234 \
    main.py

Rank 2

$ python3 -m torch.distributed.launch \
    --nproc_per_node=1 \
    --nnodes=2 \
    --node_rank=1 \
    --master_addr="127.0.0.1" \
    --master_port=1234 \
    main.py