🐛 Describe the bug
When running unit testing for model checkpointing, the following exception occurs.
This is because that the _rank_not_in_group API is not exposed at the torch.distributed level with PyTorch 1.9.
Environment
CUDA: 11.1
PyTorch 1.9.1
🐛 Describe the bug
When running unit testing for model checkpointing, the following exception occurs.
This is because that the
_rank_not_in_groupAPI is not exposed at thetorch.distributedlevel with PyTorch 1.9.Environment
CUDA: 11.1
PyTorch 1.9.1