Skip to content

viable/strict/1787959238

@thisisatharva-rh thisisatharva-rh tagged this 28 Aug 19:29
### Summary
Integrates the `torch.distributed._watchdog` timeout machinery into symmetric  memory's blocking and stream-based operations so that hangs in multi-process rendezvous or one-sided NCCL ops are detected and surfaced instead of blocking silently.

### Test Plan

```
python test/distributed/test_symmetric_memory.py -k SymmMemWatchdogUnitTest
torchrun --nproc_per_node=2 test/distributed/test_nccl.py -k NCCLSymmMemWatchdogTest
```

Authored with AI assistance
Pull Request resolved: https://github.com/pytorch/pytorch/pull/193834
Approved by: https://github.com/d4l3k
Assets 2
Loading