Skip to content

viable/strict/1785786420

@qqaatw qqaatw tagged this 03 Aug 15:16
The current code yields this error:

```
[rank0]: Traceback (most recent call last):
[rank0]:   File "/home/devuser/pytorch/test_symmem.py", line 98, in <module>
[rank0]:     do_mem_pool()
[rank0]:   File "/home/devuser/pytorch/test_symmem.py", line 81, in do_mem_pool
[rank0]:     reduced = torch.ops.symm_mem.one_shot_all_reduce(x, "sum", dist.group.WORLD.group_name)
[rank0]:               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[rank0]:   File "/home/devuser/pytorch/torch/_ops.py", line 1350, in __call__
[rank0]:     return self._op(*args, **kwargs)
[rank0]:            ^^^^^^^^^^^^^^^^^^^^^^^^^
[rank0]: NotImplementedError: "one_shot_all_reduce" not implemented for 'Long'
```

As a side question, is a rendezvous call needed here? After the dtype update the code ran successfully.
Pull Request resolved: https://github.com/pytorch/pytorch/pull/191893
Approved by: https://github.com/soulitzer
Assets 2
Loading