Refactor dynamo distributed test helpers to be reusable

[wconstab]

The point is to let Test helpers previously defined and used in test_dynamo_distributed.py be used from a new file test_traceable_collectives.py later in this stack.

Stack from ghstack (oldest at bottom):

• allred.py demo script (not for land) #93113
• Test for aten::all_reduce #93112
• Inductor support for aten::all_reduce #93111
• Eager impl for aten::all_reduce #93110
• Add aten::all_reduce with meta impl #93109
• -> Refactor dynamo distributed test helpers to be reusable #93187

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/93187

• 📄 Preview Python docs built from this PR
• 📄 Preview C++ docs built from this PR
• ❓ Need help or want to give feedback on the CI? Visit the bot commands wiki or our office hours

Note: Links to docs will display an error until the docs builds have been completed.

❌ 6 Failures

As of commit 7732b77:

NEW FAILURES - The following jobs have failed:

• win-vs2019-cuda11.6-py3 / test (default, 1, 5, windows.g5.4xlarge.nvidia.gpu)
• win-vs2019-cuda11.6-py3 / test (default, 2, 5, windows.g5.4xlarge.nvidia.gpu)
• win-vs2019-cuda11.6-py3 / test (default, 3, 5, windows.g5.4xlarge.nvidia.gpu)
• win-vs2019-cuda11.6-py3 / test (default, 4, 5, windows.g5.4xlarge.nvidia.gpu)
• win-vs2019-cuda11.6-py3 / test (default, 5, 5, windows.g5.4xlarge.nvidia.gpu)
• win-vs2019-cuda11.6-py3 / test (functorch, 1, 1, windows.g5.4xlarge.nvidia.gpu)

This comment was automatically generated by Dr. CI and updates every 15 minutes.

[kumpera]

LGTM.

But please do not use MultiProcessTestCase unless you must. It's super super slow and we're trying to migrate the test suite to our multi threaded PG:

See https://github.com/pytorch/pytorch/blob/master/torch/testing/_internal/distributed/multi_threaded_pg.py

[wconstab]

@pytorchbot merge

[pytorchmergebot]

Merge started

Your change will be merged once all checks pass (ETA 0-4 Hours).

Learn more about merging in the wiki.

Questions? Feedback? Please reach out to the PyTorch DevX Team

Advanced Debugging

Check the merge workflow status
here

[pytorchmergebot]

Merge failed

Reason: 2 jobs have failed, first few of them are: trunk / win-vs2019-cuda11.6-py3 / test (default, 2, 5, windows.g5.4xlarge.nvidia.gpu), trunk / win-vs2019-cuda11.6-py3 / test (default, 4, 5, windows.g5.4xlarge.nvidia.gpu)

Details for Dev Infra team

Raised by workflow job

[wconstab]

@pytorchbot merge -f "flaky ci (windows)"

[pytorchmergebot]

Merge started

Your change will be merged immediately since you used the force (-f) flag, bypassing any CI checks (ETA: 1-5 minutes).

Learn more about merging in the wiki.

Questions? Feedback? Please reach out to the PyTorch DevX Team

Advanced Debugging

Check the merge workflow status
here