Multigpu test configs intermittently timeout

[malfet]

🐛 Describe the bug

From https://hud.pytorch.org/ci/pytorch/pytorch/master?name_filter=multigpu
For example see
https://github.com/pytorch/pytorch/runs/4491157342?check_suite_focus=true
https://github.com/pytorch/pytorch/runs/4494906997?check_suite_focus=true
https://github.com/pytorch/pytorch/runs/4515348059?check_suite_focus=true
https://github.com/pytorch/pytorch/runs/4516653541?check_suite_focus=true
https://github.com/pytorch/pytorch/runs/4520760224?check_suite_focus=true
https://github.com/pytorch/pytorch/runs/4524464202?check_suite_focus=true
https://github.com/pytorch/pytorch/runs/4524930515?check_suite_focus=true
https://github.com/pytorch/pytorch/runs/4526311049?check_suite_focus=true
https://github.com/pytorch/pytorch/runs/4526553164?check_suite_focus=true
https://github.com/pytorch/pytorch/runs/4526686943?check_suite_focus=true
https://github.com/pytorch/pytorch/runs/4538152008?check_suite_focus=true

Versions

Irrelevant

cc @ezyang @gchanan @zou3519 @bdhirsh @ngimel @seemethere @malfet @pytorch/pytorch-dev-infra

[malfet]

Looks like no reaction here, it still affects people, I'm going to disable those

[ngimel]

It's weird, the tests that run run pretty quickly, in couple minutes, and then nothing happens for 4 hours until timeout.

[suo]

cc @rohan-varma as well

[suo]

@malfet shall we disable the cpp tests, at least to see if it stops the hangs?

[suo]

#71015