[Gradient Compression] Change wait() to value() in some callbacks of PowerSGD communication hook

[wayi1]

Stack from ghstack:

• [Gradient Compression] Directly let world_size = group_to_use.size() #49715 [Gradient Compression] Directly let world_size = group_to_use.size()
• [Gradient Compression] Explicitly restrict the scope of torch.cuda.synchronize to the current device #49711 [Gradient Compression] Explicitly restrict the scope of torch.cuda.synchronize to the current device
• [Gradient Compression] Change wait() to value() in some callbacks of PowerSGD communication hook #49709 [Gradient Compression] Change wait() to value() in some callbacks of PowerSGD communication hook
• [Gradient Compression] Warm-start of PowerSGD #49451 [Gradient Compression] Warm-start of PowerSGD

Since wait() has already been called in the return statements of the precursor callbacks, no need to wait again.

Original PR issue: Investigate Applying PowerSGD to Communication Hook for Gradient Compression #47202

Differential Revision: D25672068

[facebook-github-bot]

💊 CI failures summary and remediations

As of commit 838d1f6 (more details on the Dr. CI page):

---

• 4/4 failures possibly* introduced in this PR
  • 1/4 non-CircleCI failure(s)

---

🕵️ 3 new failures recognized by patterns

The following CI failures do not appear to be due to upstream breakages:

pytorch_linux_xenial_py3_6_gcc5_4_build (1/3)

Step: "(Optional) Merge target branch" (full log | diagnosis details | 🔁 rerun)

Automatic merge failed; fix conflicts and then commit the result.

  git switch -

Turn off this advice by setting config variable advice.detachedHead to false

HEAD is now at 838d1f6f27 Update on "[Gradient Compression] Change wait() to value() in some callbacks of PowerSGD communication hook"
+ git reset --hard 838d1f6f270d25da6d4aa55b99a574cba44ba76f
HEAD is now at 838d1f6f27 Update on "[Gradient Compression] Change wait() to value() in some callbacks of PowerSGD communication hook"
+ git merge --allow-unrelated-histories --no-edit --no-ff 7b4a7661d6de659c8423015a2f3e93308eb83850
Auto-merging torch/distributed/algorithms/ddp_comm_hooks/powerSGD_hook.py
CONFLICT (content): Merge conflict in torch/distributed/algorithms/ddp_comm_hooks/powerSGD_hook.py
Automatic merge failed; fix conflicts and then commit the result.


Exited with code exit status 1

pytorch_xla_linux_bionic_py3_6_clang9_build (2/3)

Step: "(Optional) Merge target branch" (full log | diagnosis details | 🔁 rerun)

Automatic merge failed; fix conflicts and then commit the result.

  git switch -

Turn off this advice by setting config variable advice.detachedHead to false

HEAD is now at 838d1f6f27 Update on "[Gradient Compression] Change wait() to value() in some callbacks of PowerSGD communication hook"
+ git reset --hard 838d1f6f270d25da6d4aa55b99a574cba44ba76f
HEAD is now at 838d1f6f27 Update on "[Gradient Compression] Change wait() to value() in some callbacks of PowerSGD communication hook"
+ git merge --allow-unrelated-histories --no-edit --no-ff 7b4a7661d6de659c8423015a2f3e93308eb83850
Auto-merging torch/distributed/algorithms/ddp_comm_hooks/powerSGD_hook.py
CONFLICT (content): Merge conflict in torch/distributed/algorithms/ddp_comm_hooks/powerSGD_hook.py
Automatic merge failed; fix conflicts and then commit the result.


Exited with code exit status 1

pytorch_linux_xenial_cuda9_2_cudnn7_py3_gcc5_4_build (3/3)

Step: "(Optional) Merge target branch" (full log | diagnosis details | 🔁 rerun)

Automatic merge failed; fix conflicts and then commit the result.

  git switch -

Turn off this advice by setting config variable advice.detachedHead to false

HEAD is now at 838d1f6f27 Update on "[Gradient Compression] Change wait() to value() in some callbacks of PowerSGD communication hook"
+ git reset --hard 838d1f6f270d25da6d4aa55b99a574cba44ba76f
HEAD is now at 838d1f6f27 Update on "[Gradient Compression] Change wait() to value() in some callbacks of PowerSGD communication hook"
+ git merge --allow-unrelated-histories --no-edit --no-ff 7b4a7661d6de659c8423015a2f3e93308eb83850
Auto-merging torch/distributed/algorithms/ddp_comm_hooks/powerSGD_hook.py
CONFLICT (content): Merge conflict in torch/distributed/algorithms/ddp_comm_hooks/powerSGD_hook.py
Automatic merge failed; fix conflicts and then commit the result.


Exited with code exit status 1

---

This comment was automatically generated by Dr. CI (expand for details).

Follow this link to opt-out of these comments for your Pull Requests.

Please report bugs/suggestions to the (internal) Dr. CI Users group.

This comment has been revised 14 times.

[facebook-github-bot]

This pull request has been merged in af1b636.