[Gradient Compression] Make GradBucket class public

[wayi1]

Stack from ghstack:

• [Gradient Compression] Make GradBucket class public #53099 [Gradient Compression] Make GradBucket class public
• [Gradient Compression] Refactor tensor grouping in PowerSGD #52981 [Gradient Compression] Refactor tensor grouping in PowerSGD

Publish GradBucket APIs for publishing DDP communication hooks.

s/_GradBucket/GradBucket

Differential Revision: D26721121

[facebook-github-bot]

💊 CI failures summary and remediations

As of commit 1341e73 (more details on the Dr. CI page):

---

• 5/5 failures possibly* introduced in this PR
  • 1/5 non-scanned failure(s)

---

🕵️ 2 new failures recognized by patterns

The following CI failures do not appear to be due to upstream breakages:

pytorch_linux_xenial_py3_6_gcc5_4_build (1/2)

Step: "(Optional) Merge target branch" (full log | diagnosis details | 🔁 rerun)

Automatic merge failed; fix conflicts and then commit the result.

Turn off this advice by setting config variable advice.detachedHead to false

HEAD is now at 1341e7382c Update on "[Gradient Compression] Make GradBucket class public"
+ git reset --hard 1341e7382cc8258a04bdf7941de9e1ec560534ee
HEAD is now at 1341e7382c Update on "[Gradient Compression] Make GradBucket class public"
+ git merge --allow-unrelated-histories --no-edit --no-ff 14a2ef09320814fb7f9a0084f1b9744edc816992
Auto-merging torch/distributed/algorithms/ddp_comm_hooks/powerSGD_hook.py
CONFLICT (content): Merge conflict in torch/distributed/algorithms/ddp_comm_hooks/powerSGD_hook.py
Removing aten/src/ATen/native/vulkan/ops/Mul.cpp
Removing aten/src/ATen/native/vulkan/ops/Add.cpp
Automatic merge failed; fix conflicts and then commit the result.


Exited with code exit status 1

pytorch_xla_linux_bionic_py3_6_clang9_build (2/2)

Step: "(Optional) Merge target branch" (full log | diagnosis details | 🔁 rerun)

Automatic merge failed; fix conflicts and then commit the result.

Turn off this advice by setting config variable advice.detachedHead to false

HEAD is now at 1341e7382c Update on "[Gradient Compression] Make GradBucket class public"
+ git reset --hard 1341e7382cc8258a04bdf7941de9e1ec560534ee
HEAD is now at 1341e7382c Update on "[Gradient Compression] Make GradBucket class public"
+ git merge --allow-unrelated-histories --no-edit --no-ff 14a2ef09320814fb7f9a0084f1b9744edc816992
Auto-merging torch/distributed/algorithms/ddp_comm_hooks/powerSGD_hook.py
CONFLICT (content): Merge conflict in torch/distributed/algorithms/ddp_comm_hooks/powerSGD_hook.py
Removing aten/src/ATen/native/vulkan/ops/Mul.cpp
Removing aten/src/ATen/native/vulkan/ops/Add.cpp
Automatic merge failed; fix conflicts and then commit the result.


Exited with code exit status 1

---

2 failures not recognized by patterns:

Job	Step	Action
pytorch_linux_bionic_py3_8_gcc9_coverage_test1	Run tests	🔁 rerun
pytorch_linux_bionic_py3_8_gcc9_coverage_test2	Run tests	🔁 rerun

---

This comment was automatically generated by Dr. CI (expand for details).

Follow this link to opt-out of these comments for your Pull Requests.

Please report bugs/suggestions to the (internal) Dr. CI Users group.

[rohan-varma]

Looks good, though could you post a screenshot of how the grad bucket docs are rendered?

[wayi1]

Looks good, though could you post a screenshot of how the grad bucket docs are rendered?

It's not included in ddp_comm_hooks.rst. Will update the rst file in a separate PR.

[rohan-varma]

LGTM, please make sure all tests pass before landing. Would also be great to expose this in the docs in a follow up change as you mentioend.

[facebook-github-bot]

This pull request has been merged in 68b6249.