Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Gradient Compression] Refactor default_hooks.py and powerSGD_hook.py by creating a util function that make a vanilla allreduce future #51094

Closed
wants to merge 4 commits into from
Closed

[Gradient Compression] Refactor default_hooks.py and powerSGD_hook.py by creating a util function that make a vanilla allreduce future #51094

wants to merge 4 commits into from

Commits on Jan 26, 2021

  1. [Gradient Compression] Refactor default_hooks.py and powerSGD_hook.py… 

    … by creating a util function that make a vanilla allreduce future

Address #50973 (comment)

Original PR issue: Investigate Applying PowerSGD to Communication Hook for Gradient Compression #47202

Differential Revision: [D26070147](https://our.internmc.facebook.com/intern/diff/D26070147/)

[ghstack-poisoned]
    wayi committed Jan 26, 2021
    Configuration menu
    Copy the full SHA
    7e4cd04 View commit details
    Browse the repository at this point in the history

  2. Update on "[Gradient Compression] Refactor default_hooks.py and power… 

    …SGD_hook.py by creating a util function that make a vanilla allreduce future"

Address #50973 (comment)

Original PR issue: Investigate Applying PowerSGD to Communication Hook for Gradient Compression #47202

Differential Revision: [D26070147](https://our.internmc.facebook.com/intern/diff/D26070147/)

[ghstack-poisoned]
    wayi committed Jan 26, 2021
    Configuration menu
    Copy the full SHA
    0f57dfa View commit details
    Browse the repository at this point in the history

Commits on Jan 29, 2021

  1. Update on "[Gradient Compression] Refactor default_hooks.py and power… 

    …SGD_hook.py by creating a util function that make a vanilla allreduce future"


Address #50973 (comment)

Original PR issue: Investigate Applying PowerSGD to Communication Hook for Gradient Compression #47202

Differential Revision: [D26070147](https://our.internmc.facebook.com/intern/diff/D26070147/)

[ghstack-poisoned]
    wayi committed Jan 29, 2021
    Configuration menu
    Copy the full SHA
    be1af96 View commit details
    Browse the repository at this point in the history

  2. Update on "[Gradient Compression] Refactor default_hooks.py and power… 

    …SGD_hook.py by creating a util function that make a vanilla allreduce future"


Address #50973 (comment)

Original PR issue: Investigate Applying PowerSGD to Communication Hook for Gradient Compression #47202

Differential Revision: [D26070147](https://our.internmc.facebook.com/intern/diff/D26070147/)

[ghstack-poisoned]
    wayi committed Jan 29, 2021
    Configuration menu
    Copy the full SHA
    2ca21e5 View commit details
    Browse the repository at this point in the history