Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Gradient Compression] Add error feedback to layerwise PowerSGD #49418

Closed
wants to merge 2 commits into from
Closed

[Gradient Compression] Add error feedback to layerwise PowerSGD #49418

wants to merge 2 commits into from

Commits on Dec 15, 2020

  1. [Gradient Compression] Add error feedback 

    Add the error feedback to the original implementation of PowerSGD.

Original PR issue: Investigate Applying PowerSGD to Communication Hook for Gradient Compression #47202

Differential Revision: [D25555538](https://our.internmc.facebook.com/intern/diff/D25555538/)

[ghstack-poisoned]
    wayi committed Dec 15, 2020
    Configuration menu
    Copy the full SHA
    bcdaf5b View commit details
    Browse the repository at this point in the history

Commits on Dec 16, 2020

  1. Update on "[Gradient Compression] Add error feedback" 

    Add the error feedback to the original implementation of PowerSGD.

Original PR issue: Investigate Applying PowerSGD to Communication Hook for Gradient Compression #47202

Differential Revision: [D25555538](https://our.internmc.facebook.com/intern/diff/D25555538/)

[ghstack-poisoned]
    wayi committed Dec 16, 2020
    Configuration menu
    Copy the full SHA
    960c458 View commit details
    Browse the repository at this point in the history