Skip to content

Commit

Permalink
Update on "[Gradient Compression] Refactor default_hooks.py and power…
Browse files Browse the repository at this point in the history
…SGD_hook.py by creating a util function that make a vanilla allreduce future"

Address #50973 (comment)

Original PR issue: Investigate Applying PowerSGD to Communication Hook for Gradient Compression #47202

Differential Revision: [D26070147](https://our.internmc.facebook.com/intern/diff/D26070147/)

[ghstack-poisoned]
  • Loading branch information
wayi committed Jan 26, 2021
1 parent 7e4cd04 commit 0f57dfa
Showing 1 changed file with 1 addition and 1 deletion.
Original file line number Diff line number Diff line change
Expand Up @@ -127,7 +127,7 @@ def maybe_increase_iter(self, bucket):

if self.iter == self.start_powerSGD_iter:
logging.info(
"Starting to apply PowerSGD after {} iterations.".format(self.iter)
"Start to apply PowerSGD after {} iterations.".format(self.iter)
)


Expand Down

0 comments on commit 0f57dfa

Please sign in to comment.