Skip to content

[refactor] OSS - broadcasts - getting rid of the while loop#165

Merged
blefaudeux merged 3 commits intomasterfrom
oss_broadcast_refactor
Oct 23, 2020
Merged

[refactor] OSS - broadcasts - getting rid of the while loop#165
blefaudeux merged 3 commits intomasterfrom
oss_broadcast_refactor

Conversation

@blefaudeux
Copy link
Copy Markdown
Contributor

Before submitting

  • Was this discussed/approved via a Github issue? (no need for typos, doc improvements)
  • Did you read the contributor guideline?
  • Did you make sure to update the docs?
  • Did you write any new necessary tests?

What does this PR do?

No logic changes, still doing the exact same thing as before, bucket the first small params, broadcast asynchronously, then directly broadcast the rest and get back to the bucket

PR review

Anyone in the community is free to review the PR once the tests have passed.
If we didn't discuss your PR in Github issues there's a high chance it will not be merged.

Did you have fun?

Make sure you had fun coding 🙃

@blefaudeux blefaudeux marked this pull request as draft October 23, 2020 17:54
@blefaudeux blefaudeux marked this pull request as ready for review October 23, 2020 18:15
@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Oct 23, 2020
Comment thread fairscale/optim/oss.py Outdated
Copy link
Copy Markdown
Contributor

@min-xu-ai min-xu-ai left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM! nice refactoring

@blefaudeux blefaudeux merged commit a31b08a into master Oct 23, 2020
@blefaudeux blefaudeux deleted the oss_broadcast_refactor branch October 23, 2020 23:37
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants