Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Optimization] Use ccl::all2all to simulate gather #56

Closed
xwu99 opened this issue Apr 30, 2021 · 2 comments
Closed

[Optimization] Use ccl::all2all to simulate gather #56

xwu99 opened this issue Apr 30, 2021 · 2 comments

Comments

@xwu99
Copy link
Collaborator

xwu99 commented Apr 30, 2021

Problem: Currently we used ccl::allgather as Gather. The network bandwidth is wasted due to unnecessary transfer to worker ranks.
Solution: Implement gather using ccl::all2all to avoid unnecessary data transfer, only transfer data to root rank.
@xwu99
Copy link
Collaborator Author

xwu99 commented Jun 11, 2021

It is fixed in NaiveBayes #55. Need to fix other algos.

@xwu99
Copy link
Collaborator Author

xwu99 commented Sep 24, 2021 •
edited
Loading

See #135

@xwu99 xwu99 closed this as completed Sep 24, 2021
@xwu99 xwu99 mentioned this issue Nov 2, 2021
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@xwu99