Skip to content

[DNM] Peer-to-peer shuffle design #5435

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft
wants to merge 14 commits into
base: main
Choose a base branch
from
+317 −0
Draft

[DNM] Peer-to-peer shuffle design #5435

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
14 commits
Select commit Hold shift + click to select a range
a9f15aa
[DNM] Peer-to-peer shuffle design
gjoseph92 Oct 18, 2021
9f3ee13
fix graph figure
gjoseph92 Oct 26, 2021
847425b
high-dpi transfer png
gjoseph92 Oct 26, 2021
7077541
fix many typos
gjoseph92 Oct 26, 2021
0060cfc
Florians rough thoughts
fjetter Oct 28, 2021
04868a6
problems to solve -> problems this solves
gjoseph92 Nov 5, 2021
213f5ad
spill to disk
gjoseph92 Nov 5, 2021
897c375
backpressure
gjoseph92 Nov 5, 2021
fdf6e65
concurrency
gjoseph92 Nov 5, 2021
aef4156
serialization
gjoseph92 Nov 8, 2021
cc3f238
networking
gjoseph92 Nov 8, 2021
5fb5c56
remove extraneous section
gjoseph92 Nov 8, 2021
bb37433
add xrefs
gjoseph92 Nov 8, 2021
481958c
Scheduler extension and graph culling sections
gjoseph92 Nov 13, 2021
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Binary file added distributed/shuffle/cull.png
View file
Open in desktop
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added distributed/shuffle/graph.png
View file
Open in desktop
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading