Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Celery NextGen: High Level Architecture #27

Merged
merged 31 commits into from
Jan 4, 2021
Merged

Celery NextGen: High Level Architecture #27

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
31 commits
Select commit Hold shift + click to select a range
515788d
Edit abstract from original document.
thedrow May 27, 2020
9c0b9dc
Add diagram.
thedrow May 27, 2020
d2e9a12
Remove the extra glossary and update the terms.
thedrow May 31, 2020
5d7c900
Add motivation.
thedrow May 31, 2020
1c87ee9
Extend motivation.
thedrow May 31, 2020
2fb8cff
Describe what we had in Celery 4.x.
thedrow May 31, 2020
2908faa
Extend abstract.
thedrow May 31, 2020
f091acf
Describe how message brokers work in Celery.
thedrow May 31, 2020
8fae50d
Add table of contents.
thedrow May 31, 2020
4e0e91d
Add headers for the rest of the building blocks.
thedrow May 31, 2020
a027cc4
Add a note about cluster management.
thedrow May 31, 2020
f83d855
Describe data sinks.
thedrow May 31, 2020
cb245d9
Describe message types.
thedrow Jun 1, 2020
f91d169
Add a header for the publisher.
thedrow Jun 1, 2020
0a09108
Describe data sources.
thedrow Jun 2, 2020
ec19936
Describe the Controller.
thedrow Jun 4, 2020
06493c9
Fix heading syntax.
thedrow Jun 4, 2020
8e49110
Change title.
thedrow Jun 7, 2020
b1cd5ce
Make the diagram more visible.
thedrow Jun 7, 2020
de6aaee
Add new diagram.
thedrow Jun 9, 2020
ff9aa15
Change figure dimensions.
thedrow Jun 10, 2020
389fc16
Expand sentence.
thedrow Jun 21, 2020
2163d92
Expand sentence.
thedrow Jun 21, 2020
f083416
Describe Task Scheduler.
thedrow Jun 29, 2020
f705bb8
Describe the Publisher.
thedrow Jun 29, 2020
19ebe10
Describe Python runtime.
thedrow Jun 29, 2020
0c27e14
Describe Backwards Compatibility.
thedrow Jun 29, 2020
cdbeed6
Describe the Router.
thedrow Jun 30, 2020
76731c8
Describe Execution Platform.
thedrow Jul 1, 2020
cbc7030
Describe Rationale.
thedrow Jul 1, 2020
6fc6888
Expand on Execution Platform.
thedrow Jul 1, 2020
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions draft/celery-nextgen-architecture
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
<mxfile host="Electron" modified="2020-06-09T15:06:54.863Z" agent="5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) draw.io/13.0.3 Chrome/80.0.3987.163 Electron/8.2.1 Safari/537.36" etag="8R9L8dQMvG9BEZn8h92K" version="13.0.3" type="device"><diagram id="sL1-do6aed5lOvsUaoBv" name="Page-1">7Vxbc6O4Ev41qdp9CMX98pjrmaqd2U1ltmp2nqZkkG02gDxcEmd+/UogAULCxheMkxNPVcY0ksDdn/rrbgkujJt4/b8UrJZfUACjC10N1hfG7YWue46K/xLBayXQHSZZpGFQybRG8DX8BamQNSvCAGZcwxyhKA9XvNBHSQL9nJOBNEUvfLM5ivirrsACCoKvPohE6bcwyJeV1LXURv4Jhoslu7Km0jMxYI2pIFuCAL20RMbdhXGTIpRX3+L1DYyI8pheqn73PWfrG0thkg/pED36a3/9bbb4tE69P+M/fj6G/146ZjXMM4gK+otvUJIVMaQ3nb8yTcAAK4YeojRfogVKQHTXSK9TVCQBJJdT8VHT5jNCKyzUsPBfmOev1MqgyBEWLfM4omfhOsz/Id0V02PH38k5RdXY8e2ajl8evLYOHmAaxjCHKZMlefr6T/vge/ugHEh3m2MyllcfdkfLcpDmVwRRWJCgBDLZfRhFtM0cJTn9cbpLj29QhNJSg4ZXfrC80i1RaK8tqShDRerDDQa0LTopQLqA+YaGeg05PFchwj8tfcX9UhiBPHzmbwTQSbOo29Gu+PeD11aDFQqTPGuN/EAEuAGd/5qB9VAOSee/bXIgxV+qIdlR694aUQnkXUDtTAreFnDVNmg1i4OtZr894M5xl5YcaoEFnXK8FD3Bdg/bMYB9XKjrA5FuawdCvYXO3cHn6oJH/RtkT5kUkp/BDPMlByMQhYsEf/exfogNr59hmoeYkK7oiTgMggqxMAt/gVk5HjEinYx4cOv6wrrd2R+RC8E1px3KqvQiDZe1zbdhCoo2oMNfqgoeS+dcw2VNnbv5pMbpsCZoPs8wQrqWPIJnwdrqGhdPtyzMcrl9p3Y51Eswl+Md4nF4f+Mc5G9gErAWfgSyLPQrIW2i7e+S5vO57vsylxTYM9uayCV57iTsSyiGY1+7EyJ2OxC8HNTB6Qah3Q6murHDOAGB6JIvdDvKKaq4aWv/LBA7cZmV+LvCDXR3tW5O4m8L+n85yowJHlFBJgIV43uddZtiWXVNJu54DZwlrMhXv5iRifOyDHP4dQVKFL7gFIt3ALPKg3ye1QLgPy1Kv/JXkUchmXylPADp0194mDAvI2ZFtXihXkpJyzpNUcXJhdneDUzZ5HL1mWHb+1CMMO16ScPtYM1iSdhLk5jVeFy2kzI2DY5O9owPW8j6ArOM5JS6ek10lAoWZnxecv8DysI8RITXZyjPUczbt8v9OSEGMUTgzUF9bsd2qnp9d69XBi4RFq8XJGVXwK8ihcrPAhbwxwIm2Jv7LJiA6d0zrGIKERrEP9NfJfPXIxjcMOxhBnfdkextGJPSvGK1ib4+2iclVlSXo/pqsB6y7+X6CRJe3RzIubo3Cee6DodZFtT2EuLm9iPxoVj1ufJzJPoq5iuKOKoaNC6p131F5MR1zUN8bIY/vW6thXhUkddNXdRTpe6njbwOUwHozqVhoO27cDY/joPS1I7tBPdU5zQcH7lj8ZF9npUPzjc5fc6JSxyatKCdO+ySGBzT5wwtslUENVXpwdHO0vq6zdl/1yR0P2Y603LtcCRNCSR2l5KEKVuB5IgJ00Mxi8JsuTVnqi77f5YztUNslmgcQleGpiusPMnW4zxJDmWfNIdiC4LnEFOPs8ik6W/caXlDQ25rUq8lFmcFZIFsVQWU83BN4LM9zw0Adk8MaC0A9QeWUScyFir5vaHzwHS/N9btZPZx5gOolL1WaZhBxY9CfPQDrFYRvkx19TESd93TFFPjHI0nuhm38UZ8dDwWQFj5QEJrNefQ8k1Wn0jZGZLSRGghJ6oOzKT5y+7EwGHvWOhpYVjmSxrCwX0Hzha+nvSSmYoP/CX8kaAAdueTj68BsG6Yzzt+GqY7kjxMWhccLQ9zDQFpj3jgkOAKj6jeYPrKsU4SevwVaysoIqxjXe1fLZw6kNeM41GiyVMiXQx/Q6Ro2qcixb3qUKZlcJPCMk5QV3LFutIXkFTu9BzxPHRDxpuH4KE7IvaDoMlD0PZOAEGzn+OPvNaHyR0TdxR9rPeNtN5Xpatq87GkHm3K5T9NANvdGvpFGZnp6gOeXXOUxqLRX8I4AokQG+EAKiARenclr+NaStdDBdaRYij86dYGHEkcZZoSBRvaaLUBWSGqo0wC/1WvBvbewbRFX6aq2F7rwzbSMt2JqjMMV7G8FpwNUZP17R1dk6YYkY7kF7+h9OnDJ+7tEzfMAxGM07k+NvAHnt4TnhgZYE/ltp0bz7zTE68tEu8H+t4L+qzN6LMnR58jBiEnTGfbD8YctgeIK8+8q2VWGuxsT4xVORJPs2DRH5IJTuYwr1bvSezxWAMq2ue5azGmP2zAOs4RciRb5wvNhoQI5YVmdTQi7F+pbxcqyAN9pLYsAqHf4hKD9hpfsO3em8AqULBHLXUZM7Ux0bNO10VLiDJHCXEumCkweYYRWsEfv1Hw/C5zUTwK78vPcUCk6WYHRayusRVF1miENum21g6hHbIGr6iu0WG16sHRd8JrzAFtfwZukkUHTdc7mQItKY37uKdY8n2Eq4jc+G9X/hMe80/siH6fEuLHW1JTTNvkEe5Z7yly099E5OaK+ecNimOQcCQrLVSKxNeEUCgNf5Hl8XqPCUnlksXfJdrcRnBNe9xe6htDmyHFz21L653FdVeVxDzSTc6jxTzOgH0+YhjBxQfilpoG6W4rfsB3E64ySVzqquRfXxC7e+C5AWUbq36mrriWo5k6/WuLhjDHsoMrlgDJ3oWxbJGWW1HE0Iwaovs80sg2YLUKR2mUT/7a3GyR1CqmtJjjbp85u7KilOJoMSHo8MvgvXSd6dXGzoGctJWA3KEhFnNDe0PoRFRlHW5i2dPag21ZP3ctt+U9iMOITJdPMHqGhBh3MLKkptCJYHqeDuefNR8ev5zmNStCYG133pXgdXeuVbCmvRrE7BrAC9fZ8vy3093luWN7VlEZNT/wdEl+kBVRzzsb3u07OdzNZXdVcTyVPj92xm/gELeY3SK/iGF5/b1D75MH1o5+dnG1J1tUkyry6NCsrLox0j21MmTr2ydSxvaw/8TKcAdkXGMpoyfPn1AZznZlvI/0s+cB+jNJZlwxmanST3wTZEeacV2x/FjGkeejN86VWi4VjJWP9hjlTeajrmyz7kc+KoX51syD+aW9IXSafNST1SBG2bpzC3KAW38Nk6eP/Tuj7NAW3ubFXu854eYcTRXD2IciW+LBHhDp3n2ur4LJgV5nurdm1EtD9Trn9/bB3ktC/S/gGO/lfYPf2nKUpaY6RDzTd+fqncnlaVZ7dmzv4GgnqK7UWjydQ68M++HST+LSXVPcnnI0l44PmxegV4hsXiNv3P0H</diagram></mxfile>
Binary file added draft/celery-nextgen-architecture-figure01.png
View file
Open in desktop
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading