Navigation Menu

Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[dataflow] Arrangement -> Stream operator is not fueled #7031

Closed
frankmcsherry opened this issue Jun 10, 2021 · 0 comments · Fixed by #7171
Closed

[dataflow] Arrangement -> Stream operator is not fueled #7031

frankmcsherry opened this issue Jun 10, 2021 · 0 comments · Fixed by #7171
Labels
A-dataflow Area: dataflow C-bug Category: something is broken
Projects

Comments

@frankmcsherry
Copy link
Contributor

The operator that turns an arrangement into a stream of updates does not use "fuel", in the sense that it will run to completion even if that involves a substantial amount of data production. This operator is a bit like a source, in that it produces dataflow data "from nothing", and not fueling things can result in substantial bursts of work for other operators. Adding fuel based limiting has the potential to reduce situations in which MZ overwhelms itself.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
A-dataflow Area: dataflow C-bug Category: something is broken
Projects
No open projects
Development

Successfully merging a pull request may close this issue.

1 participant