Skip to content

Add a --live option to the export operator #3612

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 1 commit into from
Nov 6, 2023
Merged

Add a --live option to the export operator #3612

merged 1 commit into from
Nov 6, 2023

Conversation

tobim
Copy link
Member

@tobim tobim commented Nov 2, 2023

Running export --live captures all data that is ingested to
the internal database. In this mode, the stream never ends.

@tobim tobim added operator Source, transformation, and sink improvement An incremental enhancement of an existing feature labels Nov 2, 2023
@tobim
Copy link
Member Author

tobim commented Nov 2, 2023

Note that this would be a temporary solution until the publish and subscribe operators are ready. But this was pretty easy to implement and lifts some important restrictions.

@tobim tobim force-pushed the topic/export-live branch 2 times, most recently from f30af64 to 67b6f36 Compare November 3, 2023 10:45
Copy link
Member

@dominiklohmann dominiklohmann left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Approving, this is a mighty-fine addition. 🙏

Running `export --live` captures all data that is ingested to
the internal database. In this mode, the stream never ends.
@tobim tobim force-pushed the topic/export-live branch from 67b6f36 to e53c312 Compare November 6, 2023 10:48
@tobim tobim marked this pull request as ready for review November 6, 2023 12:33
@tobim tobim merged commit 035669d into main Nov 6, 2023
@tobim tobim deleted the topic/export-live branch November 6, 2023 12:34
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
improvement An incremental enhancement of an existing feature operator Source, transformation, and sink
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants