Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Disk writes should happen in batches #14

Closed
snth opened this issue Oct 12, 2017 · 0 comments · Fixed by #25
Closed

Disk writes should happen in batches #14

snth opened this issue Oct 12, 2017 · 0 comments · Fixed by #25

Comments

@snth
Copy link
Owner

snth commented Oct 12, 2017

The output_stream writer writes every single event. The raw stream does have a batch size but this is of a fixed size. This should use the Stream.timed_window operation but that requires running an event loop in a separate thread.

This issue is for creating that separate thread event loop and then having constant time interval flushes to disk.

@snth snth mentioned this issue Oct 16, 2017
@snth snth closed this as completed in #25 Oct 17, 2017
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant