Skip to content

Tune defaults and demo-node experience #3320

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 6 commits into from
Jul 7, 2023
Merged

Conversation

tobim
Copy link
Member

@tobim tobim commented Jul 7, 2023

No description provided.

@tobim tobim added the node label Jul 7, 2023
@tobim tobim force-pushed the topic/managed-ingest-on-demo-node branch from e6a1bbb to 75a28d1 Compare July 7, 2023 11:29
tobim added 5 commits July 7, 2023 15:50
The rebatching process takes care of accumulating small batches into
regular sized ones in the relevant places, so we can tune the default
for a better interactive experience.
The rebuilding process takes care of optimizing the partitions
automatically, so making sure to produce big partitions from the
get go is not important.

Instead, we tune the default for a better interactive experience
so that we can export data as fast as possible.
@tobim tobim force-pushed the topic/managed-ingest-on-demo-node branch from 023a3fc to 9da0e83 Compare July 7, 2023 13:51
The `zeek-tsv` parser tried to finish a slice when it didn't have
a header, which obviously can't work because it didn't construct
a builder in that case.
@tobim tobim force-pushed the topic/managed-ingest-on-demo-node branch from 6c6be2e to a726830 Compare July 7, 2023 14:35
@tobim tobim mentioned this pull request Jul 7, 2023
@tobim tobim merged commit e0696b0 into main Jul 7, 2023
@tobim tobim deleted the topic/managed-ingest-on-demo-node branch July 7, 2023 15:40
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants