-
Notifications
You must be signed in to change notification settings - Fork 297
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
chore: change stash defaults #3136
Conversation
processor/stash/stash.go
Outdated
config.RegisterDurationConfigVariable(5, &errReadLoopSleep, true, time.Second, []string{"Processor.errReadLoopSleep", "errReadLoopSleepInS"}...) | ||
config.RegisterIntConfigVariable(10000, &errDBReadBatchSize, true, 1, "Processor.errDBReadBatchSize") |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
We can keep the current numbers and skip sleeping for errReadLoopSleep
until the stash loop picks up less jobs than the errDBReadBatchSize
. This way we can keep memory utilisation low and flush fast at the same time
This PR is considered to be stale. It has been open 20 days with no further activity thus it is going to be closed in 5 days. To avoid such a case please consider removing the stale label manually or add a comment to the PR. |
Description
Enable faster flushing of proc error tables
Notion Ticket
Notion Link
Security