-
Notifications
You must be signed in to change notification settings - Fork 4.9k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add option to enable/disable LS output slow start #4972
Conversation
- add support to disable slow start in LS output - disable slow start by default. LS with java rewrite returns some kind of heartbeat every few seconds, so beats can tell the batch is still actively processed. With this change in LS, the original purpose of limiting batch sizes has become somewhat superfluous and is not really required anymore. -> We disable slow start and windowing by default, but keep the setting in case we find it's still required (e.g. when sending to older LS instances).
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Can you add a CHANGELOG entry?
libbeat/docs/outputconfig.asciidoc
Outdated
===== `slow_start` | ||
|
||
If enabled only a subset of events in a batch of events is transfered per transaction. | ||
The number of events to sent increases up to `bulk_max_size` if no error is encountered. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
to be sent
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
👍
jenkins, test it |
* Add option to enable/disable LS output slow start - add support to disable slow start in LS output - disable slow start by default. LS with java rewrite returns some kind of heartbeat every few seconds, so beats can tell the batch is still actively processed. With this change in LS, the original purpose of limiting batch sizes has become somewhat superfluous and is not really required anymore. -> We disable slow start and windowing by default, but keep the setting in case we find it's still required (e.g. when sending to older LS instances). * Update docs and reference configs * Remove unused method * Update changelog * review (cherry picked from commit c2360d0)
* Add option to enable/disable LS output slow start - add support to disable slow start in LS output - disable slow start by default. LS with java rewrite returns some kind of heartbeat every few seconds, so beats can tell the batch is still actively processed. With this change in LS, the original purpose of limiting batch sizes has become somewhat superfluous and is not really required anymore. -> We disable slow start and windowing by default, but keep the setting in case we find it's still required (e.g. when sending to older LS instances). * Update docs and reference configs * Remove unused method * Update changelog * review (cherry picked from commit c2360d0)
…stic#5003) * Add option to enable/disable LS output slow start - add support to disable slow start in LS output - disable slow start by default. LS with java rewrite returns some kind of heartbeat every few seconds, so beats can tell the batch is still actively processed. With this change in LS, the original purpose of limiting batch sizes has become somewhat superfluous and is not really required anymore. -> We disable slow start and windowing by default, but keep the setting in case we find it's still required (e.g. when sending to older LS instances). * Update docs and reference configs * Remove unused method * Update changelog * review (cherry picked from commit ffa2e64)
LS with java rewrite returns some kind of heartbeat every few seconds,
so beats can tell the batch is still actively processed. With this
change in LS, the original purpose of limiting batch sizes has become somewhat
superfluous and is not really required anymore.
-> We disable slow start and windowing by default, but keep the setting
in case we find it's still required (e.g. when sending to older LS
instances).