Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add option to enable/disable LS output slow start #4972

Merged
merged 5 commits into from
Aug 24, 2017

Conversation

urso
Copy link

@urso urso commented Aug 22, 2017

  • add support to disable slow start in LS output
  • disable slow start by default.

LS with java rewrite returns some kind of heartbeat every few seconds,
so beats can tell the batch is still actively processed. With this
change in LS, the original purpose of limiting batch sizes has become somewhat
superfluous and is not really required anymore.
-> We disable slow start and windowing by default, but keep the setting
in case we find it's still required (e.g. when sending to older LS
instances).

urso added 2 commits August 22, 2017 22:18
- add support to disable slow start in LS output
- disable slow start by default.

LS with java rewrite returns some kind of heartbeat every few seconds,
so beats can tell the batch is still actively processed. With this
change in LS, the original purpose of limiting batch sizes has become somewhat
superfluous and is not really required anymore.
-> We disable slow start and windowing by default, but keep the setting
in case we find it's still required (e.g. when sending to older LS
instances).
@urso urso added libbeat needs_backport PR is waiting to be backported to other branches. review labels Aug 22, 2017
Copy link
Member

@ruflin ruflin left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can you add a CHANGELOG entry?

===== `slow_start`

If enabled only a subset of events in a batch of events is transfered per transaction.
The number of events to sent increases up to `bulk_max_size` if no error is encountered.
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

to be sent

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

👍

@tsg
Copy link
Contributor

tsg commented Aug 24, 2017

jenkins, test it

@tsg tsg merged commit c2360d0 into elastic:master Aug 24, 2017
urso pushed a commit to urso/beats that referenced this pull request Aug 24, 2017
* Add option to enable/disable LS output slow start

- add support to disable slow start in LS output
- disable slow start by default.

LS with java rewrite returns some kind of heartbeat every few seconds,
so beats can tell the batch is still actively processed. With this
change in LS, the original purpose of limiting batch sizes has become somewhat
superfluous and is not really required anymore.
-> We disable slow start and windowing by default, but keep the setting
in case we find it's still required (e.g. when sending to older LS
instances).

* Update docs and reference configs

* Remove unused method

* Update changelog

* review

(cherry picked from commit c2360d0)
@urso urso removed the needs_backport PR is waiting to be backported to other branches. label Aug 24, 2017
tsg pushed a commit that referenced this pull request Aug 24, 2017
* Add option to enable/disable LS output slow start

- add support to disable slow start in LS output
- disable slow start by default.

LS with java rewrite returns some kind of heartbeat every few seconds,
so beats can tell the batch is still actively processed. With this
change in LS, the original purpose of limiting batch sizes has become somewhat
superfluous and is not really required anymore.
-> We disable slow start and windowing by default, but keep the setting
in case we find it's still required (e.g. when sending to older LS
instances).

* Update docs and reference configs

* Remove unused method

* Update changelog

* review

(cherry picked from commit c2360d0)
@urso urso deleted the logstash/config-slow-start branch February 19, 2019 18:40
leweafan pushed a commit to leweafan/beats that referenced this pull request Apr 28, 2023
…stic#5003)

* Add option to enable/disable LS output slow start

- add support to disable slow start in LS output
- disable slow start by default.

LS with java rewrite returns some kind of heartbeat every few seconds,
so beats can tell the batch is still actively processed. With this
change in LS, the original purpose of limiting batch sizes has become somewhat
superfluous and is not really required anymore.
-> We disable slow start and windowing by default, but keep the setting
in case we find it's still required (e.g. when sending to older LS
instances).

* Update docs and reference configs

* Remove unused method

* Update changelog

* review

(cherry picked from commit ffa2e64)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants