-
Notifications
You must be signed in to change notification settings - Fork 3.5k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Revert to use only a single worker by default on outputs #4904
Revert to use only a single worker by default on outputs #4904
Conversation
@@ -469,7 +469,7 @@ def plugin(plugin_type, name, *args) | |||
end | |||
|
|||
def default_output_workers | |||
@settings[:pipeline_workers] || @settings[:default_pipeline_workers] | |||
1 |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Can we make this a constant?
The move to auto-scale output workers was great in theory, but a lot of outputs just weren't built to support it well, they often used too many resources or had logical errors.
46b495c
to
2248aae
Compare
LGTM |
@@ -37,6 +37,8 @@ module LogStash; class Pipeline | |||
:config_str, | |||
:original_settings | |||
|
|||
DEFAULT_OUTPUT_WORKERS = 1 | |||
|
|||
DEFAULT_SETTINGS = { |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
any reason not to place DEFAULT_OUTPUT_WORKERS in the DEFAULT_SETTINGS hash?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I'd rather not have defaults in there in general. I think we should probably pull default_pipeline_workers
out of there IMHO.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Just to clarify, I think its confusing that we have dynamic settings and defaults in that hash. Defaults make more sense as constants IMHO.
LGTM™ too. |
The move to auto-scale output workers was great in theory, but a lot of outputs just weren't built to support it well, they often used too many resources or had logical errors. Fixes #4904
The move to auto-scale output workers was great in theory, but a lot of outputs
just weren't built to support it well, they often used too many resources or had
logical errors.