Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Provide a config option to do node local aggregation #4306

Merged
merged 2 commits into from
Mar 21, 2024

Conversation

kkondaka
Copy link
Collaborator

Description

Provide a config option to do node local aggregation

Added new local_only config option to aggregate processor to do local aggregation. No events are forwarded to remote peers when this option is used.

Issues Resolved

Resolves #[Issue number to be closed when this PR is merged]

Check List

  • [X ] New functionality includes testing.
  • New functionality has a documentation issue. Please link to it in this PR.
    • New functionality has javadoc added
  • [X ] Commits are signed with a real name per the DCO

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

Signed-off-by: Krishna Kondaka <krishkdk@dev-dsk-krishkdk-2c-bd29c437.us-west-2.amazon.com>
graytaylor0
graytaylor0 previously approved these changes Mar 20, 2024
@@ -28,6 +28,10 @@ public class AggregateProcessorConfig {
@NotNull
private PluginModel aggregateAction;

@JsonProperty("local_only")
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

What do you think about naming this local_aggregations_only? It may make clear what is local only.

Signed-off-by: Krishna Kondaka <krishkdk@dev-dsk-krishkdk-2c-bd29c437.us-west-2.amazon.com>
@@ -51,6 +51,9 @@ While not necessary, a great way to set up the Aggregate Processor [identificati
### <a name="when"></a>
* `when` (Optional): A `String` that represents a condition that must be evaluated to true for the aggregation to be applied on the event. Events that do not evaluate to true on the condition are skipped. Default is no condition which means all events are included in the aggregation.

### <a name="local_only"></a>
* `local_only` (Optional): A `Boolean` indicating if the aggregation should be done local to node instead of forwarding to remote peers.
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please also update this line.

Copy link
Member

@dlvenable dlvenable left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Feel free to fix in a follow-on or in this PR.

@kkondaka kkondaka merged commit 5596c57 into opensearch-project:main Mar 21, 2024
47 checks passed
@dlvenable dlvenable added this to the v2.7 milestone Mar 21, 2024
@kkondaka kkondaka deleted the aggregate-local branch May 13, 2024 05:51
@kkondaka kkondaka mentioned this pull request May 13, 2024
2 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants