Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Support Multi-node aggregation by integrating it with the Peer Forwarder #978

Closed
dlvenable opened this issue Feb 4, 2022 · 2 comments
Closed

Support Multi-node aggregation by integrating it with the Peer Forwarder #978

dlvenable opened this issue Feb 4, 2022 · 2 comments
Assignees
@asifsmohammed
Labels
enhancement New feature or request
Projects
(deprecated) Tracking Board
Milestone
v2.0

Comments

@dlvenable
Copy link
Member

dlvenable commented Feb 4, 2022 •
edited

The aggregate processor as implemented for Data Prepper 1.3.0 will only support single-node deployments. Integrating it into the core Peer Forwarder (#700) will allow it to work with multiple nodes.
@dlvenable dlvenable mentioned this issue Feb 4, 2022
Closed
6 tasks
@dlvenable dlvenable added this to 1.4 - Log Analytics Features in Data Prepper Project Roadmap Feb 4, 2022
@dlvenable dlvenable added this to the v1.4 milestone Feb 4, 2022
@dlvenable dlvenable added this to Untriaged in (deprecated) Tracking Board via automation Feb 18, 2022
@dlvenable dlvenable changed the title Integrate AggregateProcessor with the Peer Forwarder Support Multi-node aggregation by integrating it with the Peer Forwarder Feb 18, 2022
@dlvenable dlvenable moved this from 1.4 - Log Analytics Features (May 2022) to Backlog in Data Prepper Project Roadmap Mar 21, 2022
@dlvenable dlvenable removed this from the v1.4 milestone Mar 21, 2022
@dlvenable dlvenable moved this from Backlog to 2.0 - Breaking Changes (Jun 2022) in Data Prepper Project Roadmap Apr 19, 2022
@dlvenable dlvenable added this to the v2.0 milestone Apr 19, 2022
@dlvenable dlvenable added enhancement New feature or request and removed untriaged labels Apr 19, 2022
@dlvenable
Copy link
Member Author

dlvenable commented Apr 19, 2022 •
edited

This feature depends on #1189 since the AggregateProcessor is very intentionally not @SingleThread.

I don't believe this is accurate for this task.

@dlvenable dlvenable moved this from Untriaged to To do in (deprecated) Tracking Board Sep 9, 2022
@asifsmohammed
Copy link
Member

Integrated aggregate processor with core peer forwarder as part of this PR. #1767

(deprecated) Tracking Board automation moved this from To do to Done Oct 3, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@asifsmohammed asifsmohammed

Labels
enhancement New feature or request
Projects
(deprecated) Tracking Board
Done
Data Prepper Tracking Board
Archived in project
Milestone
v2.0
Development

No branches or pull requests
2 participants
@dlvenable @asifsmohammed