Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Retryer's Stopstrategy in PipelineStage #29

Open
dream-coder-007 opened this issue May 5, 2023 · 0 comments
Open

Retryer's Stopstrategy in PipelineStage #29

dream-coder-007 opened this issue May 5, 2023 · 0 comments

Comments

@dream-coder-007
Copy link

dream-coder-007 commented May 5, 2023

Hi @shaikidris @shashankg @satks ,
I am consuming messages/event from a Kafka topic. Retryer in PipelineStage class is created with "neverStop" stop strategy. If there is an exception in event processing (using StreamingProcessor) due to some issue in message/event payload, retryer simply retries and keeps processing this particular event/message due to never stop strategy. It gets stuck here and does not process next events. Once max.poll.interval.ms is reached this partition gets assigned to another consumer. Same thing happens with this consumer also and it just continues and after sometime all consumers get stuck. Can we use StopAfterAttemptStrategy here to avoid this or is there any alternative or workaround to solve this problem?
Am I missing anything here ?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant