Skip to content
This repository has been archived by the owner on Dec 1, 2023. It is now read-only.

V2: Check if we need to store offset in consumers database together with our model in a transaction #159

Open
2 tasks
eldimious opened this issue Mar 5, 2022 · 0 comments

Comments

@eldimious
Copy link
Contributor

eldimious commented Mar 5, 2022

Verify that we have idempotent consumer

  • Check if need to store offset in consumers database together with our model in a transaction
  • Check if need to update offset on kafka after transaction completed

https://stackoverflow.com/questions/58255598/kafka-is-it-good-practice-too-keep-topic-offset-in-database

https://medium.com/@shesh.soft/kafka-idempotent-producer-and-consumer-25c52402ceb9

https://www.linkedin.com/pulse/kafka-idempotent-consumer-transactional-outbox-rob-golder/ (offset is updated on kafka after transaction is completed --- manual commit)

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant