Kafka pubsub: document transactions and exactly-once processing - #5276
Draft
javier-aliaga wants to merge 1 commit into
Draft
Kafka pubsub: document transactions and exactly-once processing#5276javier-aliaga wants to merge 1 commit into
javier-aliaga wants to merge 1 commit into
Conversation
Documents the new Kafka transactions metadata (producerTransactionsEnabled, consumerTransactionsEnabled, transactionalIdPrefix, consumerIsolationLevel, transactionTimeout) and the exactly-once consume-transform-produce pattern introduced in dapr/components-contrib#4508, including the __txnToken echo contract, fencing/scaling guidance, and the bindings limitation. Signed-off-by: Javier Aliaga <javier@diagrid.io>
Draft
4 tasks
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Thank you for helping make the Dapr documentation better!
Please follow this checklist before submitting:
Description
Documents the Kafka transactions support added to the Kafka pubsub component in dapr/components-contrib#4508 (targeted at Dapr 1.19):
setup-apache-kafka.md: five new spec metadata fields (producerTransactionsEnabled,consumerTransactionsEnabled,transactionalIdPrefix,consumerIsolationLevel,transactionTimeout) and a new "Kafka transactions and exactly-once processing" section covering transactional publishing, committed-only consumption, and the exactly-once consume-transform-produce pattern — the__txnTokenecho contract (HTTP/gRPC/bulk), failure and redelivery semantics, scope of the guarantee, transaction timeout guidance, and scaling/zombie-fencing notes. The__txnTokenentry is also added to the per-call metadata fields and consumer-side special headers lists.kafka.md(bindings): the producer-side transaction fields andconsumerIsolationLevel, plus a note thatconsumerTransactionsEnabledis rejected at init for bindings and why (pubsub-only feature).This is the documentation PR required by dapr/components-contrib#4508; both should ship in the same release. Unchecked checklist items (tabpane, images) are not applicable: the changes are reference tables, YAML component snippets, and one single-command HTTP example on pages that don't use tabpane for these.
Issue reference
dapr/components-contrib#4301