Restore stream-table duality description #8995
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
mjsax
reviewed
Jul 8, 2020
| </p> | ||
|
|
||
| <p> | ||
| In the <code>Kafka Streams DSL</code>, an input stream of an <code>aggregation</code> can be a KStream or a KTable, but the output stream will always be a KTable. This allows Kafka Streams to update an aggregate value upon the out-of-order arrival of further records after the value was produced and emitted. When such out-of-order arrival happens, the aggregating KStream or KTable emits a new aggregate value. Because the output is a KTable, the new value is considered to overwrite the old value with the same key in subsequent processing steps. |
There was a problem hiding this comment.
Can we avoid those super long lines? Similar below.
There was a problem hiding this comment.
Sure, but that's the style throughout the Kafka docs. :)
There was a problem hiding this comment.
Unfortunately, and I try to get it into better shape incrementally (reading GitHub diffs with long lines is just a pain). Would go awesome if somebody (cough) could do a PR just fixing it throughout the docs -- the current lazy approach is somewhat tiring.
There was a problem hiding this comment.
kk cool, I'll open a ticket.
Kvicii
pushed a commit
to Kvicii/kafka
that referenced
this pull request
Jul 10, 2020
* 'trunk' of github.com:apache/kafka: (24 commits) KAFKA-10249: don't try to read un-checkpointed offsets of in-memory stores (apache#8996) MINOR: Restore stream-table duality description (apache#8995) MINOR: Create ChannelBuilder for each connection in ConnectionStressWorker workload KAFKA-10179: Pass correct changelog topic to state serdes (apache#8902) KAFKA-10235 Fix flaky transactions_test.py (apache#8981) MINOR: Closing consumerGroupService resources in SaslClientsWithInvalidCredentialsTest (apache#8992) MINOR: Define the term tombstone, since it's used elsewhere in the docs (apache#3480) KAFKA-10109: Fix double AdminClient creation in AclCommand KAFKA-10220: Add null check for configurationKey in AdminManager.describeConfigs() KAFKA-10225 Increase default zk timeout for system tests (apache#8974) MINOR; alterReplicaLogDirs should not fail all the futures when only one call fails (apache#8985) KAFKA-10134: Use long poll if we do not have fetchable partitions (apache#8934) KAFKA-10191 fix flaky StreamsOptimizedTest (apache#8913) KAFKA-10243; ConcurrentModificationException while processing connection setup timeouts (apache#8990) KAFKA-10239: Make GroupInstanceId ignorable in DescribeGroups (apache#8989) KAFKA-9930: Adjust ReplicaFetcherThread logging when processing UNKNOWN_TOPIC_OR_PARTITION error (apache#8579) MINOR: document timestamped state stores (apache#8920) KAFKA-10166: checkpoint recycled standbys and ignore empty rocksdb base directory (apache#8962) MINOR: prune the metadata upgrade test matrix (apache#8971) KAFKA-10017: fix flaky EosBetaUpgradeIntegrationTest (apache#8963) ...
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
The stream-table duality section was dropped inadvertently sometime after version 0.11.0, so this PR restores it.