Insights: apache/kafka

40 Pull requests merged by 21 people

• MINOR: remove unnecessary `KeyValueMapper`

  #13545 merged Apr 14, 2023

• MINOR: Assure no streamsProducer send after handling the serialization error.

  #13576 merged Apr 14, 2023

• Revert "KAFKA-14318: KIP-878, Introduce partition autoscaling configs (#12962)"

  #13527 merged Apr 14, 2023

• MINOR: fix flaky KRaft-related tests

  #13543 merged Apr 14, 2023

• MINOR: Improve raft log4j messages a bit

  #13553 merged Apr 14, 2023

• KAFKA-14054: Handle TimeoutException gracefully

  #13534 merged Apr 14, 2023

• KAFKA-14790: Add more AddPartitionsToTxn tests in KafkaApis and Authorizer tests

  #13502 merged Apr 14, 2023

• MINOR: Refactor changelogger to accept timestamp

  #13563 merged Apr 14, 2023

• MINOR Disable the dual write integration test until KAFKA-14840

  #13573 merged Apr 14, 2023

• KAFKA-14462; [6/N] Update Records

  #13536 merged Apr 14, 2023

• MINOR: Refine `PartitionAssignor` server-side interface

  #13524 merged Apr 14, 2023

• MINOR: Bump trunk to 3.6.0-SNAPSHOT

  #13570 merged Apr 14, 2023

• KAFKA-14834: [9/N] Disable versioned-stores for unsupported operations

  #13565 merged Apr 14, 2023

• KAFKA-7499: Handle serialization error in ProductionExceptionHandler

  #13477 merged Apr 14, 2023

• KAFKA-14834: [10/N] Reserve repartition topic formats to include `isLatest`

  #13566 merged Apr 14, 2023

• KAFKA-14834: [8/N] Propagate `isLatest` as part of `Change`

  #13564 merged Apr 14, 2023

• KAFKA-14834: [7/N] Update VersionedKeyValueStore#put() to return validTo

  #13554 merged Apr 14, 2023

• KAFKA-14834: [6/N] Add tracking of versioned tables into graph nodes

  #13552 merged Apr 13, 2023

• KAFKA-14722: Make BooleanSerde public (an addition of upgrade.html changes)

  #13491 merged Apr 13, 2023

• MINOR: Fix regression in MM2 task forwarding introduced by KAFKA-14783

  #13548 merged Apr 13, 2023

• KAFKA-14462; [5/N] Add EventAccumulator

  #13505 merged Apr 13, 2023

• KAFKA-14883: Expose `observer` state in KRaft metrics

  #13525 merged Apr 13, 2023

• KAFKA-14834: [5/N] Drop out-of-order records from FK join with versioned tables

  #13522 merged Apr 13, 2023

• MINOR: Install missing iputils-ping for system tests

  #13500 merged Apr 13, 2023

• KAFKA-14834: [4/N] Drop out-of-order records from table-table join with versioned tables

  #13510 merged Apr 13, 2023

• KAFKA-14561: Improve transactions experience for older clients by ensuring ongoing transaction

  #13391 merged Apr 13, 2023

• KAFKA-14834: [3/N] Timestamped lookups for stream-table joins

  #13509 merged Apr 12, 2023

• MINOR: Follow-up on failing streams test, and fix StoreChangelogReader

  #13523 merged Apr 12, 2023

• MINOR: Add tests verifying leadership during and after reassignments in KRaft mode

  #13521 merged Apr 12, 2023

• KAFKA-14491: [21/N] Docs updates for versioned state stores

  #13444 merged Apr 12, 2023

• MINOR: update the batch size connect task metrics documentation

  #13494 merged Apr 12, 2023

• KAFKA-14462; [4/N] Add Group, Record and Result

  #13520 merged Apr 12, 2023

• KAFKA-14891: Fix rack-aware range assignor to assign co-partitioned subsets

  #13539 merged Apr 12, 2023

• KAFKA-9550 Copying log segments to tiered storage in RemoteLogManager

  #13487 merged Apr 12, 2023

• KAFKA-14834: [2/N] Test coverage for out-of-order data in joins

  #13497 merged Apr 12, 2023

• KAFKA-14834: [1/N] Add timestamped get to KTableValueGetter

  #13496 merged Apr 12, 2023

• KAFKA-14894: MetadataLoader must call finishSnapshot after loading a snapshot

  #13541 merged Apr 11, 2023

• KAFKA-14783 (KIP-875): New STOPPED state for connectors

  #13424 merged Apr 11, 2023

• KAFKA-12446: Call subtractor before adder if key is the same

  #10747 merged Apr 10, 2023

• Kafka-14420 Use incrementalAlterConfigs API for syncing topic configurations (KIP-894)

  #13373 merged Apr 10, 2023

32 Pull requests opened by 22 people

• KAFKA-14133: Migrate topology builder mock in TaskManagerTest to mockito

  #13529 opened Apr 8, 2023

• KAFKA-14858: Handle exceptions thrown from Connector::taskConfigs in Connect's standalone mode

  #13530 opened Apr 9, 2023

• KAFKA-14885: fix kafka client connect to the broker that offline from…

  #13531 opened Apr 10, 2023

• KAFKA-14887: No shutdown for ZK session expiration in feature processing

  #13532 opened Apr 10, 2023

• KAFKA-12446: update change encoding to use varint

  #13533 opened Apr 10, 2023

• KAFKA-9579 Fetch implementation for records in the remote storage through a specific purgatory.

  #13535 opened Apr 11, 2023

• KAFKA-14462; [7/N] Add ClientAssignor, Assignment, TopicMetadata and VersionedMetadata

  #13537 opened Apr 11, 2023

• KAFKA-14462; [8/N] Add ConsumerGroupMember

  #13538 opened Apr 11, 2023

• MINOR: improve QuorumController logging

  #13540 opened Apr 11, 2023

• [MINOR] getPartitionInfo fix

  #13542 opened Apr 11, 2023

• KAFKA-14462; [9/N] Add RecordHelpers

  #13544 opened Apr 12, 2023

• Minor: Add note for KIP-894

  #13547 opened Apr 12, 2023

• KAFKA-14639 - A single partition may be revoked and assign during a single round of rebalance

  #13550 opened Apr 12, 2023

• MINOR: Allow tagged fields with version subset of flexible version range

  #13551 opened Apr 12, 2023

• MINOR: Move `ControllerPurgatory` to `server-common`

  #13555 opened Apr 13, 2023

• Minor: Add EndToEndLatency wrapper scripts and redirection (KIP-906)

  #13556 opened Apr 13, 2023

• KAFKA-14902: KafkaStatusBackingStore retries on a dedicated backgroun…

  #13557 opened Apr 13, 2023

• KAFKA-14845: Fix broker registration with Zookeeper when the previous ephemeral znode was not properly recorded by the broker

  #13558 opened Apr 13, 2023

• Minor: Add ConsumerPerformance tool migration note

  #13559 opened Apr 13, 2023

• Minor: Add ClusterTool wrapper scripts and redirection (KIP-906)

  #13560 opened Apr 13, 2023

• KAFKA-14888: Added remote log segments retention functionality based on time and size.

  #13561 opened Apr 13, 2023

• KAFKA-14581: Moving GetOffsetShell to tools

  #13562 opened Apr 13, 2023

• MINOR: Update zstd-jni to 1.5.5

  #13567 opened Apr 14, 2023

• MINOR: Upgrade to Gradle 8.1

  #13569 opened Apr 14, 2023

• KAFKA-14907:Add the traffic metric of the partition dimension in BrokerTopicStats

  #13571 opened Apr 14, 2023

• KAFKA-14908: Set setReuseAddress on the kafka server socket

  #13572 opened Apr 14, 2023

• KAFKA-14905: Intercept incrementalAlterConfigs in MM2 ForwardingAdminTest

  #13575 opened Apr 14, 2023

• MINOR: updated KS release notes for 3.5

  #13577 opened Apr 14, 2023

• MINOR: update .asf.yaml

  #13578 opened Apr 14, 2023

• KAFKA-14904: Flaky Test kafka.api.TransactionsBounceTest.testWithGroupId()

  #13579 opened Apr 14, 2023

• MINOR: Debug EmbeddedConnect/KafkaCluster failures

  #13580 opened Apr 14, 2023

• A document on the current usage of Kafka project is added

  #13581 opened Apr 15, 2023

45 Unresolved conversations

Sometimes conversations happen on old items that aren’t yet closed. Here is a list of all the Issues and Pull Requests with unresolved conversations.

• KAFKA-14869: ignore unknown record types for coordinators

  #13511 commented on Apr 14, 2023 • 31 new comments

• KAFKA-14869: bump coordinator Value records to flexible versions

  #13526 commented on Apr 14, 2023 • 31 new comments

• KAFKA-14735: Improve KRaft metadata image change performance at high …

  #13280 commented on Apr 14, 2023 • 29 new comments

• KAFKA-14514: Add Server Side Sticky Range Assignor (KIP-848)

  #13443 commented on Apr 13, 2023 • 21 new comments

• KAFKA-14368: Connect offset write REST API

  #13465 commented on Apr 15, 2023 • 19 new comments

• KAFKA-14805 KRaft controller supports pre-migration mode

  #13407 commented on Apr 14, 2023 • 17 new comments

• KAFKA-14462; [4/N] Add GroupMetadataManager: ConsumerGroups Management, Members Management and Reconciliation Logic

  #13476 commented on Apr 11, 2023 • 11 new comments

• KAFKA-13668: Retry upon missing initProducerId due to authorization error

  #12149 commented on Apr 14, 2023 • 9 new comments

• KAFKA-14633: Reduce data copy & buffer allocation during decompression

  #13135 commented on Apr 13, 2023 • 7 new comments

• KAFKA-14881: Update UserScramCredentialRecord for SCRAM ZK to KRaft migration

  #13513 commented on Apr 14, 2023 • 7 new comments

• KAFKA-14821 Implement the listOffsets API with AdminApiDriver

  #13432 commented on Apr 12, 2023 • 6 new comments

• KAFKA-14875: Implement wakeup

  #13490 commented on Apr 13, 2023 • 6 new comments

• KIP-863: Reduce CompletedFetch#parseRecord() memory copy

  #12545 commented on Apr 12, 2023 • 4 new comments

• KAFKA-14654: Connector classes should statically initialize with plugin classloader

  #13165 commented on Apr 11, 2023 • 4 new comments

• KAFKA-14766: Improve performance of VarInt encoding and decoding

  #13312 commented on Apr 14, 2023 • 4 new comments

• KAFKA-12694, KAFKA-3910: Add cyclic schema support, fix default struct values

  #13433 commented on Apr 12, 2023 • 4 new comments

• KAFKA-12525: Ignoring Stale status statuses when reading from Status …

  #13453 commented on Apr 13, 2023 • 4 new comments

• KAFKA-14852: Propagate Topic Ids to the Group Coordinator for Offset Fetch

  #13493 commented on Apr 13, 2023 • 4 new comments

• KAFKA-14752: Kafka examples improvements - consumer changes

  #13514 commented on Apr 13, 2023 • 4 new comments

• KAFKA-14133: Replace EasyMock with Mockito in streams tests

  #12607 commented on Apr 13, 2023 • 3 new comments

• KAFKA-14594: Move LogDirsCommand to tools module

  #13122 commented on Apr 13, 2023 • 3 new comments

• Minor: Add JmxTool wrapper scripts and redirection (KIP-906)

  #13195 commented on Apr 14, 2023 • 3 new comments

• KAFKA-13295: Avoiding Transation timeouts arising due to long restora…

  #11433 commented on Apr 12, 2023 • 2 new comments

• KAFKA-14690: Add topic IDs to the OffsetCommit API version 9

  #13240 commented on Apr 12, 2023 • 2 new comments

• MINOR: Refactor TierStateMachine related tests into a separate test file

  #13503 commented on Apr 14, 2023 • 2 new comments

• KAFKA-14226 (KIP-821): [connect:transform] Introduce support for nested structures

  #12637 commented on Apr 14, 2023 • 1 new comment

• KAFKA-14647: Moving TopicFilter to server-common/utils

  #13158 commented on Apr 12, 2023 • 1 new comment

• KAFKA-14577: Move the scala ConsoleProducer from core to tools module

  #13214 commented on Apr 12, 2023 • 1 new comment

• MINOR: add comment that timestamp unit is milliseconds

  #13341 commented on Apr 14, 2023 • 1 new comment

• KAFKA-14592: Move FeatureCommand to tools

  #13459 commented on Apr 12, 2023 • 1 new comment

• KAFKA-14868:Remove some forgotten metrics when the replicaManager is closed

  #13471 commented on Apr 14, 2023 • 1 new comment

• KAFKA-14866:Remove controller module metrics when broker is shutting down

  #13473 commented on Apr 10, 2023 • 1 new comment

• KAFKA-1194: changes needed to run on Windows

  #12331 commented on Apr 14, 2023 • 0 new comments

• MINOR: Add JDK 20 CI build

  #12948 commented on Apr 14, 2023 • 0 new comments

• KAFKA-14464: Make resource leaks for MM2 resources more difficult

  #12980 commented on Apr 12, 2023 • 0 new comments

• KAFKA-14584: Move StateChangeLogMerger tool

  #13171 commented on Apr 13, 2023 • 0 new comments

• KAFKA-13152: Kip 770 buffer size fix

  #13283 commented on Apr 13, 2023 • 0 new comments

• MINOR: Move plugin path parsing from DelegatingClassLoader to PluginUtils

  #13334 commented on Apr 10, 2023 • 0 new comments

• KAFKA-14789: Prevent mis-attributing classpath plugins, allow discovery of classpath RestExtension and ConfigProvider

  #13356 commented on Apr 10, 2023 • 0 new comments

• KAFKA-14401: Fail the worker if any uncaught exception comes in WorkThread

  #13361 commented on Apr 14, 2023 • 0 new comments

• KAFKA-14666: Add MM2 in-memory offset translation index for offsets behind replication

  #13429 commented on Apr 10, 2023 • 0 new comments

• KAFKA-14841 Handle callbacks to ConsumerRebalanceListener in MockConsumer

  #13455 commented on Apr 14, 2023 • 0 new comments

• MINOR: Keep FileOffset opened only the needed time

  #13464 commented on Apr 12, 2023 • 0 new comments

• KAFKA-14863: Hide plugins with invalid constructors during plugin discovery

  #13467 commented on Apr 10, 2023 • 0 new comments

• KAFKA-14752: Kafka examples improvements

  #13492 commented on Apr 13, 2023 • 0 new comments