Skip to content

[flink] Fix schema inference for multi partition Kafka topics - #9478

Merged
JingsongLi merged 1 commit into
apache:masterfrom
ArnavBalyan:arnavb/fix-kafka-sync
Sep 2, 2026
Merged

[flink] Fix schema inference for multi partition Kafka topics#9478
JingsongLi merged 1 commit into
apache:masterfrom
ArnavBalyan:arnavb/fix-kafka-sync

Conversation

@ArnavBalyan

Copy link
Copy Markdown
Member

Purpose

  • Kafka table sync fails table creation when 1st partition has no cdc records, even when other partitions have records.
  • Schema discovery reads only the 1st partition and fails with SchemaRetrievalException.
  • Read records from all topic partitions so the schema is inferred from the first valid CDC record.

Tests

  • UT

@JingsongLi

Copy link
Copy Markdown
Contributor

+1

@JingsongLi
JingsongLi merged commit 2e29b9b into apache:master Sep 2, 2026
12 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants