[26.2] Schema context support for Iceberg translation - #1784
Conversation
✅ Deploy Preview for redpanda-docs-preview ready!
To edit notification comments on pull requests, go to your Netlify project configuration. |
|
Important Review skippedAuto reviews are disabled on base/target branches other than the default branch. Please check the settings in the CodeRabbit UI or the ⚙️ Run configurationConfiguration used: Organization UI Review profile: CHILL Plan: Pro Run ID: You can disable this status message by setting the Use the checkbox below for a quick retry:
✨ Finishing Touches🧪 Generate unit tests (beta)
Comment |
0734ec9 to
e53e23a
Compare
Docs review — suggestionsA few minor, non-blocking suggestions. Technically this looks good (and SME-approved). 1. Heading case — The new While you're here: the headings on this page are inconsistent — "Retention and Compaction Properties", "Segment and Message Properties", and "Performance and Cluster Properties" are Title Case, while "Tiered Storage properties", "Remote Read Replica properties", and "Apache Iceberg integration properties" are sentence case. It'd be nice to bring them all to sentence case in this PR. 2. Troubleshooting bullet — The bullet says Redpanda "cannot resolve the record's schema ID within the topic's configured Schema Registry context." This is the same "not always by ID" point Matt raised on 3. Cloud rendering — The new |
|
On single-sourcing to Cloud: The new "Resolve schemas within a Schema Registry context" section sits inside the |
micheleRP
left a comment
There was a problem hiding this comment.
please see suggestions before merging!
… Cloud Wrap the new 26.2 content in ifndef::env-cloud so it doesn't surface to Cloud users before 26.2 reaches Cloud (release cut 2026-07-31, available 2026-08-03): - specify-iceberg-schema.adoc: the "Resolve schemas within a Schema Registry context" section (and its [[resolve-schemas-within-a-context]] anchor) - iceberg-troubleshooting.adoc: the new "cannot resolve schema ID within the configured context" DLQ bullet (which links to that anchor) Left unconditional: release notes (self-managed-only page), schema-reg-contexts version notes (correct in both envs), and the topic-properties property doc (the topic-properties reference is self-managed-only in Cloud, so the property and its anchor xref never surface there). Remove these conditionals once 26.2 is available in Cloud AND Cloud support for `redpanda.schema.registry.context` is confirmed (not confirmable from cloudv2 yet). Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
a93da2f to
34852f2
Compare
Review-comment fixes that were committed after #1784's squash merge, applied directly to beta: - topic-properties: heading to sentence case - iceberg-troubleshooting: DLQ bullet "schema ID" -> "schema" - schema-reg-contexts: simplify Cloud rendering (contexts are default-enabled in 26.2) and use present tense Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Brings the branch current with beta (which now includes #1784 and #1805). Conflict resolution in specify-iceberg-schema.adoc: the section-based "Configure key, value, and header translation" section comes first, then "Resolve schemas within a Schema Registry context" (promoted from === to == and moved after the section-based content), followed by a single "How Iceberg modes translate to table format". release-notes keeps all three 26.2 what's-new entries. Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
- Reword learning objective 3 from "Configure" to "Apply" independent key/value/header translation - Add editor comment noting the broker-upgrade IMPORTANT block is not applicable to Redpanda Cloud (flags it for the post-26.2 Cloud de-conditionalization pass) - Align a merged-in #1784 reference to the "Schema Registry" (no article) terminology standard: "registered in the Schema Registry" -> "registered in Schema Registry" Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Description
This pull request introduces support for resolving Iceberg-enabled topic schemas within specific Schema Registry contexts, rather than always using the default context. It adds a new topic property,
redpanda.schema.registry.context, and updates documentation to reflect this new capability, which is especially useful for multi-tenant or per-environment schema isolation. Related troubleshooting guidance and configuration documentation have also been updated.Iceberg and Schema Registry context support:
redpanda.schema.registry.contexttopic property, allowing topics to bind Iceberg translation to a specific Schema Registry context for schema resolution.Resolves https://redpandadata.atlassian.net/browse/DOC-2192
Review deadline: 23 Jul
Preview pages
Checks