Skip to content

[26.2] Schema context support for Iceberg translation - #1784

Merged
kbatuigas merged 7 commits into
betafrom
DOC-2192-document-feature-iceberg-support-translation-usi
Jul 27, 2026
Merged

[26.2] Schema context support for Iceberg translation#1784
kbatuigas merged 7 commits into
betafrom
DOC-2192-document-feature-iceberg-support-translation-usi

Conversation

@kbatuigas

@kbatuigas kbatuigas commented Jul 10, 2026

Copy link
Copy Markdown
Contributor

Description

This pull request introduces support for resolving Iceberg-enabled topic schemas within specific Schema Registry contexts, rather than always using the default context. It adds a new topic property, redpanda.schema.registry.context, and updates documentation to reflect this new capability, which is especially useful for multi-tenant or per-environment schema isolation. Related troubleshooting guidance and configuration documentation have also been updated.

Iceberg and Schema Registry context support:

  • Added the redpanda.schema.registry.context topic property, allowing topics to bind Iceberg translation to a specific Schema Registry context for schema resolution.
  • Updated release notes to document the new context property, describe its use cases, and link to configuration examples.
  • Added troubleshooting documentation for cases where Redpanda cannot resolve a schema ID within the topic's configured Schema Registry context.

Resolves https://redpandadata.atlassian.net/browse/DOC-2192
Review deadline: 23 Jul

Preview pages

Checks

  • New feature
  • Content gap
  • Support Follow-up
  • Small fix (typos, links, copyedits, etc)

@kbatuigas
kbatuigas requested a review from a team as a code owner July 10, 2026 19:27
@netlify

netlify Bot commented Jul 10, 2026

Copy link
Copy Markdown

Deploy Preview for redpanda-docs-preview ready!

Name Link
🔨 Latest commit 34852f2
🔍 Latest deploy log https://app.netlify.com/projects/redpanda-docs-preview/deploys/6a67dfa6f21ff800080ec1f5
😎 Deploy Preview https://deploy-preview-1784--redpanda-docs-preview.netlify.app
📱 Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify project configuration.

@coderabbitai

coderabbitai Bot commented Jul 10, 2026

Copy link
Copy Markdown
Contributor

Important

Review skipped

Auto reviews are disabled on base/target branches other than the default branch.

Please check the settings in the CodeRabbit UI or the .coderabbit.yaml file in this repository. To trigger a single review, invoke the @coderabbitai review command.

⚙️ Run configuration

Configuration used: Organization UI

Review profile: CHILL

Plan: Pro

Run ID: bb7f9ba2-b3be-4182-b582-7f173f608192

You can disable this status message by setting the reviews.review_status to false in the CodeRabbit configuration file.

Use the checkbox below for a quick retry:

  • 🔍 Trigger review
✨ Finishing Touches
🧪 Generate unit tests (beta)
  • Create PR with unit tests
  • Commit unit tests in branch DOC-2192-document-feature-iceberg-support-translation-usi

Comment @coderabbitai help to get the list of available commands.

@kbatuigas
kbatuigas force-pushed the DOC-2192-document-feature-iceberg-support-translation-usi branch from 0734ec9 to e53e23a Compare July 21, 2026 22:19
Comment thread modules/get-started/pages/release-notes/redpanda.adoc Outdated
Comment thread modules/reference/partials/properties/topic-properties.adoc Outdated
Comment thread modules/manage/pages/iceberg/specify-iceberg-schema.adoc Outdated
@micheleRP

Copy link
Copy Markdown
Contributor

Docs review — suggestions

A few minor, non-blocking suggestions. Technically this looks good (and SME-approved).

1. Heading case — topic-properties.adoc

The new == Schema Registry and Validation Properties heading is Title Case, but the team standard is sentence case: == Schema Registry and validation properties ("Schema Registry" stays capitalized as a product feature).

While you're here: the headings on this page are inconsistent — "Retention and Compaction Properties", "Segment and Message Properties", and "Performance and Cluster Properties" are Title Case, while "Tiered Storage properties", "Remote Read Replica properties", and "Apache Iceberg integration properties" are sentence case. It'd be nice to bring them all to sentence case in this PR.

2. Troubleshooting bullet — iceberg-troubleshooting.adoc

The bullet says Redpanda "cannot resolve the record's schema ID within the topic's configured Schema Registry context." This is the same "not always by ID" point Matt raised on specify-iceberg-schema.adoc — in value_schema_latest mode resolution is by subject/latest, not schema ID. Consider the catch-all: "cannot resolve the record's schema within the topic's configured Schema Registry context."

3. Cloud rendering — schema-reg-contexts.adoc

The new ifdef::env-cloud[] text reads "Enabling schema_registry_enable_qualified_subjects requires a broker restart to take effect." In Redpanda Cloud, users don't restart brokers themselves — worth confirming this phrasing is accurate/actionable when this single-sourced page renders in cloud-docs.

Comment thread modules/manage/pages/schema-reg/schema-reg-contexts.adoc
@micheleRP

Copy link
Copy Markdown
Contributor

On single-sourcing to Cloud:

The new "Resolve schemas within a Schema Registry context" section sits inside the tag=single-source region on specify-iceberg-schema.adoc, so it'll flow into the Cloud page as-is. A couple of bits are self-managed-specific — the "Starting in Redpanda 26.2… enabled by default" line, and (per the contexts page) contexts aren't exposed to users on Serverless. Do you want this section wrapped in ifndef::env-cloud[] (or given Cloud/Serverless-aware conditionals), or is that something you'll handle in the follow-up Cloud PR? No blocker either way — just checking so it doesn't render unguarded in Cloud by accident.

@micheleRP micheleRP left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

please see suggestions before merging!

kbatuigas and others added 7 commits July 27, 2026 15:45
… Cloud

Wrap the new 26.2 content in ifndef::env-cloud so it doesn't surface to Cloud
users before 26.2 reaches Cloud (release cut 2026-07-31, available 2026-08-03):

- specify-iceberg-schema.adoc: the "Resolve schemas within a Schema Registry
  context" section (and its [[resolve-schemas-within-a-context]] anchor)
- iceberg-troubleshooting.adoc: the new "cannot resolve schema ID within the
  configured context" DLQ bullet (which links to that anchor)

Left unconditional: release notes (self-managed-only page), schema-reg-contexts
version notes (correct in both envs), and the topic-properties property doc (the
topic-properties reference is self-managed-only in Cloud, so the property and
its anchor xref never surface there).

Remove these conditionals once 26.2 is available in Cloud AND Cloud support for
`redpanda.schema.registry.context` is confirmed (not confirmable from cloudv2 yet).

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
@kbatuigas
kbatuigas force-pushed the DOC-2192-document-feature-iceberg-support-translation-usi branch from a93da2f to 34852f2 Compare July 27, 2026 22:45
@kbatuigas
kbatuigas merged commit b8b9b5a into beta Jul 27, 2026
8 checks passed
@kbatuigas
kbatuigas deleted the DOC-2192-document-feature-iceberg-support-translation-usi branch July 27, 2026 23:17
@kbatuigas
kbatuigas restored the DOC-2192-document-feature-iceberg-support-translation-usi branch July 27, 2026 23:18
kbatuigas added a commit that referenced this pull request Jul 27, 2026
Review-comment fixes that were committed after #1784's squash merge, applied
directly to beta:
- topic-properties: heading to sentence case
- iceberg-troubleshooting: DLQ bullet "schema ID" -> "schema"
- schema-reg-contexts: simplify Cloud rendering (contexts are default-enabled
  in 26.2) and use present tense

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
kbatuigas added a commit that referenced this pull request Jul 28, 2026
Brings the branch current with beta (which now includes #1784 and #1805).
Conflict resolution in specify-iceberg-schema.adoc: the section-based
"Configure key, value, and header translation" section comes first, then
"Resolve schemas within a Schema Registry context" (promoted from === to ==
and moved after the section-based content), followed by a single
"How Iceberg modes translate to table format". release-notes keeps all three
26.2 what's-new entries.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
kbatuigas added a commit that referenced this pull request Jul 28, 2026
- Reword learning objective 3 from "Configure" to "Apply" independent
  key/value/header translation
- Add editor comment noting the broker-upgrade IMPORTANT block is not
  applicable to Redpanda Cloud (flags it for the post-26.2 Cloud
  de-conditionalization pass)
- Align a merged-in #1784 reference to the "Schema Registry" (no article)
  terminology standard: "registered in the Schema Registry" ->
  "registered in Schema Registry"

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants