Skip to content

[core] Preserve index manifest compatibility - #9004

Merged
JingsongLi merged 2 commits into
apache:masterfrom
JingsongLi:codex/fix-index-manifest-version
Aug 3, 2026
Merged

[core] Preserve index manifest compatibility#9004
JingsongLi merged 2 commits into
apache:masterfrom
JingsongLi:codex/fix-index-manifest-version

Conversation

@JingsongLi

Copy link
Copy Markdown
Contributor

Purpose

Keep index manifests written by the current Paimon version readable by older Paimon releases.

Changes

  • Keep IndexManifestEntrySerializer at version 1 instead of writing version 2.
  • Read sourceMeta as an optional schema field while preserving the legacy five-field global-index schema.
  • Add a regression test that reads a newly written index manifest with the legacy schema.

Root cause

The serializer version is persisted in every index manifest entry. Older Paimon versions only accept version 1, so entries written with version 2 are rejected before schema evolution can handle the optional field.

Tests

  • mvn -pl paimon-core -DwildcardSuites=none -Dtest=IndexManifestEntrySerializerTest,IndexManifestFileHandlerTest test
  • 13 tests passed; checkstyle, spotless, and enforcer passed.

@JingsongLi
JingsongLi marked this pull request as ready for review August 3, 2026 12:06
@JingsongLi
JingsongLi merged commit 142f823 into apache:master Aug 3, 2026
5 of 12 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants