Skip to content

[branch-3.1](variant) normalize legacy single-part dot-key subcolumn paths on read (#62409)#62776

Closed
csun5285 wants to merge 1 commit into
apache:branch-3.1from
csun5285:cherry-pr62409-branch-3.1
Closed

[branch-3.1](variant) normalize legacy single-part dot-key subcolumn paths on read (#62409)#62776
csun5285 wants to merge 1 commit into
apache:branch-3.1from
csun5285:cherry-pr62409-branch-3.1

Conversation

@csun5285
Copy link
Copy Markdown
Contributor

pick from master #62409

…n read (apache#62409)

Legacy variant data from 3.1.x stores a flat JSON key like `{"a.b": 1}`
as a single `PathInData` part `"a.b"`. Master's compaction rebuilds the
schema via `PathInData(string)`, which splits on dots and produces a
multi-part shape that no longer matches the legacy single-part tree.

In `VariantColumnReader::init()`, when adding a subcolumn to the meta
tree, re-split its relative path via the string constructor if it has no
typed / nested metadata. This aligns the tree shape with the new
compaction schema, while the query-side fallback already handles the
reverse direction.
@csun5285 csun5285 requested a review from morrySnow as a code owner April 24, 2026 03:29
@Thearas
Copy link
Copy Markdown
Contributor

Thearas commented Apr 24, 2026

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@csun5285
Copy link
Copy Markdown
Contributor Author

run buildall

@csun5285 csun5285 changed the title [fix](variant) normalize legacy single-part dot-key subcolumn paths on read (#62409) [branch-3.0](variant) normalize legacy single-part dot-key subcolumn paths on read (#62409) Apr 24, 2026
@csun5285 csun5285 changed the title [branch-3.0](variant) normalize legacy single-part dot-key subcolumn paths on read (#62409) [branch-3.1](variant) normalize legacy single-part dot-key subcolumn paths on read (#62409) Apr 24, 2026
@csun5285 csun5285 closed this May 29, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants