Skip to content

feat(shared_shredding): add read inte test for shared_shredding#382

Merged
lxy-9602 merged 5 commits into
alibaba:mainfrom
lszskye:shared_shredding_read_inte
Jun 26, 2026
Merged

feat(shared_shredding): add read inte test for shared_shredding#382
lxy-9602 merged 5 commits into
alibaba:mainfrom
lszskye:shared_shredding_read_inte

Conversation

@lszskye

@lszskye lszskye commented Jun 25, 2026

Copy link
Copy Markdown
Collaborator

Purpose

Linked issue: #342
This PR completes shared-shredding read integration and extends end-to-end coverage for schema evolution, storage-layout evolution, partial map-key recall, dictionary lazy decoding, PK tables, and blob/data-evolution orthogonal scenarios.

Tests

WriteAndReadInteTest

  • TestAppendSharedShreddingMap
  • TestSharedShreddingWithSchemaEvolution
  • TestMapStorageLayoutDefaultToSharedShredding
  • TestMapStorageLayoutSharedShreddingToDefault
  • TestSharedShreddingWithStructValue
  • TestOrcDictionaryLazyDecodingWithSharedShredding
  • TestPkSharedShreddingMap
  • TestSharedShreddingPartialKeyRecallWithOverflow
  • TestSharedShreddingPartialKeyRecallWithNullOrMissingKey
  • TestSharedShreddingPartialKeyRecallMultipleColumns
  • TestMapStorageLayoutDefaultToSharedShreddingPartialKeyRecall
  • TestMapStorageLayoutSharedShreddingToDefaultPartialKeyRecall
  • TestSharedShreddingDuplicateSelectedKeys
  • TestSharedShreddingAllNullMapColumn

BlobTableInteTest

  • TestSharedShreddingWithBlobDataEvolution
  • TestMultipleSharedShreddingMapsWithBlobDataEvolution
  • TestSharedShreddingMapOverrideWithBlobDataEvolution
  • TestOrcMapStorageLayoutEvolutionWithBlobDataEvolution

@lszskye
lszskye requested a review from lxy-9602 June 25, 2026 06:22
Comment thread src/paimon/core/operation/abstract_split_read.cpp
Comment thread src/paimon/core/operation/abstract_split_read.cpp
Comment thread src/paimon/core/operation/abstract_split_read.cpp Outdated
Comment thread src/paimon/core/operation/data_evolution_split_read.h
@lszskye
lszskye force-pushed the shared_shredding_read_inte branch from 3d94e45 to 50e9c90 Compare June 26, 2026 06:44
@lszskye
lszskye force-pushed the shared_shredding_read_inte branch from 356f575 to 6d17168 Compare June 26, 2026 06:56

@lxy-9602 lxy-9602 left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1

@lxy-9602
lxy-9602 merged commit b631683 into alibaba:main Jun 26, 2026
8 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants