Skip to content

Revised pr 9856#9919

Open
Rich-T-kid wants to merge 2 commits intoapache:mainfrom
Rich-T-kid:revised-pr-9856
Open

Revised pr 9856#9919
Rich-T-kid wants to merge 2 commits intoapache:mainfrom
Rich-T-kid:revised-pr-9856

Conversation

@Rich-T-kid
Copy link
Copy Markdown
Contributor

Which issue does this PR close?

see #9856 & #9865 for more context

Rationale for this change

adds special path for interleave on REE arrays. @asubiotto worked on the ground work for this in #9856 I added the comparison check + arrayData cache, and a couple test from my branch.

What changes are included in this PR?

interleave on REE arrays now has a special path, also
`
[1, 1, 0, 0, 1, 1]

arr.extend(0, 2)
arr.extend(4, 6)
Now result in

runs: [4], values: [1]
instead of
runs: [2, 4], values: [1, 1]`

Are these changes tested?

yes

Are there any user-facing changes?

no

asubiotto and others added 2 commits April 30, 2026 14:17
The specialized interleave works by preserving run ends as much as possible by
coalescing groups of adjacent logical indices pointing to the same source and
calling interleave on the run end values.

Future work could additionally coalesce values across sources, but this
requires a value equality check.

Signed-off-by: Alfonso Subiotto Marques <alfonso.subiotto@polarsignals.com>
@github-actions github-actions Bot added the arrow Changes to the arrow crate label May 5, 2026
Rich-T-kid added a commit to Rich-T-kid/arrow-rs that referenced this pull request May 5, 2026
@Rich-T-kid
Copy link
Copy Markdown
Contributor Author

@Jefffrey

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

arrow Changes to the arrow crate

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Potential Optimization for interleave/take on RunEndEncoded arrays

2 participants