Skip to content

Conversation

@vibhatha
Copy link
Collaborator

@vibhatha vibhatha commented May 28, 2024

Rationale for this change

StringView implementation requires transferPair functionality which is required for C Data interface implementation as well.

What changes are included in this PR?

Adding transferPair functionality and corresponding test cases.

Are these changes tested?

Yes

Are there any user-facing changes?

No

@vibhatha vibhatha self-assigned this May 28, 2024
@vibhatha vibhatha marked this pull request as ready for review May 28, 2024 13:28
@vibhatha vibhatha requested a review from lidavidm as a code owner May 28, 2024 13:28
Comment on lines 941 to 992
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

How does this work when we're not rewriting the view buffers up above?

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

There's not an existing helper for this? I don't think every vector should have its own copy of this code...

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

No there is no helper for this. I looked into what is LargeListVector and BaseVariableWidthVector the code is mostly the same for validity buffer related split and transfer.

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Shall we file a separate issue to write a util for this?

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

That's rather unfortunate. It should go into something like BitVectorHelper

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I agree. Shall I file an issue and work on it as a follow up?

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yes please

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@github-actions github-actions bot added awaiting changes Awaiting changes and removed awaiting review Awaiting review labels May 30, 2024
@vibhatha vibhatha force-pushed the stringview-transferpair branch from 2440d6a to 4dddac9 Compare May 30, 2024 12:22
@github-actions github-actions bot added awaiting change review Awaiting change review and removed awaiting changes Awaiting changes labels May 30, 2024
@vibhatha vibhatha requested a review from lidavidm May 30, 2024 12:23
@vibhatha
Copy link
Collaborator Author

@lidavidm I updated the PR.

@github-actions github-actions bot added awaiting changes Awaiting changes and removed awaiting change review Awaiting change review labels May 31, 2024
@github-actions github-actions bot added awaiting merge Awaiting merge awaiting review Awaiting review and removed awaiting changes Awaiting changes labels May 31, 2024
@github-actions github-actions bot added awaiting review Awaiting review and removed awaiting review Awaiting review awaiting merge Awaiting merge labels May 31, 2024
@github-actions github-actions bot added awaiting committer review Awaiting committer review and removed awaiting review Awaiting review labels May 31, 2024
@lidavidm lidavidm merged commit 706b3e0 into apache:main May 31, 2024
@lidavidm lidavidm removed the awaiting committer review Awaiting committer review label May 31, 2024
@conbench-apache-arrow
Copy link

After merging your PR, Conbench analyzed the 6 benchmarking runs that have been run so far on merge-commit 706b3e0.

There were no benchmark performance regressions. 🎉

The full Conbench report has more details. It also includes information about 1 possible false positive for unstable benchmarks that are known to sometimes produce them.

pribor pushed a commit to GlobalWebIndex/arrow that referenced this pull request Oct 24, 2025
…gView (apache#41861)

### Rationale for this change

StringView implementation requires transferPair functionality which is required for C Data interface implementation as well. 

### What changes are included in this PR?

Adding transferPair functionality and corresponding test cases. 

### Are these changes tested?

Yes

### Are there any user-facing changes?

No
* GitHub Issue: apache#40932

Authored-by: Vibhatha Abeykoon <vibhatha@gmail.com>
Signed-off-by: David Li <li.davidm96@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants