Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

GH-36502: [C++] Add run-end encoded array support to ReferencedByteRanges #36521

Merged
merged 9 commits into from
Jul 11, 2023

Conversation

felipecrv
Copy link
Contributor

@felipecrv felipecrv commented Jul 6, 2023

Rationale for this change

Fix for #36502.

What changes are included in this PR?

Fix and C++ tests.

Are these changes tested?

Yes.

Are there any user-facing changes?

Addition of a new function to the ree_util namespace.

@felipecrv
Copy link
Contributor Author

@mapleFU @sjperkins @pitrou

@felipecrv felipecrv requested review from pitrou and bkietz July 7, 2023 18:09
Copy link
Member

@bkietz bkietz left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, just a few nits

cpp/src/arrow/util/ree_util.cc Outdated Show resolved Hide resolved
cpp/src/arrow/util/ree_util.h Outdated Show resolved Hide resolved
cpp/src/arrow/util/byte_size.cc Outdated Show resolved Hide resolved
@github-actions github-actions bot added awaiting changes Awaiting changes awaiting change review Awaiting change review and removed awaiting review Awaiting review awaiting changes Awaiting changes labels Jul 7, 2023
@github-actions github-actions bot added awaiting merge Awaiting merge and removed awaiting change review Awaiting change review labels Jul 10, 2023
Copy link
Member

@pitrou pitrou left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @felipecrv ! Just one comment but otherwise LGTM.

cpp/src/arrow/util/ree_util.h Outdated Show resolved Hide resolved
@felipecrv felipecrv requested a review from pitrou July 10, 2023 17:29
Copy link
Member

@pitrou pitrou left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM but one thing to fix.

@felipecrv felipecrv requested a review from pitrou July 11, 2023 16:38
@felipecrv
Copy link
Contributor Author

I'm going to rebase and force-push to see if these protobuf issues go away.

@pitrou
Copy link
Member

pitrou commented Jul 11, 2023

The protobuf issues are #36606

@pitrou pitrou merged commit e4bf235 into apache:main Jul 11, 2023
28 of 34 checks passed
@pitrou pitrou removed the awaiting merge Awaiting merge label Jul 11, 2023
@felipecrv felipecrv deleted the ree_bytes_range branch July 12, 2023 18:03
@conbench-apache-arrow
Copy link

After merging your PR, Conbench analyzed the 6 benchmarking runs that have been run so far on merge-commit e4bf235.

There were no benchmark performance regressions. 🎉

The full Conbench report has more details. It also includes information about possible false positives for unstable benchmarks that are known to sometimes produce them.

R-JunmingChen pushed a commit to R-JunmingChen/arrow that referenced this pull request Aug 20, 2023
…ByteRanges (apache#36521)

### Rationale for this change

Fix for apache#36502.

### What changes are included in this PR?

Fix and C++ tests.

### Are these changes tested?

Yes.

### Are there any user-facing changes?

Addition of a new function to the `ree_util` namespace.
* Closes: apache#36502

Lead-authored-by: Felipe Oliveira Carvalho <felipekde@gmail.com>
Co-authored-by: Benjamin Kietzman <bengilgit@gmail.com>
Signed-off-by: Antoine Pitrou <antoine@python.org>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

GetByteRangesArray doesn't support run-end encoded arrays
3 participants