-
Notifications
You must be signed in to change notification settings - Fork 871
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Extract Dremel encoding code from Parquet #11461
Conversation
Many iterations already happened. I just realized late that I should commit
sliced no longer works
early return and remove unnecessary statements
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Approving this as it is a move and slight refactor to namespaces. I have already reviewed this code in #11129 and identified some areas for improvement. We need to keep momentum while avoiding conflicts between the lexicographic comparator work and Parquet work.
Codecov Report
@@ Coverage Diff @@
## branch-22.10 #11461 +/- ##
===============================================
Coverage ? 86.47%
===============================================
Files ? 144
Lines ? 22856
Branches ? 0
===============================================
Hits ? 19765
Misses ? 3091
Partials ? 0 Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here. |
@gpucibot merge |
Description
This PR removes the Dremel encoding logic from Parquet-specific files and places it into a separate set of files for consumption by non-Parquet code. This PR also includes a minor rename of
utilities/column.hpp
->utilities/linked_column.hpp
to more accurately reflect the contents of that file.These changes were split out from #11129 to minimize future conflicts with Parquet development (which is very active at present) and to allow further refactoring and other improvements on this Dremel code to proceed independently of the list lexicographic comparator.
Checklist