-
Notifications
You must be signed in to change notification settings - Fork 178
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Remove selective unfiltering. #2410
Remove selective unfiltering. #2410
Conversation
This pull request has been linked to Clubhouse Story #8874: Remove selective unfiltering. |
1d19672
to
720674d
Compare
720674d
to
d5ffd4d
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This looks good, but will we have backward compatibility issues? cc @Shelnutt2
RETURN_NOT_OK( | ||
output->init_var_size(buffer_addressing, std::move(chunk_sizes))); | ||
RETURN_NOT_OK(output->init_var_size( | ||
ChunkedBuffer::BufferAddressing::CONTIGUOUS, std::move(chunk_sizes))); |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Making a note that we now need to clean up ChunkedBuffer
as we don't need two different addressing types - they should all be CONTIGUOUS
.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
As discussed, I will filed a follow up item for this for next sprint.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Actually no backward compatibility issue, we should be good.
d5ffd4d
to
9f71d2d
Compare
9f71d2d
to
c592d0b
Compare
From what we know about our customer's use case, they either will read the full array where this gains nothing (and actually this affects the performance negatively because of the added code complexity), or very targeted ones, for which the gains would be very small, unless the tile capacity/extent is unusually large if the users have a poorly configured array. Also, this will allow us to implement compression codec for video and imaging, which won't work with selective unfiltering. --- TYPE: IMPROVEMENT DESC: Remove selective unfiltering.
From what we know about our customer's use case, they either will do the full array where this gains nothing (and actually this affects the performance negatively because of the added code complexity), or very targeted ones, for which the gains would be very small, unless the tile capacity/extent is unusually large if the users have a poorly configured array.
Also, this will allow us to implement compression codec for video and imaging, which won't work with selective unfiltering.
TYPE: IMPROVEMENT
DESC: Remove selective unfiltering.