You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
It seems to be a way to skip data pages when reading a parquet file.
This can be very useful when you have chunky data - say - sorted first by date and userId. This would allow you to quickly select one date & userId pair (by reading only some pages of the relevant row group) without loosing the benefits of parquet.
The text was updated successfully, but these errors were encountered:
Description
I am not sure if this is implemented, but keen to see it added if it's not.
ColumnIndex Layout to Support Page Skipping
It seems to be a way to skip data pages when reading a parquet file.
This can be very useful when you have chunky data - say - sorted first by
date
anduserId
. This would allow you to quickly select onedate
&userId
pair (by reading only some pages of the relevant row group) without loosing the benefits of parquet.The text was updated successfully, but these errors were encountered: