Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[C++] Add support for sliced Substrait reads #31053

Open
asfimport opened this issue Feb 5, 2022 · 1 comment
Open

[C++] Add support for sliced Substrait reads #31053

asfimport opened this issue Feb 5, 2022 · 1 comment

Comments

@asfimport
Copy link

The Substrait format allows for "sliced reads" which only read a part of the file and would most likely be used if a read operation were distributed across multiple files.

For each file a start byte and length is specified. For files that contain indivisible "groups" (e.g. Parquet row groups) this is handled by picking some heuristic. For example, read all row groups whose midpoint is contained in the interval.

Reporter: Weston Pace / @westonpace

Note: This issue was originally created as ARROW-15589. Please see the migration documentation for further details.

@asfimport
Copy link
Author

Todd Farmer / @toddfarmer:
This issue was last updated over 90 days ago, which may be an indication it is no longer being actively worked. To better reflect the current state, the issue is being unassigned. Please feel free to re-take assignment of the issue if it is being actively worked, or if you plan to start that work soon.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant