Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[C++][Dataset] Add RadosParquetFileFormat to Dataset API #28649

Closed
asfimport opened this issue Jun 1, 2021 · 3 comments
Closed

[C++][Dataset] Add RadosParquetFileFormat to Dataset API #28649

asfimport opened this issue Jun 1, 2021 · 3 comments

Comments

@asfimport
Copy link

asfimport commented Jun 1, 2021

Implement a RadosParquetFileFormat class to defer the evaluation of scan operations on a Parquet dataset to a RADOS storage backend. This can be done by using the librados C++ library to execute storage side functions that scan the files on the Ceph storage nodes (OSDs) using Arrow libraries. This issue is an upgrade to the previous story of ARROW-10549. See corresponding mailing list discussion.

Reporter: Jayjeet Chakraborty / @JayjeetAtGithub
Assignee: Jayjeet Chakraborty / @JayjeetAtGithub

Related issues:

PRs and other links:

Note: This issue was originally created as ARROW-12921. Please see the migration documentation for further details.

@asfimport
Copy link
Author

Jayjeet Chakraborty / @JayjeetAtGithub:
Hello all, Just wanted to follow up regarding this issue if anyone has got the chance to look at the PR. It would be great if any reviewer can be assigned to the Pull request and we would like to work with them on this.

@asfimport
Copy link
Author

Aldrin Montana / @drin:
I believe this issue is superceded by ARROW-13607 and thus can be closed?

@asfimport
Copy link
Author

David Li / @lidavidm:
Yup, thanks for pointing that out Aldrin!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant