Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Support of Parquet #2

Closed
erubichi-quotient opened this issue Mar 21, 2022 · 3 comments
Closed

Support of Parquet #2

erubichi-quotient opened this issue Mar 21, 2022 · 3 comments

Comments

@erubichi-quotient
Copy link

Hi :)
Is there a plan anytime soon to support Parquet files as input?
@eyalschneider
Copy link
Contributor

Yes, in the next version (0.92) I intend to introduce two new encoders/decoders: protobuf and Parquet.

@eyalschneider
Copy link
Contributor

@erubichi-quotient : I've been reading about it and experimenting a little. Unfortunately, documentation (in code and outside) is very poor, many examples from blog posts are outdated, and it seems like it's not possible to avoid Hadoop dependencies (additional jars and even environment settings) at the moment. See also this old open issue.
I don't think I will include it in the next Pipes version. If you find a working stand-alone read/write example, please let me know.

@erubichi-quotient
Copy link
Author

Thanks!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@eyalschneider @erubichi-quotient