Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add df_read_ipc_stream #265

Closed
joshuataylor opened this issue Jun 23, 2022 · 0 comments · Fixed by #270
Closed

Add df_read_ipc_stream #265

joshuataylor opened this issue Jun 23, 2022 · 0 comments · Fixed by #270

Comments

@joshuataylor
Copy link
Contributor

joshuataylor commented Jun 23, 2022

For context about Arrow Streams, please read https://jorgecarleitao.github.io/arrow2/io/ipc_stream_read.html .
Here is a quick primer about the streaming files from Arrow: https://arrow.apache.org/docs/python/ipc.html

We want to be able to read Arrow Streaming files, so adding this would be worth while. However, we're blocked until Polars adds support, which I've created an issue for, which is blocked until Arrow2 adds support.

I am working on both tasks to get them in before starting work on this. 🚀

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant