Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Python] Write pyarrow.Table to FileWriter or StreamWriter #16587

Closed
asfimport opened this issue May 9, 2017 · 4 comments
Closed

[Python] Write pyarrow.Table to FileWriter or StreamWriter #16587

asfimport opened this issue May 9, 2017 · 4 comments

Comments

@asfimport
Copy link

As part of this, we need to be able to get an iterator of record batches from a table. We may want to write this iteration logic in C++ as it will be generally useful. The chunking between columns may be different, so there is some amount of complexity there

Reporter: Wes McKinney / @wesm
Assignee: Wes McKinney / @wesm

Note: This issue was originally created as ARROW-989. Please see the migration documentation for further details.

@asfimport
Copy link
Author

Wes McKinney / @wesm:
I think what I'm going to do is implement a stream reader for table that handles different chunking across columns, producing a sequence of clean record batches.

@asfimport
Copy link
Author

Wes McKinney / @wesm:
I will address after 0.5.0; does not need to block release

@asfimport
Copy link
Author

Wes McKinney / @wesm:
Part of #1074

@asfimport
Copy link
Author

Uwe Korn / @xhochy:
Issue resolved by pull request #1074

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants