Skip to content
This repository has been archived by the owner on Feb 18, 2024. It is now read-only.

Writing to Parquet fails for extension types that contain lists #830

Closed
dexterduck opened this issue Feb 11, 2022 · 1 comment · Fixed by #1007
Closed

Writing to Parquet fails for extension types that contain lists #830

dexterduck opened this issue Feb 11, 2022 · 1 comment · Fixed by #1007
Assignees
Labels
bug Something isn't working good first issue Good for newcomers help wanted Extra attention is needed

Comments

@dexterduck
Copy link
Contributor

If you create an extension type that wraps any kind of list type, conversion to Parquet format fails.
As far as I can tell, this could be fixed by updating the nested_array_to_page function in io/parquet/write/mod.rs to use:

match array.data_type().to_logical_type() {

instead of

match array.data_type() {
@jorgecarleitao jorgecarleitao added bug Something isn't working good first issue Good for newcomers help wanted Extra attention is needed labels Feb 12, 2022
@zenmiao7
Copy link

I'm happy to do this. Can you assign this issue to me?

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
bug Something isn't working good first issue Good for newcomers help wanted Extra attention is needed
Projects
None yet
Development

Successfully merging a pull request may close this issue.

3 participants