Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add support for List type fields #33

Closed
emanueol opened this issue Apr 2, 2021 · 1 comment
Closed

Add support for List type fields #33

emanueol opened this issue Apr 2, 2021 · 1 comment
Labels
enhancement New feature or request

Comments

@emanueol
Copy link

emanueol commented Apr 2, 2021

Parquet Viewer Version
2.3.0.40676

Where was the parquet file created?
AWS EMR > Apache Spark

Sample File
cant do, its 22MB with sensitive information and i dont have control of producer.

Describe the bug
Parquet contains a field which is a nested table (array of strings).. so I guess ParquetViewer is unable to open these type of parquets.
I cant share parquet data file, but im attaching detailed error popup screenshot - basically its refering to the nested field.

Screenshots
parquet-error-nestedtable
parquet-error-nestedtable2

Additional context

Note: This tool relies on the parquet-dotnet library for all the actual Parquet processing. So any issues where that library cannot process a parquet file will not be addressed by us. Please open a ticket on that library's repo to address such issues.

@emanueol emanueol added the bug Something isn't working label Apr 2, 2021
@emanueol emanueol changed the title [BUG] [BUG] unable to open parquest with nested table field Apr 2, 2021
@emanueol emanueol changed the title [BUG] unable to open parquest with nested table field [BUG] unable to open parquet with nested table field Apr 2, 2021
@mukunku mukunku changed the title [BUG] unable to open parquet with nested table field Add support for List type fields Jun 12, 2021
@mukunku mukunku added enhancement New feature or request and removed bug Something isn't working labels Jun 12, 2021
@mukunku
Copy link
Owner

mukunku commented Jun 13, 2021

Support for List types has been added as of v2.4 (nested lists still not supported though):
image

Let me know how it works for your file. If you experience any issues please comment on #37

Here are some sample files with list values:

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants