-
Notifications
You must be signed in to change notification settings - Fork 95
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[BUG] Exception repeatedly thrown when widening window to include a column containing arrays of bytes #79
Comments
Have the same issue with v2.6 throwing error for byte columns. 2.4.7834 also threw an error 'encoding RLE_Dictionary is not supported' for the same file. Edit: also an issue in 2.7.0.3 |
Sure thing - the attached one fails pretty hard on Version 2.7.1.0. In 2.6.0.2 it shows just the first two columns, but not the last (byte[]) column. In 2.4.2.0 it works great (shows all three columns, including last byte[] column). |
Thanks a lot for the sample file @Dave-Kiwi . I added a temporary patch to support converting DetailsSo this is an issue with the fact that we use I also put in a fix so any time a value can't be rendered it will be skipped like so: A real proper fix would be to do our own column generation and handle all the different data types ourselves. This is something I'll have to pursue another time; if there's more desire to support different array types. |
Thanks @mukunku! Yes, the byte[] in the sample file is a 3D mask we use for our application that does not correspond to any well-known file type. I think the solution you have provided is excellent, and will serve our purposes very nicely. |
Parquet Viewer Version
Version 2.6.0 and later. Works just fine on earlier versions.
Where was the parquet file created?
Locally using C#
Sample File
Contains PHI. I can make a sanitized one if you think it is needed. Let me know if you have trouble reproducing with a parquet file containing a byte[] column.
Describe the bug
When the window is widened to the column in question, the application repeatedly throws the exception in the attachment
Screenshots
Additional context
I suspect the app is having a problem with a column of type byte[]
Note: This tool relies on the parquet-dotnet library for all the actual Parquet processing. So any issues where that library cannot process a parquet file will not be addressed by us. Please open a ticket on that library's repo to address such issues.
The text was updated successfully, but these errors were encountered: