You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Describe the bug
Some parquet writers produce RLE encoded dictionaries with bit packing even if value count is not divisible by 8.
This violates the assumption decoder makes about the number of values present in the bit-packed run, causing infinite loop and hang.
To Reproduce
Attempt to read parquet file where number of values is not power of 2 but RLE encoding with bit packing was used.
Expected behavior
File should be read correctly.
Additional context
The text was updated successfully, but these errors were encountered:
Describe the bug
Some parquet writers produce RLE encoded dictionaries with bit packing even if value count is not divisible by 8.
This violates the assumption decoder makes about the number of values present in the bit-packed run, causing infinite loop and hang.
To Reproduce
Attempt to read parquet file where number of values is not power of 2 but RLE encoding with bit packing was used.
Expected behavior
File should be read correctly.
Additional context
The text was updated successfully, but these errors were encountered: