Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
PARQUET-2119: [C++] Fix DeltaBitPackDecoder fuzzer found issue
DeltaBitPackDecoder was using num_values_(which includes) null to compute batch size instead of total_value_count_. This lead to a failed check when comparing those counts. Changed to just use total_value_count_ and get rid of the check. Alternatively, we could throw an exception instead of the check; I think we only enter this state if the file is malformed (assuming no bugs elsewhere). Also modified decode arrow to check the return value of DecodeInternal; this might be pointless as its callers only compare the returned value count as a DCHECK. It might be a good idea to standardize at what stage of decoding values should be compared to expected values and the behavior when they are not equal (preferably an exception and not a check). Closes #12365 from tachyonwill/delta_check Lead-authored-by: William Butler <tachyonwill@gmail.com> Co-authored-by: William Butler <wab@google.com> Signed-off-by: Antoine Pitrou <antoine@python.org>
- Loading branch information