Cherry-pick: Fix parquet reader v3 handling arrays that cross pages - #2053
Conversation
Fix parquet reader v3 handling arrays that cross pages
CI triage — PR #2053 (cherry-pick of ClickHouse#94125, parquet reader v3)Verdict: 22 red checks → 0 are caused by this PR. All are infra (runner deaths), pre-existing flaky/known test failures that reproduce on the base branch, container-scanner noise, or aggregate gates that are only red because of the above. The fix's actual surface is green: every Parquet and Iceberg regression suite passed. The diff touches only 1. Infra — self-hosted runner lost communication (safe to re-run)These jobs all died at exactly
→ Not PR-related. Re-run the failed jobs. 2. Pre-existing flaky / environmental test failures (reproduce on base branch)The four
→ Not PR-related. Pre-existing on 3. Grype container scans (keeper / server / server-alpine, and the
|
|
Antalya is handled by #2103, removing from the project |
Cherry-picked from ClickHouse#94125.
Changelog category (leave one):
Changelog entry (a user-readable short description of the changes that goes to CHANGELOG.md):
Fixed parquet reader v3 incorrectly handling arrays that cross page boundaries. This happens e.g. for files written by Arrow without enabling page statistics or page index. Affects only columns of Array data type. Likely symptom is that one array every ~1 MB of data gets truncated. Before this fix, use this setting as workaround:
input_format_parquet_use_native_reader_v3 = 0(ClickHouse#94125 by @al13n321)CI/CD Options
Exclude tests:
Regression jobs to run: