You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Basically if you have a parquet file with a nested field that has the same name as a top level field, the datafusion parquet reader will read statistics for the nested field instead of the top level field
If you then ask for statistics (e.g. have a predicate on) int_field, the DataFusion reader will produce the statistics for struct_field.int_field rather than the top level int_field
Expected behavior
No response
Additional context
No response
The text was updated successfully, but these errors were encountered:
Describe the bug
Basically if you have a parquet file with a nested field that has the same name as a top level field, the datafusion parquet reader will read statistics for the nested field instead of the top level field
To Reproduce
I added a test in #8294
struct_and_non_struct
Basically it shows:
If you then ask for statistics (e.g. have a predicate on)
int_field
, the DataFusion reader will produce the statistics forstruct_field.int_field
rather than the top levelint_field
Expected behavior
No response
Additional context
No response
The text was updated successfully, but these errors were encountered: