Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Incorrect statistics read for unsigned integer columns in parquet #10604

Closed
Tracked by #10453
NGA-TRAN opened this issue May 21, 2024 · 1 comment · Fixed by #10704
Closed
Tracked by #10453

Incorrect statistics read for unsigned integer columns in parquet #10604

NGA-TRAN opened this issue May 21, 2024 · 1 comment · Fixed by #10704
Labels
bug Something isn't working

Comments

@NGA-TRAN
Copy link
Contributor

Describe the bug

I found this bug while adding tests for reading parquet statistics #10592. Instead of getting corresponding UInt8Array, UInt16Array, UInt32Array for columns with u8, u16, u32 data types, we get Int32Array. Similarly, instead of getting UInt64Array for column with data type u64, we get Int64Array.

To Reproduce

See the test test_uint in PR #10592 (will be merged soon)

Expected behavior

UInt8Array, UInt16Array, UInt32Array, UInt64Array for columns with data types u8, u16, u32 and u64 respectively

Additional context

No response
@NGA-TRAN NGA-TRAN added the bug Something isn't working label May 21, 2024
@NGA-TRAN NGA-TRAN mentioned this issue May 21, 2024
Closed
23 tasks
@edmondop
Copy link
Contributor

This seems related to this comment

@xinlifoobar xinlifoobar mentioned this issue May 29, 2024
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
bug Something isn't working
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Fix incorrect statistics read for unsigned integers columns in parquet xinlifoobar/datafusion
2 participants
@edmondop @NGA-TRAN