Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Writing sliced ListArray or MapArray ignore offsets #1226

Closed
alamb opened this issue Jan 23, 2022 · 0 comments · Fixed by #1214
Closed

Writing sliced ListArray or MapArray ignore offsets #1226

alamb opened this issue Jan 23, 2022 · 0 comments · Fixed by #1214
Labels
bug parquet Changes to the parquet crate

Comments

@alamb
Copy link
Contributor

alamb commented Jan 23, 2022 •
edited
Loading

Describe the bug
When writing List or Map arrays that have been slice()d (aka have a non zero offset) the wrong rows will be written

Write
To Reproduce
Write a sliced `RecordBatch that has an offset; The data written will be relative to 0 offset

Expected behavior
The slice should be relative to the offset

Additional context
Add any other context about the problem here.
@alamb alamb added arrow Changes to the arrow crate bug labels Jan 23, 2022
@alamb alamb mentioned this issue Jan 23, 2022
Merged
@alamb alamb changed the title RecordBatch::slice does not take offset into account RecordBatch::slice for List, Map and Struct does not take offset into account Jan 23, 2022
@alamb alamb changed the title RecordBatch::slice for List, Map and Struct does not take offset into account RecordBatch::slice for List, Map and LargetList not take offset into account Jan 23, 2022
@alamb alamb added parquet Changes to the parquet crate and removed arrow Changes to the arrow crate labels Jan 23, 2022
@alamb alamb changed the title RecordBatch::slice for List, Map and LargetList not take offset into account Writing sliced List or Map Arrays ignore offsets Jan 23, 2022
@alamb alamb changed the title Writing sliced List or Map Arrays ignore offsets Writing sliced ListArray or MapArray ignore offsets Feb 3, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
bug parquet Changes to the parquet crate
Projects
None yet
Milestone
No milestone
1 participant
@alamb