Skip to content

Commit

Permalink
fix limit on single threaded parquet reader
Browse files Browse the repository at this point in the history
  • Loading branch information
ritchie46 committed Dec 22, 2021
1 parent fab93e6 commit 1d848c4
Showing 1 changed file with 2 additions and 1 deletion.
3 changes: 2 additions & 1 deletion polars/polars-arrow/src/io/parquet.rs
Original file line number Diff line number Diff line change
Expand Up @@ -48,14 +48,15 @@ pub fn read_parquet<R: Read + Seek>(
if array.len() > remaining_rows {
array = array.slice(0, remaining_rows);
}
remaining_rows -= array.len();

buf_1 = b1;
buf_2 = b2;

Ok(Arc::from(array))
})
.collect::<Result<Vec<_>>>()?;

remaining_rows = metadata.row_groups[rg].num_rows() as usize;
rb.push(arrs)
}

Expand Down

0 comments on commit 1d848c4

Please sign in to comment.