slice is not respected in the sense that apparently the whole file is loaded first. This results for me in OOM and a longer than expected time. #16066
Labels
bug
Something isn't working
needs triage
Awaiting prioritization by a maintainer
python
Related to Python Polars
Checks
Reproducible example
Log output
No response
Issue description
Trying to load specific rows from a big parquet file.
With parquet as above, I get OOM exception, after a long time passes.
With scan_csv of the matching file seems to work fine.
Expected behavior
As I indicate the slice, and it can be potentially used to optimize and read only a small portion of the file, I would be happy if this is indeed what happened.
Installed versions
The text was updated successfully, but these errors were encountered: