[FEA] Add python bindings in the parquet reader for num_rows/skiprows
#15144
Assignees
Labels
0 - Backlog
In queue waiting for assignment
cuIO
cuIO issue
feature request
New feature or request
good first issue
Good for newcomers
libcudf
Affects libcudf (C++/CUDA) code.
Python
Affects Python cuDF API.
Milestone
Comments
GregoryKimball
added
feature request
|
Planning on implementing this as part of porting the parquet reader to pylibcudf |
3 tasks
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Is your feature request related to a problem? Please describe.
Unfortunately there has been churn in libcudf around support for
num_rows/skiprowsin the Parquet and ORC readers. In 22.08 we deprecated these parameters in the parquet reader (#11218) and then in 22.10 we removed them from C++ (#11503) and python (#11480). We also deprecatednum_rows/skiprowsin the ORC reader (#11522, see issue #11519).At this point, we realized that chunked parquet reading (#11867) would require adding
num_rows/skiprowsback to the C++ implementation (#11657).Let's stabilize row selection APIs in libcudf by completing these tasks:
num_rows/skiprowsnum_rows/skiprows([REVIEW] Deprecateskiprowsandnum_rowsinread_orc#11522)Additional context
We also dropped
num_rows/skiprowssupport in the cuDF-python fuzz tests (#11505). My preference is to not include any python fuzz testing changes in the scope of this issue.The text was updated successfully, but these errors were encountered: