New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Use empty_like in scatter #8314
Use empty_like in scatter #8314
Conversation
std::unique_ptr<cudf::column> make_empty_lists_column(data_type child_type, | ||
rmm::cuda_stream_view stream, | ||
rmm::mr::device_memory_resource* mr); |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thumbs up. This function should not exist.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
lgtm
Codecov Report
@@ Coverage Diff @@
## branch-21.06 #8314 +/- ##
===============================================
Coverage ? 82.88%
===============================================
Files ? 105
Lines ? 17874
Branches ? 0
===============================================
Hits ? 14814
Misses ? 3060
Partials ? 0 Continue to review full report at Codecov.
|
What's the error in |
The error is that it is trying to make a deeply nested empty column, and |
It's also that for nested types, the "type" is encoded in the hierarchy structure itself. So you can't properly preserve it without making a deep (even if potentially empty) copy of the whole thing. |
@gpucibot merge |
Just leaving a reference here so that I can refer back to this PR easily. |
This prevents things like partition from working with deeply nested arrays.
I marked this as non-breaking, but I am happy to change it to breaking because I removed a detailed API that is not used anywhere else and is flawed.