Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Avoid materialization of indices in filter_record_batch for single arrays #636

Closed
Dandandan opened this issue Jul 29, 2021 · 0 comments · Fixed by #637
Closed

Avoid materialization of indices in filter_record_batch for single arrays #636

Dandandan opened this issue Jul 29, 2021 · 0 comments · Fixed by #637
Labels
enhancement Any new improvement worthy of a entry in the changelog

Comments

@Dandandan
Copy link
Contributor

Dandandan commented Jul 29, 2021

Is your feature request related to a problem or challenge? Please describe what you are trying to do.
Some optimization possible in the kernel seems to avoid materializing (start, end) and pre-building the filter when there is only a single input array. Useful for filters like SELECT x from t where [...].

Describe the solution you'd like
Don't pre-build the filter but use the normal filter for a single array instead

Describe alternatives you've considered

Additional context
Same as jorgecarleitao/arrow2#235

@Dandandan Dandandan added the enhancement Any new improvement worthy of a entry in the changelog label Jul 29, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement Any new improvement worthy of a entry in the changelog
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant