We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Is your feature request related to a problem or challenge? Please describe what you are trying to do. There is no memory management in shuffle writer
Describe the solution you'd like
Blaze implements file-based shuffle with memory management in https://github.com/blaze-init/blaze/blob/master/native-engine/datafusion-ext/src/shuffle_writer_exec.rs
Perhaps we can learn from that?
Describe alternatives you've considered A clear and concise description of any alternative solutions or features you've considered.
Additional context See discussion in apache/datafusion#3493 (comment)
The text was updated successfully, but these errors were encountered:
I will take care of this ticket.
Sorry, something went wrong.
No branches or pull requests
Is your feature request related to a problem or challenge? Please describe what you are trying to do.
There is no memory management in shuffle writer
Describe the solution you'd like
Blaze implements file-based shuffle with memory management in https://github.com/blaze-init/blaze/blob/master/native-engine/datafusion-ext/src/shuffle_writer_exec.rs
Perhaps we can learn from that?
Describe alternatives you've considered
A clear and concise description of any alternative solutions or features you've considered.
Additional context
See discussion in apache/datafusion#3493 (comment)
The text was updated successfully, but these errors were encountered: