New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
ARROW-12421: [Rust] [DataFusion] Disable repartition rule #10069
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I suggest we also file a ticket (I can do so if you would like) to investigate and re-enable this optimization
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thanks @andygrove !
That would be great. Thanks. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Agreed. Thanks for the quick fix on this!
Additional discussion on ASF slack is here: https://the-asf.slack.com/archives/C01QUFS30TD/p1618578254185400 may be related to #9865 |
Filed https://issues.apache.org/jira/browse/ARROW-12427 to track reenabling this optimization rule |
Remove repartition rule to fix test regression when running on 24 core threadripper CPU. This will need further investigation but this patch is needed for the 4.0.0 release. Closes apache#10069 from andygrove/remove-repartition Authored-by: Andy Grove <andygrove73@gmail.com> Signed-off-by: Andrew Lamb <andrew@nerdnetworks.org>
Remove repartition rule to fix test regression when running on 24 core threadripper CPU. This will need further investigation but this patch is needed for the 4.0.0 release. Closes apache#10069 from andygrove/remove-repartition Authored-by: Andy Grove <andygrove73@gmail.com> Signed-off-by: Andrew Lamb <andrew@nerdnetworks.org>
Remove repartition rule to fix test regression when running on 24 core threadripper CPU. This will need further investigation but this patch is needed for the 4.0.0 release. Closes apache#10069 from andygrove/remove-repartition Authored-by: Andy Grove <andygrove73@gmail.com> Signed-off-by: Andrew Lamb <andrew@nerdnetworks.org>
Remove repartition rule to fix test regression when running on 24 core threadripper CPU.
This will need further investigation but this patch is needed for the 4.0.0 release.