-
Notifications
You must be signed in to change notification settings - Fork 28.2k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[SPARK-35077][SQL] Migrate to transformWithPruning for leftover optimizer rules #32721
Conversation
Test build #139133 has finished for PR 32721 at commit
|
Kubernetes integration test unable to build dist. exiting with code: 1 |
Kubernetes integration test starting |
Kubernetes integration test status success |
Kubernetes integration test starting |
Kubernetes integration test status success |
Test build #139135 has finished for PR 32721 at commit
|
Test build #139143 has finished for PR 32721 at commit
|
@dbaliafroozeh @gengliangwang @hvanhovell @maryannxue this PR is ready for review. |
Kubernetes integration test starting |
Kubernetes integration test status success |
Test build #139175 has finished for PR 32721 at commit
|
Merging to master |
What changes were proposed in this pull request?
Migrate to transformWithPruning for the following queries:
Why are the changes needed?
Reduce the number of tree traversals and hence improve the query compilation latency.
How was this patch tested?
Existing tests.
Performance diff:
<style type="text/css"></style>