New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[SPARK-21790][TESTS] Fix Docker-based Integration Test errors. #19000
Conversation
Test build #80872 has finished for PR 19000 at commit
|
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Just ran the docker test in my local environment. It works well.
LGTM |
Thanks! Merging to master. |
// The "PushedFilters" part should be exist in Datafrome's | ||
// physical plan and the existence of right literals in | ||
// "PushedFilters" is used to prove that the predicates | ||
// pushing down have been effective. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Since you removed the checking for the filter pushdown verification, please add them back in the follow-up PR. Thanks!
## What changes were proposed in this pull request? The previous PR(#19000) removed filter pushdown verification, This PR add them back. ## How was this patch tested? manual tests Author: Yuming Wang <wgyumg@gmail.com> Closes #19002 from wangyum/SPARK-21790-follow-up.
What changes were proposed in this pull request?
SPARK-17701 removed
metadata
function, this PR removed the Docker-based Integration module that has been relevant toSparkPlan.metadata
.How was this patch tested?
manual tests