Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[SPARK-21790][TESTS] Fix Docker-based Integration Test errors. #19000

Closed
wants to merge 1 commit into from
Closed

[SPARK-21790][TESTS] Fix Docker-based Integration Test errors. #19000

wants to merge 1 commit into from

Conversation

wangyum
Copy link
Member

@wangyum wangyum commented Aug 19, 2017

What changes were proposed in this pull request?

SPARK-17701 removed metadata function, this PR removed the Docker-based Integration module that has been relevant to SparkPlan.metadata.

How was this patch tested?

manual tests

@SparkQA
Copy link

SparkQA commented Aug 19, 2017

Test build #80872 has finished for PR 19000 at commit 6f92ccb.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

Copy link
Member

@gatorsmile gatorsmile left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Just ran the docker test in my local environment. It works well.

@gatorsmile
Copy link
Member

LGTM

@gatorsmile
Copy link
Member

Thanks! Merging to master.

@asfgit asfgit closed this in 72b738d Aug 19, 2017
// The "PushedFilters" part should be exist in Datafrome's
// physical plan and the existence of right literals in
// "PushedFilters" is used to prove that the predicates
// pushing down have been effective.
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Since you removed the checking for the filter pushdown verification, please add them back in the follow-up PR. Thanks!

Example is https://github.com/apache/spark/blob/master/sql/core/src/test/scala/org/apache/spark/sql/jdbc/JDBCSuite.scala#L262-L271

asfgit pushed a commit that referenced this pull request Aug 21, 2017
## What changes were proposed in this pull request?

The previous PR(#19000) removed filter pushdown verification, This PR add them back.

## How was this patch tested?
manual tests

Author: Yuming Wang <wgyumg@gmail.com>

Closes #19002 from wangyum/SPARK-21790-follow-up.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
4 participants