Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[SPARK-10178][SQL] HiveComparisionTest should print out dependent tables #8388

Closed
wants to merge 5 commits into from

Conversation

marmbrus
Copy link
Contributor

In HiveComparisionTests it is possible to fail a query of the form SELECT * FROM dest1, where dest1 is the query that is actually computing the incorrect results. To aid debugging this patch improves the harness to also print these query plans and their results.

@marmbrus
Copy link
Contributor Author

/cc @JoshRosen

@SparkQA
Copy link

SparkQA commented Aug 24, 2015

Test build #41440 has finished for PR 8388 at commit b3b84b4.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

TestHive.reset()
val executions = queryList.map(new TestHive.QueryExecution(_))
executions.foreach(_.toRdd)
val tablesGenerated = queryList.zip(executions).flatMap{
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Style nit.

@JoshRosen
Copy link
Contributor

LGTM overall, modulo a few minor nits.

@SparkQA
Copy link

SparkQA commented Aug 25, 2015

Test build #41503 has finished for PR 8388 at commit a723dda.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@rxin
Copy link
Contributor

rxin commented Aug 25, 2015

I've merged this into master & branch-1.5 (since it is test only).

@asfgit asfgit closed this in 5175ca0 Aug 25, 2015
asfgit pushed a commit that referenced this pull request Aug 25, 2015
…bles

In `HiveComparisionTest`s it is possible to fail a query of the form `SELECT * FROM dest1`, where `dest1` is the query that is actually computing the incorrect results.  To aid debugging this patch improves the harness to also print these query plans and their results.

Author: Michael Armbrust <michael@databricks.com>

Closes #8388 from marmbrus/generatedTables.

(cherry picked from commit 5175ca0)
Signed-off-by: Reynold Xin <rxin@databricks.com>
@marmbrus marmbrus deleted the generatedTables branch March 8, 2016 00:05
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants