Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[SPARK-21946][TEST]: fix flaky test: "alter table: rename cached table" in InMemoryCatalogedDDLSuite #19159

Closed
wants to merge 1 commit into from

Conversation

kiszk
Copy link
Member

@kiszk kiszk commented Sep 8, 2017

What changes were proposed in this pull request?

This PR fixes flaky test InMemoryCatalogedDDLSuite "alter table: rename cached table".
Since this test validates distributed DataFrame, the result should be checked by using checkAnswer. The original version used df.collect().Seq method that does not guaranty an order of each element of the result.

How was this patch tested?

Use existing test case

@kiszk kiszk changed the title [TEST]: fix flaky test: "alter table: rename cached table" in InMemoryCatalogedDDLSuite [SPARK-21946][TEST]: fix flaky test: "alter table: rename cached table" in InMemoryCatalogedDDLSuite Sep 8, 2017
@gatorsmile
Copy link
Member

LGTM pending Jenkins.

Copy link
Member

@dongjoon-hyun dongjoon-hyun left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1, LGTM, too.
Thank you for picking up this, @kiszk .

@SparkQA
Copy link

SparkQA commented Sep 8, 2017

Test build #81539 has finished for PR 19159 at commit 7a47891.

  • This patch fails due to an unknown error code, -9.
  • This patch merges cleanly.
  • This patch adds no public classes.

@dongjoon-hyun
Copy link
Member

Retest this please.

@SparkQA
Copy link

SparkQA commented Sep 8, 2017

Test build #81543 has finished for PR 19159 at commit 7a47891.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@gatorsmile
Copy link
Member

Thanks! Merged to master/2.2

asfgit pushed a commit that referenced this pull request Sep 8, 2017
…" in InMemoryCatalogedDDLSuite

## What changes were proposed in this pull request?

This PR fixes flaky test `InMemoryCatalogedDDLSuite "alter table: rename cached table"`.
Since this test validates distributed DataFrame, the result should be checked by using `checkAnswer`. The original version used `df.collect().Seq` method that does not guaranty an order of each element of the result.

## How was this patch tested?

Use existing test case

Author: Kazuaki Ishizaki <ishizaki@jp.ibm.com>

Closes #19159 from kiszk/SPARK-21946.

(cherry picked from commit 8a4f228)
Signed-off-by: gatorsmile <gatorsmile@gmail.com>
@asfgit asfgit closed this in 8a4f228 Sep 8, 2017
MatthewRBruce pushed a commit to Shopify/spark that referenced this pull request Jul 31, 2018
…" in InMemoryCatalogedDDLSuite

## What changes were proposed in this pull request?

This PR fixes flaky test `InMemoryCatalogedDDLSuite "alter table: rename cached table"`.
Since this test validates distributed DataFrame, the result should be checked by using `checkAnswer`. The original version used `df.collect().Seq` method that does not guaranty an order of each element of the result.

## How was this patch tested?

Use existing test case

Author: Kazuaki Ishizaki <ishizaki@jp.ibm.com>

Closes apache#19159 from kiszk/SPARK-21946.

(cherry picked from commit 8a4f228)
Signed-off-by: gatorsmile <gatorsmile@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants