Skip to content

[SPARK-16050][Tests]Remove the flaky test: ConsoleSinkSuite#13776

Closed
zsxwing wants to merge 1 commit intoapache:masterfrom
zsxwing:SPARK-16050
Closed

[SPARK-16050][Tests]Remove the flaky test: ConsoleSinkSuite#13776
zsxwing wants to merge 1 commit intoapache:masterfrom
zsxwing:SPARK-16050

Conversation

@zsxwing
Copy link
Member

@zsxwing zsxwing commented Jun 20, 2016

What changes were proposed in this pull request?

ConsoleSinkSuite just collects content from stdout and compare them with the expected string. However, because Spark may not stop some background threads at once, there is a race condition that other threads are outputting logs to stdout while ConsoleSinkSuite is running. Then it will make ConsoleSinkSuite fail.

Therefore, I just deleted ConsoleSinkSuite. If we want to test ConsoleSinkSuite in future, we should refactoring ConsoleSink to make it testable instead of depending on stdout. Therefore, this test is useless and I just delete it.

How was this patch tested?

Just removed a flaky test.

@zsxwing
Copy link
Member Author

zsxwing commented Jun 20, 2016

/cc @marmbrus @brkyvz

@SparkQA
Copy link

SparkQA commented Jun 20, 2016

Test build #60829 has finished for PR 13776 at commit 6e136ff.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@marmbrus
Copy link
Contributor

LGTM, merging to master and 2.0

@asfgit asfgit closed this in 5cfabec Jun 20, 2016
asfgit pushed a commit that referenced this pull request Jun 20, 2016
## What changes were proposed in this pull request?

ConsoleSinkSuite just collects content from stdout and compare them with the expected string. However, because Spark may not stop some background threads at once, there is a race condition that other threads are outputting logs to **stdout** while ConsoleSinkSuite is running. Then it will make ConsoleSinkSuite fail.

Therefore, I just deleted `ConsoleSinkSuite`. If we want to test ConsoleSinkSuite in future, we should refactoring ConsoleSink to make it testable instead of depending on stdout. Therefore, this test is useless and I just delete it.

## How was this patch tested?

Just removed a flaky test.

Author: Shixiong Zhu <shixiong@databricks.com>

Closes #13776 from zsxwing/SPARK-16050.

(cherry picked from commit 5cfabec)
Signed-off-by: Michael Armbrust <michael@databricks.com>
@zsxwing zsxwing deleted the SPARK-16050 branch June 20, 2016 17:39
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants