Skip to content

Commit

Permalink
[SPARK-8634] [STREAMING] [TESTS] Fix flaky test StreamingListenerSuit…
Browse files Browse the repository at this point in the history
…e "receiver info reporting"

As per the unit test log in https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35754/

```
15/06/24 23:09:10.210 Thread-3495 INFO ReceiverTracker: Starting 1 receivers
15/06/24 23:09:10.270 Thread-3495 INFO SparkContext: Starting job: apply at Transformer.scala:22
...
15/06/24 23:09:14.259 ForkJoinPool-4-worker-29 INFO StreamingListenerSuiteReceiver: Started receiver and sleeping
15/06/24 23:09:14.270 ForkJoinPool-4-worker-29 INFO StreamingListenerSuiteReceiver: Reporting error and sleeping
```

it needs at least 4 seconds to receive all receiver events in this slow machine, but `timeout` for `eventually` is only 2 seconds.
This PR increases `timeout` to make this test stable.

Author: zsxwing <zsxwing@gmail.com>

Closes #7017 from zsxwing/SPARK-8634 and squashes the following commits:

719cae4 [zsxwing] Fix flaky test StreamingListenerSuite "receiver info reporting"

(cherry picked from commit cec9852)
Signed-off-by: Andrew Or <andrew@databricks.com>
  • Loading branch information
zsxwing authored and Andrew Or committed Jun 30, 2015
1 parent 6a45d86 commit f84f247
Showing 1 changed file with 1 addition and 1 deletion.
Original file line number Diff line number Diff line change
Expand Up @@ -116,7 +116,7 @@ class StreamingListenerSuite extends TestSuiteBase with Matchers {

ssc.start()
try {
eventually(timeout(2000 millis), interval(20 millis)) {
eventually(timeout(30 seconds), interval(20 millis)) {
collector.startedReceiverStreamIds.size should equal (1)
collector.startedReceiverStreamIds(0) should equal (0)
collector.stoppedReceiverStreamIds should have size 1
Expand Down

0 comments on commit f84f247

Please sign in to comment.