Please sign in to comment.
[SPARK-24022][TEST] Make SparkContextSuite not flaky
## What changes were proposed in this pull request? SparkContextSuite.test("Cancelling stages/jobs with custom reasons.") could stay in an infinite loop because of the problem found and fixed in [SPARK-23775](https://issues.apache.org/jira/browse/SPARK-23775). This PR solves this mentioned flakyness by removing shared variable usages when cancel happens in a loop and using wait and CountDownLatch for synhronization. ## How was this patch tested? Existing unit test. Author: Gabor Somogyi <email@example.com> Closes #21105 from gaborgsomogyi/SPARK-24022. (cherry picked from commit e55953b) Signed-off-by: Marcelo Vanzin <firstname.lastname@example.org>
- Loading branch information...
Showing with 26 additions and 35 deletions.