-
Notifications
You must be signed in to change notification settings - Fork 28.1k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[SPARK-13711][Core]Don't call SparkUncaughtExceptionHandler in AppClient as it's in driver #11566
Conversation
cc @vanzin as you added |
Actually it seems it was @markhamstra and not me (in 17f3075). |
@vanzin Sorry. I was looking a wrong place... |
So what happens now if the scheduled Runnable throws an exception? |
Just go to |
registerMasterFutures.get.foreach(_.cancel(true)) | ||
registerMasterThreadPool.shutdownNow() | ||
} else if (nthRetry >= REGISTRATION_RETRIES) { | ||
markDead("All masters are unresponsive! Giving up.") |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
FYI, this line will call sc.stop()
: https://github.com/apache/spark/blob/master/core/src/main/scala/org/apache/spark/scheduler/cluster/SparkDeploySchedulerBackend.scala#L136
LGTM |
Test build #52609 has finished for PR 11566 at commit
|
Thanks. Merging to master and 1.6 |
…ient as it's in driver ## What changes were proposed in this pull request? AppClient runs in the driver side. It should not call `Utils.tryOrExit` as it will send exception to SparkUncaughtExceptionHandler and call `System.exit`. This PR just removed `Utils.tryOrExit`. ## How was this patch tested? manual tests. Author: Shixiong Zhu <shixiong@databricks.com> Closes #11566 from zsxwing/SPARK-13711.
…ient as it's in driver ## What changes were proposed in this pull request? AppClient runs in the driver side. It should not call `Utils.tryOrExit` as it will send exception to SparkUncaughtExceptionHandler and call `System.exit`. This PR just removed `Utils.tryOrExit`. ## How was this patch tested? manual tests. Author: Shixiong Zhu <shixiong@databricks.com> Closes apache#11566 from zsxwing/SPARK-13711.
What changes were proposed in this pull request?
AppClient runs in the driver side. It should not call
Utils.tryOrExit
as it will send exception to SparkUncaughtExceptionHandler and callSystem.exit
. This PR just removedUtils.tryOrExit
.How was this patch tested?
manual tests.