Skip to content

Commit

Permalink
[SPARK-10911] Executors should System.exit on clean shutdown.
Browse files Browse the repository at this point in the history
Call system.exit explicitly to make sure non-daemon user threads terminate. Without this, user applications might live forever if the cluster manager does not appropriately kill them. E.g., YARN had this bug: HADOOP-12441.

Author: zhuol <zhuol@yahoo-inc.com>

Closes #9946 from zhuoliu/10911.
  • Loading branch information
zhuol authored and Tom Graves committed Jan 26, 2016
1 parent 649e9d0 commit ae0309a
Showing 1 changed file with 1 addition and 0 deletions.
Original file line number Diff line number Diff line change
Expand Up @@ -241,6 +241,7 @@ private[spark] object CoarseGrainedExecutorBackend extends Logging {
}

run(driverUrl, executorId, hostname, cores, appId, workerUrl, userClassPath)
System.exit(0)
}

private def printUsageAndExit() = {
Expand Down

0 comments on commit ae0309a

Please sign in to comment.