Skip to content

Commit

Permalink
[SPARK-13778][CORE] Set the executor state for a worker when removing it
Browse files Browse the repository at this point in the history
## What changes were proposed in this pull request?

When a worker is lost, the executors on this worker are also lost. But Master's ApplicationPage still displays their states as running.

This patch just sets the executor state to `LOST` when a worker is lost.

## How was this patch tested?

manual tests

Author: Shixiong Zhu <shixiong@databricks.com>

Closes #11609 from zsxwing/SPARK-13778.
  • Loading branch information
zsxwing authored and Andrew Or committed Mar 10, 2016
1 parent 37fcda3 commit 40e0676
Showing 1 changed file with 1 addition and 0 deletions.
Original file line number Diff line number Diff line change
Expand Up @@ -763,6 +763,7 @@ private[deploy] class Master(
logInfo("Telling app of lost executor: " + exec.id)
exec.application.driver.send(ExecutorUpdated(
exec.id, ExecutorState.LOST, Some("worker lost"), None))
exec.state = ExecutorState.LOST
exec.application.removeExecutor(exec)
}
for (driver <- worker.drivers.values) {
Expand Down

0 comments on commit 40e0676

Please sign in to comment.