Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[SPARK-22976][Core]: Cluster mode driver dir removed while running #20298

Closed
wants to merge 1 commit into from
Closed

[SPARK-22976][Core]: Cluster mode driver dir removed while running #20298

wants to merge 1 commit into from

Commits on Jan 17, 2018

  1. [SPARK-22976][Core]: Cluster mode driver dir removed while running 

    The clean up logic on the worker perviously determined the liveness of a
particular applicaiton based on whether or not it had running executors.
This would fail in the case that a directory was made for a driver
running in cluster mode if that driver had no running executors on the
same machine. To preserve driver directories we consider both executors
and running drivers when checking directory liveness.
    @RussellSpitzer
    RussellSpitzer committed Jan 17, 2018
    Configuration menu
    Copy the full SHA
    38916f7 View commit details
    Browse the repository at this point in the history