Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[SPARK-17742][core] Handle child process exit in SparkLauncher. #18877

Closed
wants to merge 2 commits into from

Commits on Aug 7, 2017

  1. [SPARK-17742][core] Handle child process exit in SparkLauncher.

    Currently the launcher handle does not monitor the child spark-submit
    process it launches; this means that if the child exits with an error,
    the handle's state will never change, and an application will not know
    that the application has failed.
    
    This change adds code to monitor the child process, and changes the
    handle state appropriately when the child process exits.
    
    Tested with added unit tests.
    Marcelo Vanzin committed Aug 7, 2017
    Configuration menu
    Copy the full SHA
    15e1a73 View commit details
    Browse the repository at this point in the history

Commits on Aug 10, 2017

  1. Make real sure process exits before getting exit code.

    And log exceptions. And add a transition to KILLED state that
    was missing.
    Marcelo Vanzin committed Aug 10, 2017
    Configuration menu
    Copy the full SHA
    def2329 View commit details
    Browse the repository at this point in the history