This repository has been archived by the owner on Aug 13, 2018. It is now read-only.

Ensure long running jobs are destroyed after `kill` #24

Closed

quasiben opened this issue Jan 28, 2016 · 0 comments

Labels

bug

Member

quasiben commented Jan 28, 2016

YARN sometimes does not properly clean up container and can leave long running processes linger. I've found a few open issues related to this:

Spark has also had issues around this in the past

[SPARK-4117] [YARN] Spark on Yarn handle AM being told command from RM apache/spark#10129

I've verified on Ubuntu 12.04 that SAMZA-498 resolves the issue

quasiben added the bug label

quasiben changed the title ~~Ensure Long Running Jobs are Destroy after kill~~ Ensure Long Running Jobs are destroyed after kill

quasiben changed the title ~~Ensure Long Running Jobs are destroyed after kill~~ Ensure long running jobs are destroyed after kill

martindurant closed this as completed

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.