Skip to content

[AIRFLOW-677] Kill task if it fails to heartbeat#1923

Closed
saguziel wants to merge 3 commits intoapache:masterfrom
saguziel:kill_zombies
Closed

[AIRFLOW-677] Kill task if it fails to heartbeat#1923
saguziel wants to merge 3 commits intoapache:masterfrom
saguziel:kill_zombies

Conversation

@saguziel
Copy link
Contributor

@saguziel saguziel commented Dec 6, 2016

Dear Airflow Maintainers,

Please accept this PR that addresses the following issues:

@mistercrunch @artwr @bolkedebruin @plypaul

Testing Done:

  • We've been running this in production at Airbnb for a bit, although off a different merge base

If there's a connection error while heartbeating, it should retry. Also,
if it hasn't been able to heartbeat for a while, it should kill the
child processes so that we don't have 2 of the same task running.
@saguziel saguziel force-pushed the kill_zombies branch 2 times, most recently from d792fa7 to ea58c6a Compare December 8, 2016 19:53
@codecov-io
Copy link

Current coverage is 66.56% (diff: 70.37%)

Merging #1923 into master will increase coverage by <.01%

@@             master      #1923   diff @@
==========================================
  Files           135        135          
  Lines         10133      10181    +48   
  Methods           0          0          
  Messages          0          0          
  Branches          0          0          
==========================================
+ Hits           6745       6777    +32   
- Misses         3388       3404    +16   
  Partials          0          0          

Powered by Codecov. Last update b674656...f67b8a4

@aoen
Copy link
Contributor

aoen commented Dec 8, 2016

LGTM (FYI this PR got reviewed internally at Airbnb by mistercrunch and myself to get to it's current state)

Also note that the original owner of this PR is @plypaul

@saguziel
Copy link
Contributor Author

saguziel commented Dec 9, 2016

this was merged in 2306892

@saguziel saguziel closed this Dec 9, 2016
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants