Skip to content

Comments

[AIRFLOW-6014] reschedule deleted pending tasks#7611

Closed
inytar wants to merge 1 commit intoapache:masterfrom
wooga:6014-reschedule-deleted-pending-tasks
Closed

[AIRFLOW-6014] reschedule deleted pending tasks#7611
inytar wants to merge 1 commit intoapache:masterfrom
wooga:6014-reschedule-deleted-pending-tasks

Conversation

@inytar
Copy link
Contributor

@inytar inytar commented Mar 3, 2020

This code checks if a k8s process has been deleted and was in the
pending state, if so it will reschedule the task.

This is an alternative implementation of #6606, which we have been using internally. I don't have any preference on which PR to use, wanted to show what we have been running in production for some time.


Issue link: AIRFLOW-6014

Make sure to mark the boxes below before creating PR: [x]

  • Description above provides context of the change
  • Commit message/PR title starts with [AIRFLOW-NNNN]. AIRFLOW-NNNN = JIRA ID*
  • Unit tests coverage for changes (not needed for documentation changes)
    • There seem to be no tests for KubernetesJobWatchers, and it requires a lot of k8s api knowledge it seems, I would be happy with some help on moving forward with this.
  • Commits follow "How to write a good git commit message"
  • Relevant documentation is updated including usage instructions.
  • I will engage committers as explained in Contribution Workflow Example.

* For document-only changes commit message can start with [AIRFLOW-XXXX].


In case of fundamental code change, Airflow Improvement Proposal (AIP) is needed.
In case of a new dependency, check compliance with the ASF 3rd Party License Policy.
In case of backwards incompatible changes please leave a note in UPDATING.md.
Read the Pull Request Guidelines for more information.

@boring-cyborg boring-cyborg bot added area:Scheduler including HA (high availability) scheduler k8s labels Mar 3, 2020
This code checks if a k8s process has been deleted and was in the
pending state, if so it will reschedule the task.
@inytar
Copy link
Contributor Author

inytar commented Mar 17, 2020

A alternative version in #6606 has already been merged.

@inytar inytar closed this Mar 17, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area:Scheduler including HA (high availability) scheduler

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant