Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Revert "consumer: removes unused task" #259

Merged

Conversation

diegodelemos
Copy link
Member

This reverts commit 441e28b.

  • We are correctly using the
    TTLSecondsAfterFinished,
    and it really works, but the subtle detail is that RJC never
    finishes. One can see this by checking how many ready containers
    are inside the pod, Workflow Engine finishes and RJC still runs,
    see:
    $ kubectl get pod \
              batch-serial-a0f3f1c4-161d-461c-94e0-c4dae1000b2f-nv8bb -o json | \
      jq '.status.containerStatuses[] | .name + " " + (.ready|tostring)'
        "job-controller true"
        "workflow-engine false"
    Because of this we need to manually delete the batch- containers
    with the task that was removed in the previous commit
    (closes workflow_run_manager: batch workflows not being cleaned-up #258).

This reverts commit 441e28b.

* We are correctly using the
  [TTLSecondsAfterFinished](https://kubernetes.io/docs/concepts/workloads/controllers/ttlafterfinished),
  and it really works, but the subtle detail is that RJC never
  finishes. One can see this by checking how many ready containers
  are inside the pod, Workflow Engine finishes and RJC still runs,
  see:
  ```console
  $ kubectl get pod \
            batch-serial-a0f3f1c4-161d-461c-94e0-c4dae1000b2f-nv8bb -o json | \
    jq '.status.containerStatuses[] | .name + " " + (.ready|tostring)'
      "job-controller true"
      "workflow-engine false"
  ```
  Because of this we need to manually delete the batch- containers
  with the task that was removed in the previous commit
  (closes reanahub#258).
@tiborsimko tiborsimko merged commit 2840cba into reanahub:master Oct 18, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

workflow_run_manager: batch workflows not being cleaned-up
2 participants