Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

If non-leaf-task onExit-handler is defined as DAG only the first task is run #3432

Closed
4 tasks done
arbielsk opened this issue Jul 9, 2020 · 2 comments · Fixed by #3435
Closed
4 tasks done

If non-leaf-task onExit-handler is defined as DAG only the first task is run #3432

arbielsk opened this issue Jul 9, 2020 · 2 comments · Fixed by #3435
Assignees
@simster7
Labels
type/bug

Comments

@arbielsk
Copy link

arbielsk commented Jul 9, 2020

Checklist:

  • I've included the version.
  • I've included reproduction steps.
  • I've included the workflow YAML.
  • I've included the logs.

What happened:
I created a dag where each task has an exit handler. In the example below, step-3 depends on step-2. After the fix of #3395 all exitHandlers are now being called as expected (thanks a lot to the team for this VERY quick fix). However if the exitHandler is defined as a DAG with multiple tasks only the first task seems to be run.

Hypothesis: There might be a connected to #3431

What you expected to happen:
I expected all of the exitHandler's tasks to be run like any other DAG.

How to reproduce it (as minimally and precisely as possible):

apiVersion: argoproj.io/v1alpha1
kind: Workflow
metadata:
  name: exit-handler-bug-example
spec:
  entrypoint: dag
  templates:
    - name: dag
      dag:
        tasks:
          - name: step-1
            onExit: exit-handler
            template: step-template
          - name: step-2
            onExit: exit-handler
            template: step-template
          - name: step-3
            dependencies: [step-2]
            onExit: exit-handler
            template: step-template
    - name: exit-handler
      dag:
        tasks:
          - name: exit-1
            template: sleep-10
          - name: exit-2
            dependencies: [exit-1]
            template: sleep-10
          - name: exit-3
            dependencies: [exit-2]
            template: sleep-10
    - name: sleep-10
      container:
        image: alpine:latest
        command:
          - sh
          - -c
        args:
          - "sleep 10 && echo exit-handler-step-{{pod.name}}"
    - name: step-template
      container:
        image: alpine:latest
        command:
          - sh
          - -c
        args:
          - "sleep 5 && echo step {{pod.name}}"

Anything else we need to know?:
However the exitHandler of the non-leaf task never registers as finished and thus keeps the workflow in status running indefinitely.
I saw similar behavior in 2.8.x where task-level non-leaf-task exitHandlers (defined as DAG) were started but then got stuck after 1 or 2 tasks.

Environment:

  • Argo version:
$ argo version
argo: v2.9.2
  BuildDate: 2020-07-08T23:55:01Z
  GitCommit: 65c2bd44e45c11e0a0b03adeef8d6800b72cd551
  GitTreeState: clean
  GitTag: v2.9.2
  GoVersion: go1.13.4
  Compiler: gc
  Platform: darwin/amd64
  • Kubernetes version :
$ kubectl version -o yaml
clientVersion:
  buildDate: "2020-01-15T08:26:26Z"
  compiler: gc
  gitCommit: e7f962ba86f4ce7033828210ca3556393c377bcc
  gitTreeState: clean
  gitVersion: v1.16.6-beta.0
  goVersion: go1.13.5
  major: "1"
  minor: 16+
  platform: darwin/amd64
serverVersion:
  buildDate: "2020-01-15T08:18:29Z"
  compiler: gc
  gitCommit: e7f962ba86f4ce7033828210ca3556393c377bcc
  gitTreeState: clean
  gitVersion: v1.16.6-beta.0
  goVersion: go1.13.5
  major: "1"
  minor: 16+
  platform: linux/amd64

Other debugging information (if applicable):

  • workflow result:
argo --loglevel DEBUG get <workflowname>
DEBU[0000] CLI version                                   version="{v2.9.2 2020-07-08T23:55:01Z 65c2bd44e45c11e0a0b03adeef8d6800b72cd551 v2.9.2 clean go1.13.4 gc darwin/amd64}"
DEBU[0000] Client options                                opts="{{ false false}  0x2277640 0xc0001040f0}"
Name:                exit-handler-bug-example
Namespace:           argo
ServiceAccount:      default
Status:              Running
Created:             Thu Jul 09 11:21:41 +0200 (5 minutes ago)
Started:             Thu Jul 09 11:21:41 +0200 (5 minutes ago)
Duration:            5 minutes 34 seconds

STEP                         TEMPLATE       PODNAME                              DURATION  MESSAGE
 ● exit-handler-bug-example  dag                                                             
 ├-✔ step-1                  step-template  exit-handler-bug-example-3071691002  8s          
 ├-✔ step-2                  step-template  exit-handler-bug-example-3054913383  10s         
 ├-✔ step-1.onExit           exit-handler                                                    
 | ├-✔ exit-1                sleep-10       exit-handler-bug-example-2218368392  13s         
 | ├-✔ exit-2                sleep-10       exit-handler-bug-example-2268701249  15s         
 | └-✔ exit-3                sleep-10       exit-handler-bug-example-2251923630  13s         
 ├-● step-2.onExit           exit-handler                                                    
 | └-✔ exit-1                sleep-10       exit-handler-bug-example-546893857   14s         
 ├-✔ step-3                  step-template  exit-handler-bug-example-3038135764  10s         
 └-✔ step-3.onExit           exit-handler                                                    
   ├-✔ exit-1                sleep-10       exit-handler-bug-example-1275286746  13s         
   ├-✔ exit-2                sleep-10       exit-handler-bug-example-1258509127  13s         
   └-✔ exit-3                sleep-10       exit-handler-bug-example-1241731508  13s
  • executor logs:
    (logs of pod that executed step-2.onExit.exit-1)
kubectl logs exit-handler-bug-example-546893857 -c init

Error from server (BadRequest): container init is not valid for pod exit-handler-bug-example-546893857

kubectl logs exit-handler-bug-example-546893857 -c wait
time="2020-07-09T09:21:52.944Z" level=info msg="Starting Workflow Executor" version=v2.9.2
time="2020-07-09T09:21:52.946Z" level=info msg="Creating a docker executor"
time="2020-07-09T09:21:52.946Z" level=info msg="Executor (version: v2.9.2, build_date: 2020-07-08T23:57:25Z) initialized (pod: argo/exit-handler-bug-example-546893857) with template:\n{\"name\":\"sleep-10\",\"arguments\":{},\"inputs\":{},\"outputs\":{},\"metadata\":{},\"container\":{\"name\":\"\",\"image\":\"alpine:latest\",\"command\":[\"sh\",\"-c\"],\"args\":[\"sleep 10 \\u0026\\u0026 echo exit-handler-step-exit-handler-bug-example-546893857\"],\"resources\":{}}}"
time="2020-07-09T09:21:52.946Z" level=info msg="Waiting on main container"
time="2020-07-09T09:21:56.205Z" level=info msg="main container started with container ID: 1aef3223bc909a667c6532c013725730a99791128bbed8f4b716ded74c5ac6b0"
time="2020-07-09T09:21:56.205Z" level=info msg="Starting annotations monitor"
time="2020-07-09T09:21:56.208Z" level=info msg="docker wait 1aef3223bc909a667c6532c013725730a99791128bbed8f4b716ded74c5ac6b0"
time="2020-07-09T09:21:56.208Z" level=info msg="Starting deadline monitor"
time="2020-07-09T09:22:05.978Z" level=info msg="Main container completed"
time="2020-07-09T09:22:05.978Z" level=info msg="No Script output reference in workflow. Capturing script output ignored"
time="2020-07-09T09:22:05.978Z" level=info msg="Capturing script exit code"
time="2020-07-09T09:22:05.978Z" level=info msg="Annotations monitor stopped"
time="2020-07-09T09:22:06.000Z" level=info msg="No output parameters"
time="2020-07-09T09:22:06.000Z" level=info msg="No output artifacts"
time="2020-07-09T09:22:06.000Z" level=info msg="Annotating pod with output"
time="2020-07-09T09:22:06.003Z" level=info msg="Killing sidecars"
time="2020-07-09T09:22:06.009Z" level=info msg="Alloc=5839 TotalAlloc=15384 Sys=70592 NumGC=5 Goroutines=9"
  • workflow-controller logs:
kubectl logs -n argo $(kubectl get pods -l app=workflow-controller -n argo -o name)
time="2020-07-09T09:21:41Z" level=info msg="Processing workflow" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:21:41Z" level=info msg="Updated phase  -> Running" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:21:41Z" level=info msg="DAG node exit-handler-bug-example initialized Running" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:21:41Z" level=info msg="All of node exit-handler-bug-example.step-2 dependencies [] completed" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:21:41Z" level=info msg="Pod node exit-handler-bug-example-3054913383 initialized Pending" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:21:41Z" level=info msg="Created pod: exit-handler-bug-example.step-2 (exit-handler-bug-example-3054913383)" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:21:41Z" level=info msg="All of node exit-handler-bug-example.step-1 dependencies [] completed" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:21:41Z" level=info msg="Pod node exit-handler-bug-example-3071691002 initialized Pending" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:21:41Z" level=info msg="Created pod: exit-handler-bug-example.step-1 (exit-handler-bug-example-3071691002)" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:21:41Z" level=info msg="Workflow update successful" namespace=argo phase=Running resourceVersion=1464695 workflow=exit-handler-bug-example
time="2020-07-09T09:21:41Z" level=info msg="Processing workflow" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:21:41Z" level=info msg="Workflow update successful" namespace=argo phase=Running resourceVersion=1464700 workflow=exit-handler-bug-example
time="2020-07-09T09:21:41Z" level=info msg="Processing workflow" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:21:41Z" level=info msg="Updating node exit-handler-bug-example-3054913383 message: ContainerCreating"
time="2020-07-09T09:21:41Z" level=info msg="Workflow update successful" namespace=argo phase=Running resourceVersion=1464702 workflow=exit-handler-bug-example
time="2020-07-09T09:21:41Z" level=info msg="Processing workflow" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:21:41Z" level=info msg="Updating node exit-handler-bug-example-3071691002 message: ContainerCreating"
time="2020-07-09T09:21:41Z" level=info msg="Workflow update successful" namespace=argo phase=Running resourceVersion=1464703 workflow=exit-handler-bug-example
time="2020-07-09T09:21:41Z" level=info msg="Processing workflow" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:21:42Z" level=info msg="Processing workflow" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:21:45Z" level=info msg="Processing workflow" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:21:45Z" level=info msg="Updating node exit-handler-bug-example-3071691002 status Pending -> Running"
time="2020-07-09T09:21:45Z" level=info msg="Workflow update successful" namespace=argo phase=Running resourceVersion=1464724 workflow=exit-handler-bug-example
time="2020-07-09T09:21:45Z" level=info msg="Processing workflow" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:21:47Z" level=info msg="Processing workflow" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:21:47Z" level=info msg="Updating node exit-handler-bug-example-3054913383 status Pending -> Running"
time="2020-07-09T09:21:47Z" level=info msg="Workflow update successful" namespace=argo phase=Running resourceVersion=1464733 workflow=exit-handler-bug-example
time="2020-07-09T09:21:47Z" level=info msg="Processing workflow" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:21:51Z" level=info msg="Processing workflow" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:21:51Z" level=info msg="Setting node exit-handler-bug-example-3071691002 outputs"
time="2020-07-09T09:21:51Z" level=info msg="Updating node exit-handler-bug-example-3071691002 status Running -> Succeeded"
time="2020-07-09T09:21:51Z" level=info msg="Running OnExit handler: exit-handler" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:21:51Z" level=info msg="DAG node exit-handler-bug-example-1359570492 initialized Running" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:21:51Z" level=info msg="All of node step-1.onExit.exit-1 dependencies [] completed" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:21:51Z" level=info msg="Pod node exit-handler-bug-example-2218368392 initialized Pending" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:21:51Z" level=info msg="Created pod: step-1.onExit.exit-1 (exit-handler-bug-example-2218368392)" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:21:51Z" level=info msg="Workflow update successful" namespace=argo phase=Running resourceVersion=1464744 workflow=exit-handler-bug-example
time="2020-07-09T09:21:51Z" level=info msg="Processing workflow" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:21:51Z" level=info msg="Labeled pod argo/exit-handler-bug-example-3071691002 completed"
time="2020-07-09T09:21:51Z" level=info msg="Updating node exit-handler-bug-example-2218368392 message: ContainerCreating"
time="2020-07-09T09:21:51Z" level=info msg="Running OnExit handler: exit-handler" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:21:51Z" level=info msg="Workflow update successful" namespace=argo phase=Running resourceVersion=1464748 workflow=exit-handler-bug-example
time="2020-07-09T09:21:51Z" level=info msg="Processing workflow" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:21:51Z" level=info msg="Running OnExit handler: exit-handler" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:21:52Z" level=info msg="Processing workflow" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:21:52Z" level=info msg="Setting node exit-handler-bug-example-3054913383 outputs"
time="2020-07-09T09:21:52Z" level=info msg="Running OnExit handler: exit-handler" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:21:52Z" level=info msg="Workflow update successful" namespace=argo phase=Running resourceVersion=1464756 workflow=exit-handler-bug-example
time="2020-07-09T09:21:52Z" level=info msg="Processing workflow" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:21:52Z" level=info msg="Updating node exit-handler-bug-example-3054913383 status Running -> Succeeded"
time="2020-07-09T09:21:52Z" level=info msg="Running OnExit handler: exit-handler" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:21:52Z" level=info msg="DAG node exit-handler-bug-example-4086143951 initialized Running" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:21:52Z" level=info msg="All of node step-2.onExit.exit-1 dependencies [] completed" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:21:52Z" level=info msg="Pod node exit-handler-bug-example-546893857 initialized Pending" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:21:52Z" level=info msg="Created pod: step-2.onExit.exit-1 (exit-handler-bug-example-546893857)" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:21:52Z" level=info msg="All of node exit-handler-bug-example.step-3 dependencies [step-2] completed" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:21:52Z" level=info msg="Pod node exit-handler-bug-example-3038135764 initialized Pending" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:21:52Z" level=info msg="Created pod: exit-handler-bug-example.step-3 (exit-handler-bug-example-3038135764)" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:21:52Z" level=info msg="Running OnExit handler: exit-handler" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:21:52Z" level=info msg="Workflow update successful" namespace=argo phase=Running resourceVersion=1464763 workflow=exit-handler-bug-example
time="2020-07-09T09:21:52Z" level=info msg="Processing workflow" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:21:52Z" level=info msg="Labeled pod argo/exit-handler-bug-example-3054913383 completed"
time="2020-07-09T09:21:52Z" level=info msg="Updating node exit-handler-bug-example-546893857 message: ContainerCreating"
time="2020-07-09T09:21:52Z" level=info msg="Running OnExit handler: exit-handler" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:21:52Z" level=info msg="Running OnExit handler: exit-handler" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:21:52Z" level=info msg="Workflow update successful" namespace=argo phase=Running resourceVersion=1464768 workflow=exit-handler-bug-example
time="2020-07-09T09:21:52Z" level=info msg="Processing workflow" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:21:52Z" level=info msg="Updating node exit-handler-bug-example-3038135764 message: ContainerCreating"
time="2020-07-09T09:21:52Z" level=info msg="Running OnExit handler: exit-handler" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:21:52Z" level=info msg="Running OnExit handler: exit-handler" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:21:52Z" level=info msg="Workflow update successful" namespace=argo phase=Running resourceVersion=1464770 workflow=exit-handler-bug-example
time="2020-07-09T09:21:52Z" level=info msg="Processing workflow" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:21:52Z" level=info msg="Running OnExit handler: exit-handler" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:21:52Z" level=info msg="Running OnExit handler: exit-handler" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:21:53Z" level=info msg="Processing workflow" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:21:53Z" level=info msg="Running OnExit handler: exit-handler" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:21:53Z" level=info msg="Running OnExit handler: exit-handler" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:21:55Z" level=info msg="Processing workflow" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:21:55Z" level=info msg="Updating node exit-handler-bug-example-2218368392 status Pending -> Running"
time="2020-07-09T09:21:55Z" level=info msg="Running OnExit handler: exit-handler" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:21:55Z" level=info msg="Running OnExit handler: exit-handler" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:21:55Z" level=info msg="Workflow update successful" namespace=argo phase=Running resourceVersion=1464787 workflow=exit-handler-bug-example
time="2020-07-09T09:21:55Z" level=info msg="Processing workflow" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:21:55Z" level=info msg="Running OnExit handler: exit-handler" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:21:55Z" level=info msg="Running OnExit handler: exit-handler" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:21:57Z" level=info msg="Processing workflow" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:21:57Z" level=info msg="Updating node exit-handler-bug-example-546893857 status Pending -> Running"
time="2020-07-09T09:21:57Z" level=info msg="Running OnExit handler: exit-handler" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:21:57Z" level=info msg="Running OnExit handler: exit-handler" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:21:57Z" level=info msg="Workflow update successful" namespace=argo phase=Running resourceVersion=1464796 workflow=exit-handler-bug-example
time="2020-07-09T09:21:57Z" level=info msg="Processing workflow" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:21:57Z" level=info msg="Running OnExit handler: exit-handler" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:21:57Z" level=info msg="Running OnExit handler: exit-handler" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:21:59Z" level=info msg="Processing workflow" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:21:59Z" level=info msg="Updating node exit-handler-bug-example-3038135764 status Pending -> Running"
time="2020-07-09T09:21:59Z" level=info msg="Running OnExit handler: exit-handler" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:21:59Z" level=info msg="Running OnExit handler: exit-handler" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:21:59Z" level=info msg="Workflow update successful" namespace=argo phase=Running resourceVersion=1464805 workflow=exit-handler-bug-example
time="2020-07-09T09:21:59Z" level=info msg="Processing workflow" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:21:59Z" level=info msg="Running OnExit handler: exit-handler" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:21:59Z" level=info msg="Running OnExit handler: exit-handler" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:04Z" level=info msg="Processing workflow" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:04Z" level=info msg="Setting node exit-handler-bug-example-2218368392 outputs"
time="2020-07-09T09:22:04Z" level=info msg="Setting node exit-handler-bug-example-3038135764 outputs"
time="2020-07-09T09:22:04Z" level=info msg="Updating node exit-handler-bug-example-3038135764 status Running -> Succeeded"
time="2020-07-09T09:22:04Z" level=info msg="Running OnExit handler: exit-handler" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:04Z" level=info msg="Running OnExit handler: exit-handler" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:04Z" level=info msg="DAG node exit-handler-bug-example-2933386262 initialized Running" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:04Z" level=info msg="All of node step-3.onExit.exit-1 dependencies [] completed" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:04Z" level=info msg="Pod node exit-handler-bug-example-1275286746 initialized Pending" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:04Z" level=info msg="Created pod: step-3.onExit.exit-1 (exit-handler-bug-example-1275286746)" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:04Z" level=info msg="Workflow update successful" namespace=argo phase=Running resourceVersion=1464820 workflow=exit-handler-bug-example
time="2020-07-09T09:22:04Z" level=info msg="Processing workflow" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:04Z" level=info msg="Labeled pod argo/exit-handler-bug-example-3038135764 completed"
time="2020-07-09T09:22:04Z" level=info msg="Updating node exit-handler-bug-example-1275286746 message: ContainerCreating"
time="2020-07-09T09:22:04Z" level=info msg="Running OnExit handler: exit-handler" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:04Z" level=info msg="Running OnExit handler: exit-handler" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:04Z" level=info msg="Workflow update successful" namespace=argo phase=Running resourceVersion=1464825 workflow=exit-handler-bug-example
time="2020-07-09T09:22:04Z" level=info msg="Processing workflow" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:04Z" level=info msg="Updating node exit-handler-bug-example-2218368392 status Running -> Succeeded"
time="2020-07-09T09:22:04Z" level=info msg="Running OnExit handler: exit-handler" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:04Z" level=info msg="All of node step-1.onExit.exit-2 dependencies [exit-1] completed" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:04Z" level=info msg="Pod node exit-handler-bug-example-2268701249 initialized Pending" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:04Z" level=info msg="Created pod: step-1.onExit.exit-2 (exit-handler-bug-example-2268701249)" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:04Z" level=info msg="Running OnExit handler: exit-handler" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:04Z" level=info msg="Workflow update successful" namespace=argo phase=Running resourceVersion=1464830 workflow=exit-handler-bug-example
time="2020-07-09T09:22:04Z" level=info msg="Processing workflow" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:04Z" level=info msg="Labeled pod argo/exit-handler-bug-example-2218368392 completed"
time="2020-07-09T09:22:04Z" level=info msg="Updating node exit-handler-bug-example-2268701249 message: ContainerCreating"
time="2020-07-09T09:22:04Z" level=info msg="Running OnExit handler: exit-handler" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:04Z" level=info msg="Running OnExit handler: exit-handler" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:04Z" level=info msg="Workflow update successful" namespace=argo phase=Running resourceVersion=1464834 workflow=exit-handler-bug-example
time="2020-07-09T09:22:04Z" level=info msg="Processing workflow" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:04Z" level=info msg="Running OnExit handler: exit-handler" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:04Z" level=info msg="Running OnExit handler: exit-handler" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:05Z" level=info msg="Processing workflow" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:05Z" level=info msg="Running OnExit handler: exit-handler" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:05Z" level=info msg="Running OnExit handler: exit-handler" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:07Z" level=info msg="Processing workflow" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:07Z" level=info msg="Setting node exit-handler-bug-example-546893857 outputs"
time="2020-07-09T09:22:07Z" level=info msg="Updating node exit-handler-bug-example-546893857 status Running -> Succeeded"
time="2020-07-09T09:22:07Z" level=info msg="Running OnExit handler: exit-handler" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:07Z" level=info msg="Running OnExit handler: exit-handler" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:07Z" level=info msg="Workflow update successful" namespace=argo phase=Running resourceVersion=1464854 workflow=exit-handler-bug-example
time="2020-07-09T09:22:07Z" level=info msg="Processing workflow" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:07Z" level=info msg="Labeled pod argo/exit-handler-bug-example-546893857 completed"
time="2020-07-09T09:22:07Z" level=info msg="Running OnExit handler: exit-handler" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:07Z" level=info msg="Running OnExit handler: exit-handler" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:08Z" level=info msg="Processing workflow" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:08Z" level=info msg="Updating node exit-handler-bug-example-1275286746 status Pending -> Running"
time="2020-07-09T09:22:08Z" level=info msg="Running OnExit handler: exit-handler" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:08Z" level=info msg="Running OnExit handler: exit-handler" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:08Z" level=info msg="Workflow update successful" namespace=argo phase=Running resourceVersion=1464860 workflow=exit-handler-bug-example
time="2020-07-09T09:22:08Z" level=info msg="Processing workflow" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:08Z" level=info msg="Running OnExit handler: exit-handler" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:08Z" level=info msg="Running OnExit handler: exit-handler" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:10Z" level=info msg="Processing workflow" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:10Z" level=info msg="Updating node exit-handler-bug-example-2268701249 status Pending -> Running"
time="2020-07-09T09:22:10Z" level=info msg="Running OnExit handler: exit-handler" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:10Z" level=info msg="Running OnExit handler: exit-handler" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:10Z" level=info msg="Workflow update successful" namespace=argo phase=Running resourceVersion=1464869 workflow=exit-handler-bug-example
time="2020-07-09T09:22:10Z" level=info msg="Processing workflow" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:10Z" level=info msg="Running OnExit handler: exit-handler" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:10Z" level=info msg="Running OnExit handler: exit-handler" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:18Z" level=info msg="Processing workflow" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:18Z" level=info msg="Setting node exit-handler-bug-example-1275286746 outputs"
time="2020-07-09T09:22:18Z" level=info msg="Updating node exit-handler-bug-example-1275286746 status Running -> Succeeded"
time="2020-07-09T09:22:18Z" level=info msg="Running OnExit handler: exit-handler" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:18Z" level=info msg="Running OnExit handler: exit-handler" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:18Z" level=info msg="All of node step-3.onExit.exit-2 dependencies [exit-1] completed" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:18Z" level=info msg="Pod node exit-handler-bug-example-1258509127 initialized Pending" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:18Z" level=info msg="Created pod: step-3.onExit.exit-2 (exit-handler-bug-example-1258509127)" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:18Z" level=info msg="Workflow update successful" namespace=argo phase=Running resourceVersion=1464888 workflow=exit-handler-bug-example
time="2020-07-09T09:22:18Z" level=info msg="Processing workflow" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:18Z" level=info msg="Labeled pod argo/exit-handler-bug-example-1275286746 completed"
time="2020-07-09T09:22:18Z" level=info msg="Updating node exit-handler-bug-example-1258509127 message: ContainerCreating"
time="2020-07-09T09:22:18Z" level=info msg="Running OnExit handler: exit-handler" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:18Z" level=info msg="Running OnExit handler: exit-handler" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:18Z" level=info msg="Workflow update successful" namespace=argo phase=Running resourceVersion=1464892 workflow=exit-handler-bug-example
time="2020-07-09T09:22:18Z" level=info msg="Processing workflow" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:18Z" level=info msg="Running OnExit handler: exit-handler" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:18Z" level=info msg="Running OnExit handler: exit-handler" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:19Z" level=info msg="Processing workflow" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:19Z" level=info msg="Setting node exit-handler-bug-example-2268701249 outputs"
time="2020-07-09T09:22:19Z" level=info msg="Running OnExit handler: exit-handler" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:19Z" level=info msg="Running OnExit handler: exit-handler" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:19Z" level=info msg="Workflow update successful" namespace=argo phase=Running resourceVersion=1464900 workflow=exit-handler-bug-example
time="2020-07-09T09:22:19Z" level=info msg="Processing workflow" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:19Z" level=info msg="Running OnExit handler: exit-handler" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:19Z" level=info msg="Running OnExit handler: exit-handler" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:20Z" level=info msg="Processing workflow" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:20Z" level=info msg="Updating node exit-handler-bug-example-2268701249 status Running -> Succeeded"
time="2020-07-09T09:22:20Z" level=info msg="Running OnExit handler: exit-handler" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:20Z" level=info msg="All of node step-1.onExit.exit-3 dependencies [exit-2] completed" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:20Z" level=info msg="Pod node exit-handler-bug-example-2251923630 initialized Pending" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:20Z" level=info msg="Created pod: step-1.onExit.exit-3 (exit-handler-bug-example-2251923630)" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:20Z" level=info msg="Running OnExit handler: exit-handler" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:20Z" level=info msg="Workflow update successful" namespace=argo phase=Running resourceVersion=1464908 workflow=exit-handler-bug-example
time="2020-07-09T09:22:20Z" level=info msg="Processing workflow" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:20Z" level=info msg="Labeled pod argo/exit-handler-bug-example-2268701249 completed"
time="2020-07-09T09:22:20Z" level=info msg="Updating node exit-handler-bug-example-2251923630 message: ContainerCreating"
time="2020-07-09T09:22:20Z" level=info msg="Running OnExit handler: exit-handler" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:20Z" level=info msg="Running OnExit handler: exit-handler" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:20Z" level=info msg="Workflow update successful" namespace=argo phase=Running resourceVersion=1464912 workflow=exit-handler-bug-example
time="2020-07-09T09:22:20Z" level=info msg="Processing workflow" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:20Z" level=info msg="Running OnExit handler: exit-handler" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:20Z" level=info msg="Running OnExit handler: exit-handler" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:21Z" level=info msg="Processing workflow" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:21Z" level=info msg="Running OnExit handler: exit-handler" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:21Z" level=info msg="Running OnExit handler: exit-handler" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:22Z" level=info msg="Processing workflow" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:22Z" level=info msg="Updating node exit-handler-bug-example-1258509127 status Pending -> Running"
time="2020-07-09T09:22:22Z" level=info msg="Running OnExit handler: exit-handler" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:22Z" level=info msg="Running OnExit handler: exit-handler" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:22Z" level=info msg="Workflow update successful" namespace=argo phase=Running resourceVersion=1464924 workflow=exit-handler-bug-example
time="2020-07-09T09:22:22Z" level=info msg="Processing workflow" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:22Z" level=info msg="Running OnExit handler: exit-handler" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:22Z" level=info msg="Running OnExit handler: exit-handler" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:24Z" level=info msg="Processing workflow" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:24Z" level=info msg="Updating node exit-handler-bug-example-2251923630 status Pending -> Running"
time="2020-07-09T09:22:24Z" level=info msg="Running OnExit handler: exit-handler" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:24Z" level=info msg="Running OnExit handler: exit-handler" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:24Z" level=info msg="Workflow update successful" namespace=argo phase=Running resourceVersion=1464932 workflow=exit-handler-bug-example
time="2020-07-09T09:22:24Z" level=info msg="Processing workflow" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:24Z" level=info msg="Running OnExit handler: exit-handler" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:24Z" level=info msg="Running OnExit handler: exit-handler" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:33Z" level=info msg="Processing workflow" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:33Z" level=info msg="Setting node exit-handler-bug-example-1258509127 outputs"
time="2020-07-09T09:22:33Z" level=info msg="Updating node exit-handler-bug-example-1258509127 status Running -> Succeeded"
time="2020-07-09T09:22:33Z" level=info msg="Running OnExit handler: exit-handler" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:33Z" level=info msg="All of node step-3.onExit.exit-3 dependencies [exit-2] completed" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:33Z" level=info msg="Pod node exit-handler-bug-example-1241731508 initialized Pending" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:33Z" level=info msg="Created pod: step-3.onExit.exit-3 (exit-handler-bug-example-1241731508)" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:33Z" level=info msg="Running OnExit handler: exit-handler" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:33Z" level=info msg="Workflow update successful" namespace=argo phase=Running resourceVersion=1464952 workflow=exit-handler-bug-example
time="2020-07-09T09:22:33Z" level=info msg="Processing workflow" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:33Z" level=info msg="Updating node exit-handler-bug-example-1241731508 message: ContainerCreating"
time="2020-07-09T09:22:33Z" level=info msg="Labeled pod argo/exit-handler-bug-example-1258509127 completed"
time="2020-07-09T09:22:33Z" level=info msg="Running OnExit handler: exit-handler" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:33Z" level=info msg="Running OnExit handler: exit-handler" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:33Z" level=info msg="Workflow update successful" namespace=argo phase=Running resourceVersion=1464956 workflow=exit-handler-bug-example
time="2020-07-09T09:22:33Z" level=info msg="Processing workflow" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:33Z" level=info msg="Labeled pod argo/exit-handler-bug-example-1258509127 completed"
time="2020-07-09T09:22:33Z" level=info msg="Running OnExit handler: exit-handler" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:33Z" level=info msg="Running OnExit handler: exit-handler" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:34Z" level=info msg="Processing workflow" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:34Z" level=info msg="Setting node exit-handler-bug-example-2251923630 outputs"
time="2020-07-09T09:22:34Z" level=info msg="Running OnExit handler: exit-handler" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:34Z" level=info msg="Running OnExit handler: exit-handler" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:34Z" level=info msg="Workflow update successful" namespace=argo phase=Running resourceVersion=1464964 workflow=exit-handler-bug-example
time="2020-07-09T09:22:34Z" level=info msg="Processing workflow" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:34Z" level=info msg="Running OnExit handler: exit-handler" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:34Z" level=info msg="Running OnExit handler: exit-handler" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:35Z" level=info msg="Processing workflow" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:35Z" level=info msg="Updating node exit-handler-bug-example-2251923630 status Running -> Succeeded"
time="2020-07-09T09:22:35Z" level=info msg="Running OnExit handler: exit-handler" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:35Z" level=info msg="Outbound nodes of exit-handler-bug-example-1359570492 set to [exit-handler-bug-example-2251923630]" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:35Z" level=info msg="node exit-handler-bug-example-1359570492 phase Running -> Succeeded" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:35Z" level=info msg="node exit-handler-bug-example-1359570492 finished: 2020-07-09 09:22:35.222576651 +0000 UTC" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:35Z" level=info msg="Checking daemoned children of exit-handler-bug-example-1359570492" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:35Z" level=info msg="Running OnExit handler: exit-handler" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:35Z" level=info msg="Workflow update successful" namespace=argo phase=Running resourceVersion=1464968 workflow=exit-handler-bug-example
time="2020-07-09T09:22:35Z" level=info msg="Processing workflow" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:35Z" level=info msg="Labeled pod argo/exit-handler-bug-example-2251923630 completed"
time="2020-07-09T09:22:35Z" level=info msg="Running OnExit handler: exit-handler" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:35Z" level=info msg="Running OnExit handler: exit-handler" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:37Z" level=info msg="Processing workflow" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:37Z" level=info msg="Updating node exit-handler-bug-example-1241731508 status Pending -> Running"
time="2020-07-09T09:22:37Z" level=info msg="Running OnExit handler: exit-handler" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:37Z" level=info msg="Running OnExit handler: exit-handler" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:37Z" level=info msg="Workflow update successful" namespace=argo phase=Running resourceVersion=1464979 workflow=exit-handler-bug-example
time="2020-07-09T09:22:37Z" level=info msg="Processing workflow" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:37Z" level=info msg="Running OnExit handler: exit-handler" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:37Z" level=info msg="Running OnExit handler: exit-handler" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:47Z" level=info msg="Processing workflow" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:47Z" level=info msg="Setting node exit-handler-bug-example-1241731508 outputs"
time="2020-07-09T09:22:47Z" level=info msg="Updating node exit-handler-bug-example-1241731508 status Running -> Succeeded"
time="2020-07-09T09:22:47Z" level=info msg="Running OnExit handler: exit-handler" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:47Z" level=info msg="Running OnExit handler: exit-handler" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:47Z" level=info msg="Outbound nodes of exit-handler-bug-example-2933386262 set to [exit-handler-bug-example-1241731508]" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:47Z" level=info msg="node exit-handler-bug-example-2933386262 phase Running -> Succeeded" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:47Z" level=info msg="node exit-handler-bug-example-2933386262 finished: 2020-07-09 09:22:47.524393586 +0000 UTC" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:47Z" level=info msg="Checking daemoned children of exit-handler-bug-example-2933386262" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:47Z" level=info msg="Workflow update successful" namespace=argo phase=Running resourceVersion=1465000 workflow=exit-handler-bug-example
time="2020-07-09T09:22:47Z" level=info msg="Processing workflow" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:47Z" level=info msg="Labeled pod argo/exit-handler-bug-example-1241731508 completed"
time="2020-07-09T09:22:47Z" level=info msg="Running OnExit handler: exit-handler" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:22:47Z" level=info msg="Running OnExit handler: exit-handler" namespace=argo workflow=exit-handler-bug-example
time="2020-07-09T09:24:43Z" level=info msg="Alloc=8704 TotalAlloc=12710294 Sys=347424 NumGC=256 Goroutines=165"
time="2020-07-09T09:29:43Z" level=info msg="Alloc=6907 TotalAlloc=12710622 Sys=347424 NumGC=258 Goroutines=165"

Logs
see above

Message from the maintainers:

If you are impacted by this bug please add a 👍 reaction to this issue! We often sort issues this way to know what to prioritize.
@arbielsk arbielsk mentioned this issue Jul 9, 2020
Closed
4 tasks
@arbielsk arbielsk changed the title If non-leaf task onExit handler is defined as DAG only the first task is run If non-leaf-task onExit-handler is defined as DAG only the first task is run Jul 9, 2020
@simster7 simster7 self-assigned this Jul 9, 2020
@simster7 simster7 mentioned this issue Jul 9, 2020
Merged
@arbielsk
Copy link
Author

@simster7 Thank you very much for fixing these so quickly! I'd love to buy you a coffee if you allow me. If that's possible I'd appreciate some details via pm :)
Thanks again!

@simster7
Copy link
Member

@simster7 Thank you very much for fixing these so quickly! I'd love to buy you a coffee if you allow me. If that's possible I'd appreciate some details via pm :)
Thanks again!

Thanks! No worries at all, positive feedback like this is as encouraging as coffee :)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@simster7 simster7

Labels
type/bug
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

fix: Ensure task dependencies run after onExit handler is fulfilled simster7/argo
2 participants
@simster7 @arbielsk