You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Retrying a workflow that uses a DAG and a withParam does not retry the failed task/step.
Screen.Recording.2022-01-23.at.11.57.48.PM.mov
A quick fix that seems to work is to set the retry limit to 0 but it causes other issues in the collected output.
retryStrategy:
limit: "0"
The output that is collected in the final step is duplicated and repeated based on the number of retries done.
From the recording, each output is repeated twice in the final array. I expect three outputs but I get six as it was retried twice.
Screen.Recording.2022-01-24.at.12.03.27.AM.mov
What version of Argo Workflows are you running?
3.2.4
Diagnostics
Either a workflow that reproduces the bug, or paste you whole workflow YAML, including status, something like:
apiVersion: argoproj.io/v1alpha1kind: WorkflowTemplatemetadata:
name: retry-barebonesspec:
entrypoint: maintemplates:
- name: maininputs:
parameters:
- name: numbers value: | ["one", "two", "three"]dag:
tasks:
- name: whalesay-before-processtemplate: whalesayarguments:
parameters:
- name: messagevalue: "HELLO ALL"
- name: processtemplate: processwithParam: "{{inputs.parameters.numbers}}"dependencies:
- whalesay-before-processarguments:
parameters:
- name: messagevalue: "{{item}}"
- name: whalesay-after-processtemplate: whalesaydependencies:
- processarguments:
parameters:
- name: messagevalue: "Root: {{tasks.process.outputs.parameters.output}}"# On retry there are extra values in the output, duplicated multiple times based on retry count
- name: process# this fixes the behaviourretryStrategy:
limit: "0"inputs:
parameters:
- name: messageoutputs:
parameters:
- name: outputvalueFrom:
parameter: "{{tasks.step2.outputs.parameters.output}}"dag:
tasks:
- name: step0template: whalesayarguments:
parameters:
- name: messagevalue: "{{inputs.parameters.message}}"
- name: step1template: whalesaydependencies:
- step0arguments:
parameters:
- name: messagevalue: "{{inputs.parameters.message}}"
- name: always-passvalue: "false"
- name: step2template: whalesaydependencies:
- step1arguments:
parameters:
- name: messagevalue: "{{tasks.step1.outputs.parameters.output}}"
- name: whalesayinputs:
parameters:
- name: message
- name: always-passvalue: "true"outputs:
parameters:
- name: outputvalueFrom:
path: /tmp/output.txtscript:
command: [ python ]image: python:alpineimagePullPolicy: IfNotPresentsource: | import random import os msg = '{{inputs.parameters.message}}' print(msg) if '{{inputs.parameters.always-pass}}' == 'true': a = -1 else: a = random.randint(1,10) if a > 0 and a <= 5: raise Exception(msg) with open('/tmp/output.txt', 'w') as o: o.write('random' + msg + ' : ' +str(a))
What Kubernetes provider are you using?
What executor are you running? Docker/K8SAPI/Kubelet/PNS/Emissary
Emissary
# Logs from the workflow controller:
kubectl logs -n argo deploy/workflow-controller | grep ${workflow}# If the workflow's pods have not been created, you can skip the rest of the diagnostics.# The workflow's pods that are problematic:
kubectl get pod -o yaml -l workflows.argoproj.io/workflow=${workflow},workflow.argoproj.io/phase!=Succeeded
# Logs from in your workflow's wait container, something like:
kubectl logs -c wait -l workflows.argoproj.io/workflow=${workflow},workflow.argoproj.io/phase!=Succeeded
Message from the maintainers:
Impacted by this bug? Give it a 👍. We prioritise the issues with the most 👍.
The text was updated successfully, but these errors were encountered:
Summary
What happened/what you expected to happen?
Retrying a workflow that uses a DAG and a withParam does not retry the failed task/step.
Screen.Recording.2022-01-23.at.11.57.48.PM.mov
A quick fix that seems to work is to set the retry limit to 0 but it causes other issues in the collected output.
The output that is collected in the final step is duplicated and repeated based on the number of retries done.
From the recording, each output is repeated twice in the final array. I expect three outputs but I get six as it was retried twice.
Screen.Recording.2022-01-24.at.12.03.27.AM.mov
What version of Argo Workflows are you running?
3.2.4
Diagnostics
Either a workflow that reproduces the bug, or paste you whole workflow YAML, including status, something like:
What Kubernetes provider are you using?
What executor are you running? Docker/K8SAPI/Kubelet/PNS/Emissary
Emissary
Message from the maintainers:
Impacted by this bug? Give it a 👍. We prioritise the issues with the most 👍.
The text was updated successfully, but these errors were encountered: