Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Obtain nonexistent node with agent pod generating many error logs #12726

Open
4 tasks done
jswxstw opened this issue Mar 1, 2024 · 0 comments · May be fixed by #12732
Open
4 tasks done

Obtain nonexistent node with agent pod generating many error logs #12726

jswxstw opened this issue Mar 1, 2024 · 0 comments · May be fixed by #12732
Labels
area/agent Argo Agent that runs for HTTP and Plugin templates area/controller Controller issues, panics area/executor P3 Low priority type/bug

Comments

@jswxstw
Copy link
Member

jswxstw commented Mar 1, 2024

Pre-requisites

  • I have double-checked my configuration
  • I can confirm the issue exists when I tested with :latest
  • I have searched existing issues and could not find a match for this bug
  • I'd like to contribute the fix myself (see contributing guide)

What happened/what did you expect to happen?

woc.log.Errorf("was unable to obtain node for %s", nodeID)

HTTP/Plugin nodes are running in the agent pod and it is shared within the same workflow. Therefore, woc.nodeID(agentPod) will generate a nodeID that never exists.

Version

latest

Paste a small workflow that reproduces the issue. We must be able to run the workflow; don't enter a workflows that uses private images.

apiVersion: argoproj.io/v1alpha1
kind: Workflow
metadata:
  generateName: hello-
spec:
  entrypoint: main
  templates:
    - name: main
      plugin:
        hello: { }

Logs from the workflow controller

time="2023-12-08T10:34:07.212Z" level=error msg="was unable to obtain node for hello-7wwcp-2166136261" namespace=argo workflow=hello-7wwcp

Logs from in your workflow's wait container

kubectl logs -n argo -c wait -l workflows.argoproj.io/workflow=${workflow},workflow.argoproj.io/phase!=Succeeded
@agilgur5 agilgur5 added area/controller Controller issues, panics P3 Low priority labels Mar 1, 2024
jswxstw pushed a commit to jswxstw/argo-workflows that referenced this issue Mar 4, 2024
Signed-off-by: oninowang <oninowang@tencent.com>
jswxstw pushed a commit to jswxstw/argo-workflows that referenced this issue Mar 4, 2024
Signed-off-by: oninowang <oninowang@tencent.com>
jswxstw pushed a commit to jswxstw/argo-workflows that referenced this issue Mar 21, 2024
Signed-off-by: oninowang <oninowang@tencent.com>
@agilgur5 agilgur5 added area/executor area/agent Argo Agent that runs for HTTP and Plugin templates labels May 4, 2024
agilgur5 pushed a commit to jswxstw/argo-workflows that referenced this issue May 4, 2024
Signed-off-by: oninowang <oninowang@tencent.com>
jswxstw pushed a commit to jswxstw/argo-workflows that referenced this issue May 4, 2024
Signed-off-by: jswxstw <jswxstw@gmail.com>
jswxstw pushed a commit to jswxstw/argo-workflows that referenced this issue May 22, 2024
Signed-off-by: jswxstw <jswxstw@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/agent Argo Agent that runs for HTTP and Plugin templates area/controller Controller issues, panics area/executor P3 Low priority type/bug
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants