Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

OCPBUGS-29012: DNM Debug Logging around hang #111

Closed
wants to merge 2 commits into from

Conversation

JoelSpeed
Copy link

Investigating a hang during load balancer update operations, seeing a 15m53s hang repeatedly through CI around the areas of code that I've added logging to. Doesn't happen all the time so need to try and isolate where the hang is by adding additional debug logging and hoping that it triggers

@openshift-ci openshift-ci bot requested review from elmiko and RadekManak March 1, 2024 09:34
Copy link

openshift-ci bot commented Mar 1, 2024

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by:
Once this PR has been reviewed and has the lgtm label, please ask for approval from joelspeed. For more information see the Kubernetes Code Review Process.

The full list of commands accepted by this bot can be found here.

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@JoelSpeed
Copy link
Author

/payload-aggregate periodic-ci-openshift-release-master-ci-4.16-upgrade-from-stable-4.15-e2e-azure-sdn-upgrade 10

Copy link

openshift-ci bot commented Mar 1, 2024

@JoelSpeed: trigger 1 job(s) for the /payload-(with-prs|job|aggregate|job-with-prs|aggregate-with-prs) command

  • periodic-ci-openshift-release-master-ci-4.16-upgrade-from-stable-4.15-e2e-azure-sdn-upgrade

See details on https://pr-payload-tests.ci.openshift.org/runs/ci/201e32d0-d7b0-11ee-9ce6-ba631dfa805d-0

@JoelSpeed JoelSpeed changed the title DNM Debug Logging around hang OCPBUGS-29012: DNM Debug Logging around hang Mar 1, 2024
@openshift-ci-robot openshift-ci-robot added jira/valid-reference Indicates that this PR references a valid Jira ticket of any type. jira/valid-bug Indicates that a referenced Jira bug is valid for the branch this PR is targeting. labels Mar 1, 2024
@openshift-ci-robot
Copy link

@JoelSpeed: This pull request references Jira Issue OCPBUGS-29012, which is valid. The bug has been moved to the POST state.

3 validation(s) were run on this bug
  • bug is open, matching expected state (open)
  • bug target version (4.16.0) matches configured target version for branch (4.16.0)
  • bug is in the state ASSIGNED, which is one of the valid states (NEW, ASSIGNED, POST)

Requesting review from QA contact:
/cc @sunzhaohua2

The bug has been updated to refer to the pull request using the external bug tracker.

In response to this:

Investigating a hang during load balancer update operations, seeing a 15m53s hang repeatedly through CI around the areas of code that I've added logging to. Doesn't happen all the time so need to try and isolate where the hang is by adding additional debug logging and hoping that it triggers

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

@openshift-ci openshift-ci bot requested a review from sunzhaohua2 March 1, 2024 10:24
@JoelSpeed
Copy link
Author

/payload-aggregate periodic-ci-openshift-release-master-ci-4.16-upgrade-from-stable-4.15-e2e-azure-sdn-upgrade 5

Copy link

openshift-ci bot commented Mar 1, 2024

@JoelSpeed: trigger 1 job(s) for the /payload-(with-prs|job|aggregate|job-with-prs|aggregate-with-prs) command

  • periodic-ci-openshift-release-master-ci-4.16-upgrade-from-stable-4.15-e2e-azure-sdn-upgrade

See details on https://pr-payload-tests.ci.openshift.org/runs/ci/0ae104c0-d7dc-11ee-89ce-567e8c589c5a-0

@JoelSpeed
Copy link
Author

/payload-aggregate periodic-ci-openshift-release-master-ci-4.16-upgrade-from-stable-4.15-e2e-azure-sdn-upgrade 10

Copy link

openshift-ci bot commented Mar 4, 2024

@JoelSpeed: trigger 1 job(s) for the /payload-(with-prs|job|aggregate|job-with-prs|aggregate-with-prs) command

  • periodic-ci-openshift-release-master-ci-4.16-upgrade-from-stable-4.15-e2e-azure-sdn-upgrade

See details on https://pr-payload-tests.ci.openshift.org/runs/ci/43488210-d9fe-11ee-8f66-202b5387c27a-0

@JoelSpeed
Copy link
Author

The failure mode did not present itself in the last round of upgrade jobs, hence kicking off again this morning to see if I can get the failure to present.

@openshift-merge-robot openshift-merge-robot added the needs-rebase Indicates a PR cannot be merged because it has merge conflicts with HEAD. label Mar 21, 2024
@openshift-merge-robot
Copy link

PR needs rebase.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

@JoelSpeed
Copy link
Author

/close

No longer needed for debugging

@openshift-ci openshift-ci bot closed this Apr 29, 2024
Copy link

openshift-ci bot commented Apr 29, 2024

@JoelSpeed: Closed this PR.

In response to this:

/close

No longer needed for debugging

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

@openshift-ci-robot
Copy link

@JoelSpeed: This pull request references Jira Issue OCPBUGS-29012. The bug has been updated to no longer refer to the pull request using the external bug tracker.

In response to this:

Investigating a hang during load balancer update operations, seeing a 15m53s hang repeatedly through CI around the areas of code that I've added logging to. Doesn't happen all the time so need to try and isolate where the hang is by adding additional debug logging and hoping that it triggers

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
jira/valid-bug Indicates that a referenced Jira bug is valid for the branch this PR is targeting. jira/valid-reference Indicates that this PR references a valid Jira ticket of any type. needs-rebase Indicates a PR cannot be merged because it has merge conflicts with HEAD.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants