Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

OCPBUGS-29858: Only extract node role from properly formatted node-role label #28585

Merged
merged 1 commit into from Feb 26, 2024

Conversation

stbenjam
Copy link
Member

@stbenjam stbenjam commented Feb 9, 2024

The convention is a format like node-role.kubernetes.io/role: "", not node-role.kubernetes.io: role, however ROSA uses the latter format to indicate the infra role. This changes the node watch code to ignore it, as well as other potential variations like node-role.kubernetes.io/.

The current code panics when run against a ROSA cluster:

  E0209 18:10:55.533265      78 runtime.go:79] Observed a panic: runtime.boundsError{x:24, y:23, signed:true, code:0x3} (runtime error: slice bounds out of range [24:23])
  goroutine 233 [running]:
  k8s.io/apimachinery/pkg/util/runtime.logPanic({0x7a71840?, 0xc0018e2f48})
  	k8s.io/apimachinery@v0.27.2/pkg/util/runtime/runtime.go:75 +0x99
  k8s.io/apimachinery/pkg/util/runtime.HandleCrash({0x0, 0x0, 0x1000251f9fe?})
  	k8s.io/apimachinery@v0.27.2/pkg/util/runtime/runtime.go:49 +0x75
  panic({0x7a71840, 0xc0018e2f48})
  	runtime/panic.go:884 +0x213
  github.com/openshift/origin/pkg/monitortests/node/watchnodes.nodeRoles(0x7ecd7b3?)
  	github.com/openshift/origin/pkg/monitortests/node/watchnodes/node.go:187 +0x1e5
  github.com/openshift/origin/pkg/monitortests/node/watchnodes.startNodeMonitoring.func1(0

The convention is a format like `node-role.kubernetes.io/role: ""`, not
`node-role.kubernetes.io: role`, however ROSA uses the latter format to
indicate the `infra` role. This changes the node watch code to ignore
it.

The current code panics when run against a ROSA cluster:

```
  E0209 18:10:55.533265      78 runtime.go:79] Observed a panic: runtime.boundsError{x:24, y:23, signed:true, code:0x3} (runtime error: slice bounds out of range [24:23])
  goroutine 233 [running]:
  k8s.io/apimachinery/pkg/util/runtime.logPanic({0x7a71840?, 0xc0018e2f48})
  	k8s.io/apimachinery@v0.27.2/pkg/util/runtime/runtime.go:75 +0x99
  k8s.io/apimachinery/pkg/util/runtime.HandleCrash({0x0, 0x0, 0x1000251f9fe?})
  	k8s.io/apimachinery@v0.27.2/pkg/util/runtime/runtime.go:49 +0x75
  panic({0x7a71840, 0xc0018e2f48})
  	runtime/panic.go:884 +0x213
  github.com/openshift/origin/pkg/monitortests/node/watchnodes.nodeRoles(0x7ecd7b3?)
  	github.com/openshift/origin/pkg/monitortests/node/watchnodes/node.go:187 +0x1e5
  github.com/openshift/origin/pkg/monitortests/node/watchnodes.startNodeMonitoring.func1(0
```
@stbenjam
Copy link
Member Author

stbenjam commented Feb 9, 2024

/hold

@openshift-ci openshift-ci bot added the do-not-merge/hold Indicates that a PR should not merge because someone has issued a /hold command. label Feb 9, 2024
@openshift-ci openshift-ci bot added the approved Indicates a PR has been approved by an approver from all required OWNERS files. label Feb 9, 2024
@dgoodwin
Copy link
Contributor

/lgtm

Unhold when ready.

@openshift-ci openshift-ci bot added the lgtm Indicates that a PR is ready to be merged. label Feb 13, 2024
Copy link
Contributor

openshift-ci bot commented Feb 13, 2024

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: dgoodwin, stbenjam

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@ritmun
Copy link

ritmun commented Feb 13, 2024

/retest

@stbenjam
Copy link
Member Author

/hold cancel

@openshift-ci openshift-ci bot removed the do-not-merge/hold Indicates that a PR should not merge because someone has issued a /hold command. label Feb 13, 2024
@stbenjam
Copy link
Member Author

/retest-required

@stbenjam
Copy link
Member Author

stbenjam commented Feb 19, 2024

/hold

Have to get bugs lined up so I can cherry-pick this back to where folks are testing ROSA

@openshift-ci openshift-ci bot added the do-not-merge/hold Indicates that a PR should not merge because someone has issued a /hold command. label Feb 19, 2024
@stbenjam stbenjam changed the title Only extract node role from properly formatted node-role label OCPBUGS-29858: Only extract node role from properly formatted node-role label Feb 22, 2024
@openshift-ci-robot openshift-ci-robot added jira/valid-reference Indicates that this PR references a valid Jira ticket of any type. jira/invalid-bug Indicates that a referenced Jira bug is invalid for the branch this PR is targeting. labels Feb 22, 2024
@openshift-ci-robot
Copy link

@stbenjam: This pull request references Jira Issue OCPBUGS-29858, which is invalid:

  • expected the bug to target the "4.16.0" version, but no target version was set

Comment /jira refresh to re-evaluate validity if changes to the Jira bug are made, or edit the title of this pull request to link to a different bug.

The bug has been updated to refer to the pull request using the external bug tracker.

In response to this:

The convention is a format like node-role.kubernetes.io/role: "", not node-role.kubernetes.io: role, however ROSA uses the latter format to indicate the infra role. This changes the node watch code to ignore it, as well as other potential variations like node-role.kubernetes.io/.

The current code panics when run against a ROSA cluster:

 E0209 18:10:55.533265      78 runtime.go:79] Observed a panic: runtime.boundsError{x:24, y:23, signed:true, code:0x3} (runtime error: slice bounds out of range [24:23])
 goroutine 233 [running]:
 k8s.io/apimachinery/pkg/util/runtime.logPanic({0x7a71840?, 0xc0018e2f48})
 	k8s.io/apimachinery@v0.27.2/pkg/util/runtime/runtime.go:75 +0x99
 k8s.io/apimachinery/pkg/util/runtime.HandleCrash({0x0, 0x0, 0x1000251f9fe?})
 	k8s.io/apimachinery@v0.27.2/pkg/util/runtime/runtime.go:49 +0x75
 panic({0x7a71840, 0xc0018e2f48})
 	runtime/panic.go:884 +0x213
 github.com/openshift/origin/pkg/monitortests/node/watchnodes.nodeRoles(0x7ecd7b3?)
 	github.com/openshift/origin/pkg/monitortests/node/watchnodes/node.go:187 +0x1e5
 github.com/openshift/origin/pkg/monitortests/node/watchnodes.startNodeMonitoring.func1(0

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

@stbenjam
Copy link
Member Author

/hold cancel
/retest-required
/cherry-pick release-4.15

@openshift-cherrypick-robot

@stbenjam: once the present PR merges, I will cherry-pick it on top of release-4.15 in a new PR and assign it to you.

In response to this:

/hold cancel
/retest-required
/cherry-pick release-4.15

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

@openshift-ci openshift-ci bot removed the do-not-merge/hold Indicates that a PR should not merge because someone has issued a /hold command. label Feb 22, 2024
@stbenjam
Copy link
Member Author

/cherry-pick release-4.14

@openshift-cherrypick-robot

@stbenjam: once the present PR merges, I will cherry-pick it on top of release-4.14 in a new PR and assign it to you.

In response to this:

/cherry-pick release-4.14

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

@stbenjam
Copy link
Member Author

/jira refresh

@openshift-ci-robot
Copy link

@stbenjam: This pull request references Jira Issue OCPBUGS-29858, which is invalid:

  • expected the bug to target only the "4.16.0" version, but multiple target versions were set

Comment /jira refresh to re-evaluate validity if changes to the Jira bug are made, or edit the title of this pull request to link to a different bug.

In response to this:

/jira refresh

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

@stbenjam
Copy link
Member Author

/jira refresh

@openshift-ci-robot openshift-ci-robot added jira/valid-bug Indicates that a referenced Jira bug is valid for the branch this PR is targeting. and removed jira/invalid-bug Indicates that a referenced Jira bug is invalid for the branch this PR is targeting. labels Feb 22, 2024
@openshift-ci-robot
Copy link

@stbenjam: This pull request references Jira Issue OCPBUGS-29858, which is valid. The bug has been moved to the POST state.

3 validation(s) were run on this bug
  • bug is open, matching expected state (open)
  • bug target version (4.16.0) matches configured target version for branch (4.16.0)
  • bug is in the state New, which is one of the valid states (NEW, ASSIGNED, POST)

In response to this:

/jira refresh

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

@openshift-ci-robot
Copy link

/retest-required

Remaining retests: 0 against base HEAD 93d6a84 and 2 for PR HEAD 7fd01a1 in total

@openshift-ci-robot
Copy link

/retest-required

Remaining retests: 0 against base HEAD 9c9713e and 1 for PR HEAD 7fd01a1 in total

@openshift-ci-robot
Copy link

/retest-required

Remaining retests: 0 against base HEAD 96d2578 and 0 for PR HEAD 7fd01a1 in total

@openshift-ci-robot
Copy link

/hold

Revision 7fd01a1 was retested 3 times: holding

@openshift-ci openshift-ci bot added the do-not-merge/hold Indicates that a PR should not merge because someone has issued a /hold command. label Feb 23, 2024
@stbenjam
Copy link
Member Author

/hold cancel
/retest-required

@openshift-ci openshift-ci bot removed the do-not-merge/hold Indicates that a PR should not merge because someone has issued a /hold command. label Feb 26, 2024
Copy link
Contributor

openshift-ci bot commented Feb 26, 2024

@stbenjam: The following tests failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name Commit Details Required Rerun command
ci/prow/e2e-aws-ovn-single-node-serial 7fd01a1 link false /test e2e-aws-ovn-single-node-serial
ci/prow/e2e-aws-ovn-single-node 7fd01a1 link false /test e2e-aws-ovn-single-node
ci/prow/e2e-aws-ovn-single-node-upgrade 7fd01a1 link false /test e2e-aws-ovn-single-node-upgrade

Full PR test history. Your PR dashboard.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

@openshift-ci-robot
Copy link

/retest-required

Remaining retests: 0 against base HEAD 96d2578 and 2 for PR HEAD 7fd01a1 in total

@stbenjam
Copy link
Member Author

/override ci/prow/e2e-aws-ovn-serial

@stbenjam
Copy link
Member Author

/skip

Copy link
Contributor

openshift-ci bot commented Feb 26, 2024

@stbenjam: Overrode contexts on behalf of stbenjam: ci/prow/e2e-aws-ovn-serial

In response to this:

/override ci/prow/e2e-aws-ovn-serial

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

@openshift-merge-bot openshift-merge-bot bot merged commit 330feda into openshift:master Feb 26, 2024
22 checks passed
@openshift-ci-robot
Copy link

@stbenjam: Jira Issue OCPBUGS-29858: All pull requests linked via external trackers have merged:

Jira Issue OCPBUGS-29858 has been moved to the MODIFIED state.

In response to this:

The convention is a format like node-role.kubernetes.io/role: "", not node-role.kubernetes.io: role, however ROSA uses the latter format to indicate the infra role. This changes the node watch code to ignore it, as well as other potential variations like node-role.kubernetes.io/.

The current code panics when run against a ROSA cluster:

 E0209 18:10:55.533265      78 runtime.go:79] Observed a panic: runtime.boundsError{x:24, y:23, signed:true, code:0x3} (runtime error: slice bounds out of range [24:23])
 goroutine 233 [running]:
 k8s.io/apimachinery/pkg/util/runtime.logPanic({0x7a71840?, 0xc0018e2f48})
 	k8s.io/apimachinery@v0.27.2/pkg/util/runtime/runtime.go:75 +0x99
 k8s.io/apimachinery/pkg/util/runtime.HandleCrash({0x0, 0x0, 0x1000251f9fe?})
 	k8s.io/apimachinery@v0.27.2/pkg/util/runtime/runtime.go:49 +0x75
 panic({0x7a71840, 0xc0018e2f48})
 	runtime/panic.go:884 +0x213
 github.com/openshift/origin/pkg/monitortests/node/watchnodes.nodeRoles(0x7ecd7b3?)
 	github.com/openshift/origin/pkg/monitortests/node/watchnodes/node.go:187 +0x1e5
 github.com/openshift/origin/pkg/monitortests/node/watchnodes.startNodeMonitoring.func1(0

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

@openshift-cherrypick-robot

@stbenjam: new pull request created: #28615

In response to this:

/hold cancel
/retest-required
/cherry-pick release-4.15

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

@openshift-cherrypick-robot

@stbenjam: new pull request created: #28616

In response to this:

/cherry-pick release-4.14

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

@openshift-bot
Copy link
Contributor

[ART PR BUILD NOTIFIER]

This PR has been included in build openshift-enterprise-tests-container-v4.16.0-202402261639.p0.g330feda.assembly.stream.el8 for distgit openshift-enterprise-tests.
All builds following this will include this PR.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved Indicates a PR has been approved by an approver from all required OWNERS files. jira/valid-bug Indicates that a referenced Jira bug is valid for the branch this PR is targeting. jira/valid-reference Indicates that this PR references a valid Jira ticket of any type. lgtm Indicates that a PR is ready to be merged.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

6 participants