Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

OCPBUGS-29614: update skipUnlessMachineAPIOperator function #28625

Merged
merged 1 commit into from Mar 11, 2024

Conversation

elmiko
Copy link
Contributor

@elmiko elmiko commented Feb 27, 2024

This change updates the check for the machine api operator to inspect the number of machines that might be returned. If zero machines are returned it indicates that the cluster has the CRD but contains no instances, in these cases we want to skip the test.

This change updates the check for the machine api operator to inspect
the number of machines that might be returned. If zero machines are
returned it indicates that the cluster has the CRD but contains no
instances, in these cases we want to skip the test.
@openshift-ci-robot openshift-ci-robot added the jira/valid-reference Indicates that this PR references a valid Jira ticket of any type. label Feb 27, 2024
@openshift-ci-robot
Copy link

@elmiko: This pull request references Jira Issue OCPBUGS-29614, which is invalid:

  • expected the bug to be in one of the following states: NEW, ASSIGNED, POST, but it is ON_QA instead

Comment /jira refresh to re-evaluate validity if changes to the Jira bug are made, or edit the title of this pull request to link to a different bug.

The bug has been updated to refer to the pull request using the external bug tracker.

In response to this:

This change updates the check for the machine api operator to inspect the number of machines that might be returned. If zero machines are returned it indicates that the cluster has the CRD but contains no instances, in these cases we want to skip the test.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

@openshift-ci-robot openshift-ci-robot added the jira/invalid-bug Indicates that a referenced Jira bug is invalid for the branch this PR is targeting. label Feb 27, 2024
@elmiko
Copy link
Contributor Author

elmiko commented Feb 27, 2024

cc @JoelSpeed ptal

@elmiko
Copy link
Contributor Author

elmiko commented Feb 27, 2024

/jira refresh

@openshift-ci-robot openshift-ci-robot added jira/valid-bug Indicates that a referenced Jira bug is valid for the branch this PR is targeting. and removed jira/invalid-bug Indicates that a referenced Jira bug is invalid for the branch this PR is targeting. labels Feb 27, 2024
@openshift-ci-robot
Copy link

@elmiko: This pull request references Jira Issue OCPBUGS-29614, which is valid.

3 validation(s) were run on this bug
  • bug is open, matching expected state (open)
  • bug target version (4.16.0) matches configured target version for branch (4.16.0)
  • bug is in the state POST, which is one of the valid states (NEW, ASSIGNED, POST)

Requesting review from QA contact:
/cc @huali9

In response to this:

/jira refresh

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

Copy link
Contributor

@JoelSpeed JoelSpeed left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

What is the impact of this on the have machine resources [apigroup:machine.openshift.io] test. Why is that test successfully skipped in UPI but not the CPMS test?

@elmiko can you run a pre merge payload job test on the specific cases that we had the bug reported against, I'd like to see the output from these two tests specifically

@elmiko
Copy link
Contributor Author

elmiko commented Feb 28, 2024

/pj-rehearse help

@elmiko
Copy link
Contributor Author

elmiko commented Feb 28, 2024

/payload help

Copy link
Contributor

openshift-ci bot commented Feb 28, 2024

@elmiko: it appears that you have attempted to use some version of the payload command, but your comment was incorrectly formatted and cannot be acted upon. See the docs for usage info.

@elmiko
Copy link
Contributor Author

elmiko commented Feb 28, 2024

/payload-job periodic-ci-openshift-release-master-nightly-4.16-e2e-aws-ovn-upi

Copy link
Contributor

openshift-ci bot commented Feb 28, 2024

@elmiko: trigger 1 job(s) for the /payload-(with-prs|job|aggregate|job-with-prs|aggregate-with-prs) command

  • periodic-ci-openshift-release-master-nightly-4.16-e2e-aws-ovn-upi

See details on https://pr-payload-tests.ci.openshift.org/runs/ci/1c8c7550-d657-11ee-9894-c889fffe55dd-0

@elmiko
Copy link
Contributor Author

elmiko commented Feb 28, 2024

@JoelSpeed it seems like there were no logs created from that run, or am i missing something?

@elmiko
Copy link
Contributor Author

elmiko commented Mar 1, 2024

/payload-job periodic-ci-openshift-release-master-nightly-4.16-e2e-aws-ovn-upi

Copy link
Contributor

openshift-ci bot commented Mar 1, 2024

@elmiko: trigger 1 job(s) for the /payload-(with-prs|job|aggregate|job-with-prs|aggregate-with-prs) command

  • periodic-ci-openshift-release-master-nightly-4.16-e2e-aws-ovn-upi

See details on https://pr-payload-tests.ci.openshift.org/runs/ci/4533f100-d7d2-11ee-8b6e-1dacea8a49be-0

@elmiko
Copy link
Contributor Author

elmiko commented Mar 1, 2024

in the latest test run i can see that the test we want is being skipped, but we might also be skipping other tests from the suite.

@elmiko
Copy link
Contributor Author

elmiko commented Mar 1, 2024

@JoelSpeed i think we need to understand more about how these tests are run because now i see it skipping several tests:

image

@elmiko
Copy link
Contributor Author

elmiko commented Mar 1, 2024

rethinking a little, perhaps this is what we want to be seeing on a upi cluster?

@elmiko
Copy link
Contributor Author

elmiko commented Mar 1, 2024

/payload-job periodic-ci-openshift-release-master-nightly-4.16-e2e-aws-ovn-serial

i want to see if this runs properly on an ipi install

Copy link
Contributor

openshift-ci bot commented Mar 1, 2024

@elmiko: trigger 1 job(s) for the /payload-(with-prs|job|aggregate|job-with-prs|aggregate-with-prs) command

  • periodic-ci-openshift-release-master-nightly-4.16-e2e-aws-ovn-serial

See details on https://pr-payload-tests.ci.openshift.org/runs/ci/7f1f2d10-d810-11ee-98c2-958a47dcb860-0

@elmiko
Copy link
Contributor Author

elmiko commented Mar 3, 2024

it looks like the tests did run on that cluster, i think this fix is working like we want. @stbenjam could you confirm?

@stbenjam
Copy link
Member

stbenjam commented Mar 4, 2024

/lgtm
/hold

@openshift-ci openshift-ci bot added the do-not-merge/hold Indicates that a PR should not merge because someone has issued a /hold command. label Mar 4, 2024
@openshift-ci openshift-ci bot added the lgtm Indicates that a PR is ready to be merged. label Mar 4, 2024
Copy link
Contributor

openshift-ci bot commented Mar 4, 2024

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: elmiko, stbenjam

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@openshift-ci openshift-ci bot added the approved Indicates a PR has been approved by an approver from all required OWNERS files. label Mar 4, 2024
@elmiko
Copy link
Contributor Author

elmiko commented Mar 4, 2024

it seems like the test failures are part of the teardown, the actual test run looked fine. i think we should merge this.

/hold cancel

@openshift-ci openshift-ci bot removed the do-not-merge/hold Indicates that a PR should not merge because someone has issued a /hold command. label Mar 4, 2024
@openshift-ci-robot
Copy link

/retest-required

Remaining retests: 0 against base HEAD e66eced and 2 for PR HEAD a9ab8be in total

@elmiko
Copy link
Contributor Author

elmiko commented Mar 5, 2024

@stbenjam looking at the test outputs, it seems like the CPMS tests are being run in the proper places and are being skipped in upi configurations.

the current failures seem unrelated.

@stbenjam
Copy link
Member

stbenjam commented Mar 5, 2024

It doesn't look like the AWS UPI job got to the point of running the tests, was there another one I missed?

/test e2e-aws-ovn-upi

@elmiko
Copy link
Contributor Author

elmiko commented Mar 5, 2024

was there another one I missed?

i saw one yesterday that was skipping appropriately, let me see if i can find it

@elmiko
Copy link
Contributor Author

elmiko commented Mar 5, 2024

the passed and skipped tests in this seem to show it doing what we want, https://prow.ci.openshift.org/view/gs/test-platform-results/pr-logs/pull/28617/pull-ci-openshift-origin-master-e2e-aws-ovn-upi/1763600923436781568

oops, wrong pr, that's your's lol

@elmiko
Copy link
Contributor Author

elmiko commented Mar 5, 2024

i know i saw the skip message i put into this PR in one of the upi test runs, i thought it was the one you manually triggered but i can't find it now. also, it seems like there is some other problem preventing that from running properly now.

/test e2e-aws-ovn-upi

@openshift-ci-robot
Copy link

/retest-required

Remaining retests: 0 against base HEAD ba887b4 and 1 for PR HEAD a9ab8be in total

@openshift-ci-robot
Copy link

/retest-required

Remaining retests: 0 against base HEAD 5e3d98e and 0 for PR HEAD a9ab8be in total

@stbenjam
Copy link
Member

stbenjam commented Mar 6, 2024

Looks good now

@openshift-ci-robot
Copy link

/hold

Revision a9ab8be was retested 3 times: holding

@openshift-ci openshift-ci bot added the do-not-merge/hold Indicates that a PR should not merge because someone has issued a /hold command. label Mar 6, 2024
@elmiko
Copy link
Contributor Author

elmiko commented Mar 7, 2024

i think we might need to manually override some of the tests

/retest

@stbenjam
Copy link
Member

stbenjam commented Mar 7, 2024

/hold cancel
/skip

@openshift-ci openshift-ci bot removed the do-not-merge/hold Indicates that a PR should not merge because someone has issued a /hold command. label Mar 7, 2024
@stbenjam
Copy link
Member

stbenjam commented Mar 7, 2024

/override ci/prow/e2e-gcp-ovn-upgrade

Unrelated failure.

Copy link
Contributor

openshift-ci bot commented Mar 7, 2024

@stbenjam: Overrode contexts on behalf of stbenjam: ci/prow/e2e-gcp-ovn-upgrade

In response to this:

/override ci/prow/e2e-gcp-ovn-upgrade

Unrelated failure.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

@openshift-ci-robot
Copy link

/retest-required

Remaining retests: 0 against base HEAD 0708aaa and 2 for PR HEAD a9ab8be in total

Copy link
Contributor

openshift-ci bot commented Mar 7, 2024

@elmiko: The following tests failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name Commit Details Required Rerun command
ci/prow/e2e-aws-ovn-single-node-serial a9ab8be link false /test e2e-aws-ovn-single-node-serial
ci/prow/e2e-aws-ovn-single-node-upgrade a9ab8be link false /test e2e-aws-ovn-single-node-upgrade

Full PR test history. Your PR dashboard.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

@openshift-trt-bot
Copy link

Job Failure Risk Analysis for sha: a9ab8be

Job Name Failure Risk
pull-ci-openshift-origin-master-e2e-gcp-ovn IncompleteTests
Tests for this run (22) are below the historical average (1758): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)

1 similar comment
@openshift-trt-bot
Copy link

Job Failure Risk Analysis for sha: a9ab8be

Job Name Failure Risk
pull-ci-openshift-origin-master-e2e-gcp-ovn IncompleteTests
Tests for this run (22) are below the historical average (1758): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)

@stbenjam
Copy link
Member

/override ci/prow/e2e-gcp-ovn
/skip

Unrelated

Copy link
Contributor

openshift-ci bot commented Mar 11, 2024

@stbenjam: Overrode contexts on behalf of stbenjam: ci/prow/e2e-gcp-ovn

In response to this:

/override ci/prow/e2e-gcp-ovn
/skip

Unrelated

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

@openshift-merge-bot openshift-merge-bot bot merged commit 3bf7a4a into openshift:master Mar 11, 2024
23 checks passed
@openshift-ci-robot
Copy link

@elmiko: Jira Issue OCPBUGS-29614: Some pull requests linked via external trackers have merged:

The following pull requests linked via external trackers have not merged:

These pull request must merge or be unlinked from the Jira bug in order for it to move to the next state. Once unlinked, request a bug refresh with /jira refresh.

Jira Issue OCPBUGS-29614 has not been moved to the MODIFIED state.

In response to this:

This change updates the check for the machine api operator to inspect the number of machines that might be returned. If zero machines are returned it indicates that the cluster has the CRD but contains no instances, in these cases we want to skip the test.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

@openshift-bot
Copy link
Contributor

[ART PR BUILD NOTIFIER]

This PR has been included in build openshift-enterprise-tests-container-v4.16.0-202403111814.p0.g3bf7a4a.assembly.stream.el8 for distgit openshift-enterprise-tests.
All builds following this will include this PR.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved Indicates a PR has been approved by an approver from all required OWNERS files. jira/valid-bug Indicates that a referenced Jira bug is valid for the branch this PR is targeting. jira/valid-reference Indicates that this PR references a valid Jira ticket of any type. lgtm Indicates that a PR is ready to be merged.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

6 participants