Skip to content

NO-ISSUE: check mosb failed message in test 85980 - #6500

Merged
openshift-merge-bot[bot] merged 1 commit into
openshift:mainfrom
sergiordlr:check_mosb_failed_message
Sep 4, 2026
Merged

NO-ISSUE: check mosb failed message in test 85980#6500
openshift-merge-bot[bot] merged 1 commit into
openshift:mainfrom
sergiordlr:check_mosb_failed_message

Conversation

@sergiordlr

@sergiordlr sergiordlr commented Sep 4, 2026

Copy link
Copy Markdown
Contributor

- What I did

Check MOSB Failed message in test case 85980

After https://redhat.atlassian.net/browse/OCPBUGS-112465 when a MOSB fails it reports the failure message in the Failed condition.

- How to verify it

Test 85980 checks the failed message and passes

Summary by CodeRabbit

  • Tests
    • Expanded coverage for machine operating system build failures.
    • Tests now verify that a failed build reports a clear failure message when the retry limit is reached.
    • Added a time-bound check to confirm the expected failure status is surfaced promptly.

@openshift-merge-bot

Copy link
Copy Markdown
Contributor

Pipeline controller notification
This repo is configured to use the pipeline controller. Second-stage tests will be triggered either automatically or after lgtm label is added, depending on the repository configuration. The pipeline controller will automatically detect which contexts are required and will utilize /test Prow commands to trigger the second stage.

For optional jobs, comment /test ? to see a list of all defined jobs. To trigger manually all jobs from second stage use /pipeline required command.

This repository is configured in: LGTM mode

@openshift-ci-robot openshift-ci-robot added the jira/valid-reference Indicates that this PR references a valid Jira ticket of any type. label Sep 4, 2026
@openshift-ci-robot

Copy link
Copy Markdown
Contributor

@sergiordlr: This pull request explicitly references no jira issue.

Details

In response to this:

- What I did

Check MOSB Failed message in test case 85980

After https://redhat.atlassian.net/browse/OCPBUGS-112465#icft=OCPBUGS-112465 when a MOSB fails it reports the failure message in the Failed condition.

- How to verify it

Test 85980 checks the failed message and passes

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

@coderabbitai

coderabbitai Bot commented Sep 4, 2026

Copy link
Copy Markdown

No actionable comments were generated in the recent review. 🎉

ℹ️ Recent review info
⚙️ Run configuration

Configuration used: Repository: openshift/coderabbit/.coderabbit.yaml

Review profile: CHILL

Plan: Team

Run ID: ebc92aab-de09-4b66-9163-08a06351521f

📥 Commits

Reviewing files that changed from the base of the PR and between 25c2546 and 8940415.

📒 Files selected for processing (1)
  • test/extended-priv/mco_ocb_longduration.go

Included review availability: Your plan provides up to 2 included reviews per hour; 1 remains after this review.


Walkthrough

The extended-privilege MOSB degradation test now asserts that a failed MachineOSBuild reports the expected backoff-limit message within two minutes.

Changes

MOSB failure validation

Layer / File(s) Summary
Failure condition assertion
test/extended-priv/mco_ocb_longduration.go
The test checks that the failed MachineOSBuild Failed condition message contains Job has reached the specified backoff limit.

Estimated code review effort: 1 (Trivial) | ~2 minutes

Merge Risk: ⚪ Minimal · up to 89404

This change adds a test assertion that a failed MachineOSBuild reports the expected backoff-limit message. No merge-blocking risk remains.

🚥 Pre-merge checks | ✅ 15
✅ Passed checks (15 passed)
Check name Status Explanation
Docstring Coverage ✅ Passed No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check. Docstring coverage is scoped to functions touched by this diff. Analyzed 0 functions across 1…
Linked Issues check ✅ Passed Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check ✅ Passed Check skipped because no linked issues were found for this pull request.
Stable And Deterministic Test Names ✅ Passed The pull request adds only a MOSB condition assertion in the test body. The [PolarionID:85980] Ginkgo title is identical in the parent and current revisions, and the added text contains no dynamic t…
Test Structure And Quality ✅ Passed PASS: The commit adds one assertion to the existing MOSB failure phase in test 85980. It checks a field of the same Failed condition already being verified, so it does not introduce an unrelated respo…
Microshift Test Compatibility ✅ Passed The PR adds two assertion lines to the existing [PolarionID:85980] test. It does not add a new It, Describe, or other Ginkgo test. The assertion only checks the Failed condition message on the…
Single Node Openshift (Sno) Test Compatibility ✅ Passed PASS: The pull request adds only a Failed condition message assertion to existing test 85980. The assertion uses the MOSB API and does not add any listed multi-node or HA assumption. The enclosing `…
Topology-Aware Scheduling Compatibility ✅ Passed The pull request changes only test/extended-priv/mco_ocb_longduration.go and adds a MOSB failure-message assertion. It does not add or modify deployment manifests, operator code, controllers, or sch…
Ote Binary Stdout Contract ✅ Passed PASS. The pull request adds only a HaveConditionField assertion inside the g.It body for test 85980. The assertion performs no stdout write. The diff adds no fmt.Print*, klog, log, `os.Stdou…
Ipv6 And Disconnected Network Test Compatibility ✅ Passed PASS. The pull request adds only a HaveConditionField assertion for the MOSB failure message inside the existing Ginkgo test 85980. The changed lines add no IPv4 address handling, IP parsing, URL …
No-Weak-Crypto ✅ Passed PASS. The commit changes only test/extended-priv/mco_ocb_longduration.go by adding a MOSB failure-message assertion. The added code contains no MD5, SHA1, DES, 3DES, RC4, Blowfish, ECB, custom crypt…
Container-Privileges ✅ Passed The pull request changes one Go test file and adds only an assertion for the MachineOSBuild failure message. The exact commit diff contains no privileged, hostPID, hostNetwork, hostIPC, `SYS…
No-Sensitive-Data-In-Logs ✅ Passed The pull request adds only a HaveConditionField assertion with the fixed text Job has reached the specified backoff limit and a generic failure description. It adds no password, token, API key, PI…
Description Check ✅ Passed Check skipped - CodeRabbit’s high-level summary is enabled.
Title check ✅ Passed The title clearly identifies the main change: adding a check for the MOSB failure message in test 85980.
✨ Finishing Touches
🧪 Generate unit tests (beta)
  • Create PR with unit tests

Comment @coderabbitai help to get the list of available commands.

@openshift-ci openshift-ci Bot added the approved Indicates a PR has been approved by an approver from all required OWNERS files. label Sep 4, 2026
@sergiordlr

sergiordlr commented Sep 4, 2026

Copy link
Copy Markdown
Contributor Author

/verified by @sergiordlr

Executed the test manually and checked that the test verifies the message and passes

Manual execution logs
  [sig-mco][Suite:openshift/machine-config-operator/longduration][Serial][Disruptive] MCO ocb longduration [PolarionID:85980][OTP][Skipped:Disconnected] Check when MOSB is degraded MCP should be degraded too with right fields updated. [Disruptive]
  /home/fedora/Workspace/machine-config-operator/test/extended-priv/mco_ocb_longduration.go:700
    STEP: Creating a kubernetes client @ 09/04/26 10:54:52.374
  I0904 10:54:52.598307  333525 client.go:163] configPath is now "/tmp/configfile205709390"
  I0904 10:54:52.598335  333525 client.go:290] The user is now "e2e-test-mco-ocb-longduration-sgjvf-user"
  I0904 10:54:52.598341  333525 client.go:292] Creating project "e2e-test-mco-ocb-longduration-sgjvf"
  I0904 10:54:52.703420  333525 client.go:301] Waiting on permissions in project "e2e-test-mco-ocb-longduration-sgjvf" ...
  I0904 10:54:52.797330  333525 client.go:362] Waiting for ServiceAccount "default" to be provisioned...
  I0904 10:54:52.920883  333525 client.go:362] Waiting for ServiceAccount "builder" to be provisioned...
  I0904 10:54:53.044357  333525 client.go:362] Waiting for ServiceAccount "deployer" to be provisioned...
  I0904 10:54:53.169177  333525 client.go:372] Waiting for RoleBinding "system:image-builders" to be provisioned...
  I0904 10:54:53.194104  333525 client.go:372] Waiting for RoleBinding "system:deployers" to be provisioned...
  I0904 10:54:53.219279  333525 client.go:372] Waiting for RoleBinding "system:image-pullers" to be provisioned...
  I0904 10:54:53.242324  333525 client.go:403] Project "e2e-test-mco-ocb-longduration-sgjvf" has been fully provisioned.
    STEP: MCO Preconditions Checks @ 09/04/26 10:54:53.242
  Sep  4 10:54:53.414: INFO: Check that master pool is ready for testing
  I0904 10:54:53.414489  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get mcp master -o jsonpath={.status.machineCount}'
  Sep  4 10:54:53.572: INFO: Num nodes: 3, wait time per node 13 minutes
  Sep  4 10:54:53.572: INFO: Increase waiting time because it is master pool
  Sep  4 10:54:53.572: INFO: Waiting 3m54s for MCP master to be completed.
  I0904 10:54:53.572731  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get mcp master -o jsonpath={.status.conditions[?(@.type=="Degraded")].status}'
  I0904 10:54:53.724821  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get mcp master -o jsonpath={.status.conditions[?(@.type=="Updated")].status}'
  Sep  4 10:54:53.879: INFO: MCP 'master' is ready for testing
  Sep  4 10:54:53.879: INFO: Check that worker pool is ready for testing
  I0904 10:54:53.879378  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get mcp worker -o jsonpath={.status.machineCount}'
  Sep  4 10:54:54.026: INFO: Num nodes: 2, wait time per node 13 minutes
  Sep  4 10:54:54.026: INFO: Waiting 2m0s for MCP worker to be completed.
  I0904 10:54:54.026863  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get mcp worker -o jsonpath={.status.conditions[?(@.type=="Degraded")].status}'
  I0904 10:54:54.179691  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get mcp worker -o jsonpath={.status.conditions[?(@.type=="Updated")].status}'
  Sep  4 10:54:54.333: INFO: MCP 'worker' is ready for testing
  Sep  4 10:54:54.333: INFO: Wait for MCC to get the leader lease
  I0904 10:54:54.333631  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get pod -n openshift-machine-config-operator -l k8s-app=machine-config-controller -o jsonpath={.items[0].metadata.name}'
  I0904 10:54:54.494993  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb logs -n openshift-machine-config-operator -c machine-config-controller machine-config-controller-b8ffdc494-6ln7t'
  Sep  4 10:54:54.756: INFO: End of MCO Preconditions

    STEP: Create custom infra MCP @ 09/04/26 10:54:54.902
  Sep  4 10:54:57.736: INFO: mco fixture dir is not initialized, start to create
  Sep  4 10:54:57.738: INFO: mco fixture dir is initialized: /tmp/fixture-testdata-dir2013934403
  I0904 10:55:00.740196  333525 client.go:742] showInfo is true
  I0904 10:55:00.740240  333525 client.go:744] Running 'oc --namespace=e2e-test-mco-ocb-longduration-sgjvf --kubeconfig=/tmp/422ocb process --ignore-unknown-parameters=true -f /tmp/fixture-testdata-dir2013934403/custom-machine-config-pool.yaml -p NAME=infra'
  I0904 10:55:00.892279  333525 template.go:66] the file of resource is /tmp/e2e-test-mco-ocb-longduration-sgjvf-mnzgghssconfig.json.stdout
  I0904 10:55:00.892339  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb create -f /tmp/e2e-test-mco-ocb-longduration-sgjvf-mnzgghssconfig.json.stdout'
  machineconfigpool.machineconfiguration.openshift.io/infra created
  I0904 10:55:01.506634  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb label node ip-10-0-11-233.us-east-2.compute.internal node-role.kubernetes.io/infra='
  node/ip-10-0-11-233.us-east-2.compute.internal labeled
  Sep  4 10:55:01.705: INFO: Node ip-10-0-11-233.us-east-2.compute.internal added to pool infra
  Sep  4 10:55:01.705: INFO: Waiting 5m0s for MCP infra to report 1 machine count.
  I0904 10:55:01.705248  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get mcp infra -o jsonpath={.status.machineCount}'
  Sep  4 10:55:01.872: ERROR: the err:.status.machineCount value is not already set in MCP infra, and try next round
  I0904 10:55:31.710818  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get mcp infra -o jsonpath={.status.machineCount}'
  Sep  4 10:55:31.866: INFO: MCP is reporting 1 machine count
  I0904 10:55:31.866304  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get mcp infra -o jsonpath={.status.machineCount}'
  Sep  4 10:55:32.014: INFO: Num nodes: 1, wait time per node 13 minutes
  Sep  4 10:55:32.218: INFO: Waiting 13m0s for MCP infra condition Updated to be True
  I0904 10:55:32.218437  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get mcp infra -o jsonpath={.status.conditions[?(@.type=="Updated")].status}'
  Sep  4 10:55:32.362: INFO: MCP infra condition Updated status is True
  Sep  4 10:55:34.522: INFO: Infra node: ip-10-0-11-233.us-east-2.compute.internal

  Sep  4 10:55:34.522: INFO: OK!

    STEP: Create MOSC with incorrect containerfile @ 09/04/26 10:55:34.522
  I0904 10:55:34.523049  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get clusterversion version -o jsonpath={.status.capabilities.enabledCapabilities}'
  Sep  4 10:55:34.687: INFO: enabled capabilities: ["Build","CSISnapshot","CloudControllerManager","CloudCredential","Console","DeploymentConfig","ImageRegistry","Ingress","Insights","MachineAPI","NodeTuning","OperatorLifecycleManager","OperatorLifecycleManagerV1","Storage","baremetal","marketplace","openshift-samples"]
  Sep  4 10:55:34.687: INFO: Capability [ImageRegistry] is enabled: true
  I0904 10:55:34.687780  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get configs.imageregistry.operator.openshift.io cluster -o jsonpath={.spec.storage.emptyDir}'
  Sep  4 10:55:40.332: INFO: Create a new secret with the credentials to login to the internal registry using a SA
  I0904 10:55:40.332835  333525 client.go:717] Running 'oc --namespace=e2e-test-mco-ocb-longduration-sgjvf --kubeconfig=/tmp/422ocb create -n openshift-machine-config-operator token builder --duration=72h'
  Sep  4 10:55:40.485: INFO: Use a master node to login to the internal registry using the new token
  I0904 10:55:40.953672  333525 client.go:742] showInfo is false
  Sep  4 10:55:44.092: INFO: Copy the docker.json file to local
  Sep  4 10:55:44.092: INFO: Node: ip-10-0-1-43.us-east-2.compute.internal. Copying file /tmp/e2e-test-mco-ocb-longduration-sgjvf-tmp-config.json to local path /tmp/e2e-test-mco-ocb-longduration-sgjvf-tmp-config.json
  I0904 10:55:44.092244  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get pods -n openshift-machine-config-operator -l k8s-app=machine-config-daemon --field-selector spec.nodeName=ip-10-0-1-43.us-east-2.compute.internal -o jsonpath='{..metadata.name}''
  I0904 10:55:44.268781  333525 client.go:717] Running 'oc --namespace=e2e-test-mco-ocb-longduration-sgjvf --kubeconfig=/tmp/422ocb cp -n openshift-machine-config-operator machine-config-daemon-zz5d7:/rootfs/tmp/e2e-test-mco-ocb-longduration-sgjvf-tmp-config.json /tmp/e2e-test-mco-ocb-longduration-sgjvf-tmp-config.json -c machine-config-daemon'
  tar: Removing leading `/' from member names
  Sep  4 10:55:44.532: INFO: OK!
  Sep  4 10:55:44.532: INFO: Create the secret with the credentials to push images to the internal registry
  I0904 10:55:44.532446  333525 client.go:717] Running 'oc --namespace=e2e-test-mco-ocb-longduration-sgjvf --kubeconfig=/tmp/422ocb create secret -n openshift-machine-config-operator docker-registry cloned-push-secretfzotpnpa --from-file=.dockerconfigjson=/tmp/e2e-test-mco-ocb-longduration-sgjvf-tmp-config.json'
  secret/cloned-push-secretfzotpnpa created
  Sep  4 10:55:44.675: INFO: OK!
  I0904 10:55:44.675389  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get -n openshift-machine-config-operator secret cloned-push-secretfzotpnpa -o jsonpath={.}'
  Sep  4 10:55:44.828: INFO: Cloning resource <Kind: secret, Name: pull-secret, Namespace: openshift-config> with name cloned-basepull-secret-d2me8n0s and namespace openshift-machine-config-operator
  I0904 10:55:44.828090  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get -n openshift-config secret pull-secret -o json'
  Sep  4 10:55:44.996: INFO: Executing extra modifications
  Sep  4 10:55:44.997: INFO: New resource created using definition file /tmp/e2e-test-mco-ocb-longduration-sgjvf-cloned-secret-cloned-basepull-secret-d2me8n0s-0224c656-c033-4828-a12b-5d9cd83d2781-namespace.json
  I0904 10:55:44.997307  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb create -f /tmp/e2e-test-mco-ocb-longduration-sgjvf-cloned-secret-cloned-basepull-secret-d2me8n0s-0224c656-c033-4828-a12b-5d9cd83d2781-namespace.json'
  Sep  4 10:55:45.187: INFO: Creating MachineOSConfig infra in pool infra with pullSecret cloned-basepull-secret-d2me8n0s pushSecret cloned-push-secretfzotpnpa and pushSpec image-registry.openshift-image-registry.svc:5000/openshift-machine-config-operator/ocb-infra-image:latest
  Sep  4 10:55:45.187: INFO: Using custom Containerfile [{"content":"FROM alpine:3.18\nRUN apt update \u0026\u0026 apt install -y cowsay\n"}]
  I0904 10:55:48.189233  333525 client.go:742] showInfo is true
  I0904 10:55:48.189286  333525 client.go:744] Running 'oc --namespace=e2e-test-mco-ocb-longduration-sgjvf --kubeconfig=/tmp/422ocb process --ignore-unknown-parameters=true -f /tmp/fixture-testdata-dir2013934403/generic-machine-os-config.yaml -p NAME=infra POOL=infra RENDEREDIMAGEPUSHSECRET=cloned-push-secretfzotpnpa PUSHSPEC=image-registry.openshift-image-registry.svc:5000/openshift-machine-config-operator/ocb-infra-image:latest BASEIMAGEPULLSECRET=cloned-basepull-secret-d2me8n0s CONTAINERFILE=[{"content":"FROM alpine:3.18\nRUN apt update \u0026\u0026 apt install -y cowsay\n"}]'
  I0904 10:55:48.344437  333525 template.go:66] the file of resource is /tmp/e2e-test-mco-ocb-longduration-sgjvf-kl4cgaldconfig.json.stdout
  I0904 10:55:48.344512  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb create -f /tmp/e2e-test-mco-ocb-longduration-sgjvf-kl4cgaldconfig.json.stdout'
  machineosconfig.machineconfiguration.openshift.io/infra created
  Sep  4 10:55:48.500: INFO: OK!

    STEP: Verify MOSB is created and fails @ 09/04/26 10:55:48.5
  I0904 10:55:48.500163  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get machineosconfig infra -o jsonpath={.metadata.annotations.machineconfiguration\.openshift\.io/current-machine-os-build}'
  I0904 10:56:08.663436  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get machineosconfig infra -o jsonpath={.metadata.annotations.machineconfiguration\.openshift\.io/current-machine-os-build}'
  I0904 10:56:08.815177  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get machineosbuild infra-ffa445ea2ccb4a6cd3fe78d99ca215a2 -o jsonpath={.}'
  I0904 10:56:08.970336  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get machineosconfig infra -o jsonpath={.metadata.annotations.machineconfiguration\.openshift\.io/current-machine-os-build}'
  Sep  4 10:56:09.118: INFO: MOSB created: infra-ffa445ea2ccb4a6cd3fe78d99ca215a2

  I0904 10:56:09.118292  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get machineosbuild infra-ffa445ea2ccb4a6cd3fe78d99ca215a2 -o jsonpath={.status.conditions[?(@.type=="Failed")]}'
  Sep  4 10:56:09.264: INFO: Value: False
  I0904 10:56:29.269872  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get machineosbuild infra-ffa445ea2ccb4a6cd3fe78d99ca215a2 -o jsonpath={.status.conditions[?(@.type=="Failed")]}'
  Sep  4 10:56:29.423: INFO: Value: False
  I0904 10:56:49.424519  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get machineosbuild infra-ffa445ea2ccb4a6cd3fe78d99ca215a2 -o jsonpath={.status.conditions[?(@.type=="Failed")]}'
  Sep  4 10:56:49.572: INFO: Value: False
  I0904 10:57:09.573265  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get machineosbuild infra-ffa445ea2ccb4a6cd3fe78d99ca215a2 -o jsonpath={.status.conditions[?(@.type=="Failed")]}'
  Sep  4 10:57:09.733: INFO: Value: False
  I0904 10:57:29.737970  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get machineosbuild infra-ffa445ea2ccb4a6cd3fe78d99ca215a2 -o jsonpath={.status.conditions[?(@.type=="Failed")]}'
  Sep  4 10:57:29.924: INFO: Value: True
  I0904 10:57:29.924875  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get machineosbuild infra-ffa445ea2ccb4a6cd3fe78d99ca215a2 -o jsonpath={.status.conditions[?(@.type=="Failed")]}'
  Sep  4 10:57:30.071: INFO: Value: Job "build-infra-ffa445ea2ccb4a6cd3fe78d99ca215a2" failed after 4 attempt(s): Job has reached the specified backoff limit
  Sep  4 10:57:30.071: INFO: MOSB failed as expected

    STEP: Verify MCP is degraded with ImageBuildDegraded condition @ 09/04/26 10:57:30.071
  I0904 10:57:30.071792  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get mcp infra -o jsonpath={.status.conditions[?(@.type=="Degraded")]}'
  Sep  4 10:57:30.223: INFO: Value: True
  I0904 10:57:30.223432  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get mcp infra -o jsonpath={.status.conditions[?(@.type=="ImageBuildDegraded")]}'
  Sep  4 10:57:30.372: INFO: Value: True
  I0904 10:57:30.372809  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get mcp infra -o jsonpath={.status.conditions[?(@.type=="ImageBuildDegraded")]}'
  Sep  4 10:57:30.529: INFO: Value: Failed to build OS image for pool infra (MachineOSBuild: infra-ffa445ea2ccb4a6cd3fe78d99ca215a2): BackoffLimitExceeded: Job "build-infra-ffa445ea2ccb4a6cd3fe78d99ca215a2" failed after 4 attempt(s): Job has reached the specified backoff limit
  I0904 10:57:30.529752  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get mcp infra -o jsonpath={.status.conditions[?(@.type=="Degraded")]}'
  Sep  4 10:57:30.670: INFO: Value: Custom OS image build failed
  Sep  4 10:57:30.670: INFO: OK!

    STEP: Fix the MOSC by updating containerfile @ 09/04/26 10:57:30.67
  I0904 10:57:30.670656  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb patch machineosconfig infra --type json -p [{"op": "replace", "path": "/spec/containerFile", "value":  [{"content":"FROM configs AS final\nRUN echo \"hello\" \u003e /etc/test.txt\n"}]}]'
  Sep  4 10:57:30.856: INFO: OK!

    STEP: Verify new MOSB is created and succeeds @ 09/04/26 10:57:30.856
  Sep  4 10:57:30.856: INFO: Current mosb: <Kind: machineosbuild, Name: infra-ffa445ea2ccb4a6cd3fe78d99ca215a2, Namespace: >
  I0904 10:57:30.857009  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get machineosconfig infra -o jsonpath={.metadata.annotations.machineconfiguration\.openshift\.io/current-machine-os-build}'
  I0904 10:57:51.030691  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get machineosconfig infra -o jsonpath={.metadata.annotations.machineconfiguration\.openshift\.io/current-machine-os-build}'
  Sep  4 10:57:51.179: INFO: New mosb: <Kind: machineosbuild, Name: infra-70b896756e1c3cd3dc7749a017795729, Namespace: >
  I0904 10:57:51.179741  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get machineosbuild infra-70b896756e1c3cd3dc7749a017795729 -o jsonpath={.status.conditions[?(@.type=="Building")]}'
  Sep  4 10:57:51.338: INFO: Value: True
  I0904 10:57:51.338333  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get machineosbuild infra-70b896756e1c3cd3dc7749a017795729 -o jsonpath={.status.conditions[?(@.type=="Building")]}'
  Sep  4 10:57:51.487: INFO: Value: True
  I0904 10:58:11.505807  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get machineosbuild infra-70b896756e1c3cd3dc7749a017795729 -o jsonpath={.status.conditions[?(@.type=="Building")]}'
  Sep  4 10:58:11.650: INFO: Value: True
  I0904 10:58:31.664890  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get machineosbuild infra-70b896756e1c3cd3dc7749a017795729 -o jsonpath={.status.conditions[?(@.type=="Building")]}'
  Sep  4 10:58:31.816: INFO: Value: True
  I0904 10:58:51.834131  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get machineosbuild infra-70b896756e1c3cd3dc7749a017795729 -o jsonpath={.status.conditions[?(@.type=="Building")]}'
  Sep  4 10:58:51.987: INFO: Value: True
  I0904 10:59:11.987441  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get machineosbuild infra-70b896756e1c3cd3dc7749a017795729 -o jsonpath={.status.conditions[?(@.type=="Building")]}'
  Sep  4 10:59:12.127: INFO: Value: True
  I0904 10:59:32.146670  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get machineosbuild infra-70b896756e1c3cd3dc7749a017795729 -o jsonpath={.status.conditions[?(@.type=="Building")]}'
  Sep  4 10:59:32.300: INFO: Value: True
  I0904 10:59:52.316226  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get machineosbuild infra-70b896756e1c3cd3dc7749a017795729 -o jsonpath={.status.conditions[?(@.type=="Building")]}'
  Sep  4 10:59:52.463: INFO: Value: True
  I0904 11:00:12.481876  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get machineosbuild infra-70b896756e1c3cd3dc7749a017795729 -o jsonpath={.status.conditions[?(@.type=="Building")]}'
  Sep  4 11:00:12.629: INFO: Value: True
  I0904 11:00:32.647032  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get machineosbuild infra-70b896756e1c3cd3dc7749a017795729 -o jsonpath={.status.conditions[?(@.type=="Building")]}'
  Sep  4 11:00:32.800: INFO: Value: True
  I0904 11:00:52.810291  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get machineosbuild infra-70b896756e1c3cd3dc7749a017795729 -o jsonpath={.status.conditions[?(@.type=="Building")]}'
  Sep  4 11:00:53.006: INFO: Value: True
  I0904 11:01:13.006752  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get machineosbuild infra-70b896756e1c3cd3dc7749a017795729 -o jsonpath={.status.conditions[?(@.type=="Building")]}'
  Sep  4 11:01:13.155: INFO: Value: True
  I0904 11:01:33.161781  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get machineosbuild infra-70b896756e1c3cd3dc7749a017795729 -o jsonpath={.status.conditions[?(@.type=="Building")]}'
  Sep  4 11:01:33.340: INFO: Value: True
  I0904 11:01:53.360093  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get machineosbuild infra-70b896756e1c3cd3dc7749a017795729 -o jsonpath={.status.conditions[?(@.type=="Building")]}'
  Sep  4 11:01:53.511: INFO: Value: True
  I0904 11:02:13.514054  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get machineosbuild infra-70b896756e1c3cd3dc7749a017795729 -o jsonpath={.status.conditions[?(@.type=="Building")]}'
  Sep  4 11:02:13.663: INFO: Value: True
  I0904 11:02:33.670630  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get machineosbuild infra-70b896756e1c3cd3dc7749a017795729 -o jsonpath={.status.conditions[?(@.type=="Building")]}'
  Sep  4 11:02:33.825: INFO: Value: True
  I0904 11:02:53.827741  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get machineosbuild infra-70b896756e1c3cd3dc7749a017795729 -o jsonpath={.status.conditions[?(@.type=="Building")]}'
  Sep  4 11:02:53.988: INFO: Value: True
  I0904 11:03:13.989194  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get machineosbuild infra-70b896756e1c3cd3dc7749a017795729 -o jsonpath={.status.conditions[?(@.type=="Building")]}'
  Sep  4 11:03:14.138: INFO: Value: True
  I0904 11:03:34.147412  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get machineosbuild infra-70b896756e1c3cd3dc7749a017795729 -o jsonpath={.status.conditions[?(@.type=="Building")]}'
  Sep  4 11:03:34.304: INFO: Value: True
  I0904 11:03:54.323497  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get machineosbuild infra-70b896756e1c3cd3dc7749a017795729 -o jsonpath={.status.conditions[?(@.type=="Building")]}'
  Sep  4 11:03:54.476: INFO: Value: True
  I0904 11:04:14.494960  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get machineosbuild infra-70b896756e1c3cd3dc7749a017795729 -o jsonpath={.status.conditions[?(@.type=="Building")]}'
  Sep  4 11:04:14.652: INFO: Value: True
  I0904 11:04:34.667314  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get machineosbuild infra-70b896756e1c3cd3dc7749a017795729 -o jsonpath={.status.conditions[?(@.type=="Building")]}'
  Sep  4 11:04:34.816: INFO: Value: False
  I0904 11:04:34.816580  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get machineosbuild infra-70b896756e1c3cd3dc7749a017795729 -o jsonpath={.status.conditions[?(@.type=="Succeeded")]}'
  Sep  4 11:04:34.963: INFO: Value: True
  I0904 11:04:34.963738  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get machineosbuild infra-70b896756e1c3cd3dc7749a017795729 -o jsonpath={.status.conditions[?(@.type=="Interrupted")]}'
  Sep  4 11:04:35.112: INFO: Value: False
  I0904 11:04:35.112485  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get machineosbuild infra-70b896756e1c3cd3dc7749a017795729 -o jsonpath={.status.conditions[?(@.type=="Failed")]}'
  Sep  4 11:04:35.274: INFO: Value: False
  I0904 11:04:35.274519  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get machineosconfig infra -o jsonpath={.metadata.annotations.machineconfiguration\.openshift\.io/current-machine-os-build}'
  Sep  4 11:04:35.425: INFO: New MOSB created: infra-70b896756e1c3cd3dc7749a017795729

    STEP: Verify old failed MOSB is deleted @ 09/04/26 11:04:35.425
  I0904 11:04:35.425182  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get machineosbuild infra-ffa445ea2ccb4a6cd3fe78d99ca215a2 -o jsonpath={.}'
  I0904 11:04:35.574921  333525 client.go:726] Error running /home/fedora/OCP_envs/5.0/oc --kubeconfig=/tmp/422ocb get machineosbuild infra-ffa445ea2ccb4a6cd3fe78d99ca215a2 -o jsonpath={.}:
  Error from server (NotFound): machineosbuilds.machineconfiguration.openshift.io "infra-ffa445ea2ccb4a6cd3fe78d99ca215a2" not found
  Sep  4 11:04:35.574: INFO: OK!

    STEP: Verify MCP recovers and is no longer degraded @ 09/04/26 11:04:35.575
  I0904 11:04:35.575054  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get mcp infra -o jsonpath={.status.conditions[?(@.type=="ImageBuildDegraded")]}'
  Sep  4 11:04:35.722: INFO: Value: False
  I0904 11:04:35.722127  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get mcp infra -o jsonpath={.status.conditions[?(@.type=="Degraded")]}'
  Sep  4 11:04:35.873: INFO: Value: False
  I0904 11:04:35.873606  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get mcp infra -o jsonpath={.status.conditions[?(@.type=="Updating")]}'
  Sep  4 11:04:36.025: INFO: Value: True
  Sep  4 11:04:36.025: INFO: OK!

    STEP: Wait for MCP to complete update @ 09/04/26 11:04:36.025
  I0904 11:04:36.025355  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get mcp infra -o jsonpath={.status.machineCount}'
  Sep  4 11:04:36.180: INFO: Num nodes: 1, wait time per node 13 minutes
  Sep  4 11:04:36.382: INFO: Waiting 13m0s for MCP infra to be completed.
  I0904 11:05:36.383319  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get mcp infra -o jsonpath={.status.degradedMachineCount}'
  I0904 11:05:36.525476  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get mcp infra -o jsonpath={.status.conditions[?(@.type=="Degraded")].status}'
  I0904 11:05:36.676537  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get mcp infra -o jsonpath={.status.conditions[?(@.type=="Updated")].status}'
  I0904 11:06:36.407658  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get mcp infra -o jsonpath={.status.degradedMachineCount}'
  I0904 11:06:36.560946  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get mcp infra -o jsonpath={.status.conditions[?(@.type=="Degraded")].status}'
  I0904 11:06:36.721419  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get mcp infra -o jsonpath={.status.conditions[?(@.type=="Updated")].status}'
  I0904 11:07:36.390003  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get mcp infra -o jsonpath={.status.degradedMachineCount}'
  I0904 11:07:36.535753  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get mcp infra -o jsonpath={.status.conditions[?(@.type=="Degraded")].status}'
  I0904 11:07:36.686712  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get mcp infra -o jsonpath={.status.conditions[?(@.type=="Updated")].status}'
  Sep  4 11:07:36.838: INFO: The new MC has been successfully applied to MCP 'infra'
  Sep  4 11:07:36.838: INFO: OK!

    STEP: Verify image is applied to node @ 09/04/26 11:07:36.838
  I0904 11:07:36.838925  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get machineosconfig infra -o jsonpath={.status.currentImagePullSpec}'
  I0904 11:07:37.166635  333525 client.go:742] showInfo is true
  I0904 11:07:37.166672  333525 client.go:744] Running 'oc --namespace=e2e-test-mco-ocb-longduration-sgjvf --kubeconfig=/tmp/422ocb debug node/ip-10-0-11-233.us-east-2.compute.internal -- chroot /host rpm-ostree status --json'
  Sep  4 11:07:44.841: INFO: Current booted container-image-reference: "ostree-unverified-registry:image-registry.openshift-image-registry.svc:5000/openshift-machine-config-operator/ocb-infra-image@sha256:68c4ce8c129a167f1cc78f988d638a2df0268d1ac7d989bb9fbb07815ee57521"
  Sep  4 11:07:44.841: INFO: Booted image: image-registry.openshift-image-registry.svc:5000/openshift-machine-config-operator/ocb-infra-image@sha256:68c4ce8c129a167f1cc78f988d638a2df0268d1ac7d989bb9fbb07815ee57521
  Sep  4 11:07:44.841: INFO: Node is using image: image-registry.openshift-image-registry.svc:5000/openshift-machine-config-operator/ocb-infra-image@sha256:68c4ce8c129a167f1cc78f988d638a2df0268d1ac7d989bb9fbb07815ee57521

  Sep  4 11:07:44.841: INFO: OK!

    STEP: Verify file created in containerfile exists on node @ 09/04/26 11:07:44.841
  I0904 11:07:45.149496  333525 client.go:742] showInfo is false
  Sep  4 11:07:46.834: INFO: OK!

  I0904 11:07:46.834568  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get machineosconfig infra -o jsonpath={.}'
  I0904 11:07:46.980551  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get machineosconfig infra -o jsonpath={.spec.baseImagePullSecret.name}'
  I0904 11:07:47.131167  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get -n openshift-machine-config-operator secret cloned-basepull-secret-d2me8n0s -o jsonpath={.}'
  I0904 11:07:47.301867  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get -n openshift-machine-config-operator secret cloned-basepull-secret-d2me8n0s -o jsonpath={.metadata.ownerReferences[0]}'
  I0904 11:07:47.472487  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb delete -n openshift-machine-config-operator secret cloned-basepull-secret-d2me8n0s'
  I0904 11:07:47.668078  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get machineosconfig infra -o jsonpath={.spec.renderedImagePushSecret.name}'
  I0904 11:07:47.824292  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get -n openshift-machine-config-operator secret cloned-push-secretfzotpnpa -o jsonpath={.}'
  I0904 11:07:47.965591  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get -n openshift-machine-config-operator secret cloned-push-secretfzotpnpa -o jsonpath={.metadata.ownerReferences[0]}'
  I0904 11:07:48.122482  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb delete -n openshift-machine-config-operator secret cloned-push-secretfzotpnpa'
  I0904 11:07:48.299774  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb delete machineosconfig infra'
  I0904 11:07:48.466998  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get mcp infra -o jsonpath={.}'
    STEP: Removing custom MCP infra @ 09/04/26 11:07:48.61
  Sep  4 11:07:50.754: INFO: Removing pool label from node ip-10-0-11-233.us-east-2.compute.internal
  I0904 11:07:50.754882  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb label node ip-10-0-11-233.us-east-2.compute.internal node-role.kubernetes.io/infra-'
  node/ip-10-0-11-233.us-east-2.compute.internal unlabeled
  Sep  4 11:07:50.956: INFO: Waiting for label node-role.kubernetes.io/infra to be removed from node ip-10-0-11-233.us-east-2.compute.internal
  I0904 11:07:50.956912  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get node ip-10-0-11-233.us-east-2.compute.internal -o jsonpath={.metadata.labels}'
  Sep  4 11:07:51.113: INFO: Label null has been removed from node ip-10-0-11-233.us-east-2.compute.internal
  Sep  4 11:07:51.113: INFO: Waiting 5m0s for MCP infra to report 0 machine count.
  I0904 11:07:51.113864  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get mcp infra -o jsonpath={.status.machineCount}'
  Sep  4 11:07:51.264: INFO: Expected machine count 0. Reported machine count 1
  I0904 11:08:21.143350  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get mcp infra -o jsonpath={.status.machineCount}'
  Sep  4 11:08:21.292: INFO: MCP is reporting 0 machine count
  I0904 11:08:21.292435  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get mcp worker -o jsonpath={.status.machineCount}'
  Sep  4 11:08:21.444: INFO: Num nodes: 2, wait time per node 13 minutes
  Sep  4 11:08:21.444: INFO: Waiting 26m0s for MCP worker to be completed.
  I0904 11:09:21.500732  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get mcp worker -o jsonpath={.status.degradedMachineCount}'
  I0904 11:09:21.652719  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get mcp worker -o jsonpath={.status.conditions[?(@.type=="Degraded")].status}'
  I0904 11:09:21.811158  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get mcp worker -o jsonpath={.status.conditions[?(@.type=="Updated")].status}'
  I0904 11:10:21.445356  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get mcp worker -o jsonpath={.status.degradedMachineCount}'
  I0904 11:10:21.594839  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get mcp worker -o jsonpath={.status.conditions[?(@.type=="Degraded")].status}'
  I0904 11:10:21.742760  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get mcp worker -o jsonpath={.status.conditions[?(@.type=="Updated")].status}'
  I0904 11:11:21.503699  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get mcp worker -o jsonpath={.status.degradedMachineCount}'
  I0904 11:11:21.648325  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get mcp worker -o jsonpath={.status.conditions[?(@.type=="Degraded")].status}'
  I0904 11:11:21.802927  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get mcp worker -o jsonpath={.status.conditions[?(@.type=="Updated")].status}'
  Sep  4 11:11:21.954: INFO: The new MC has been successfully applied to MCP 'worker'
  I0904 11:11:21.954275  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb delete mcp infra'
  I0904 11:11:22.222379  333525 client.go:420] Deleted {user.openshift.io/v1, Resource=users  e2e-test-mco-ocb-longduration-sgjvf-user}, err: <nil>
  I0904 11:11:22.254920  333525 client.go:420] Deleted {oauth.openshift.io/v1, Resource=oauthclients  e2e-client-e2e-test-mco-ocb-longduration-sgjvf}, err: <nil>
  I0904 11:11:22.287454  333525 client.go:420] Deleted {oauth.openshift.io/v1, Resource=oauthaccesstokens  sha256~HJskJhfDRZ_HlzUa-zj-qPVsiJbz7jVSNHRlUxbUSXs}, err: <nil>
    STEP: Destroying namespace "e2e-test-mco-ocb-longduration-sgjvf" for this suite. @ 09/04/26 11:11:22.287
  • [989.942 seconds]
  ------------------------------
  [ReportAfterSuite] [sig-testing] Log Check
  /home/fedora/Workspace/machine-config-operator/vendor/k8s.io/kubernetes/test/e2e/invariants/logcheck/logcheck.go:179
  [ReportAfterSuite] PASSED [0.000 seconds]

@openshift-ci-robot openshift-ci-robot added the verified Signifies that the PR passed pre-merge verification criteria label Sep 4, 2026
@openshift-ci-robot

Copy link
Copy Markdown
Contributor

@sergiordlr: This PR has been marked as verified by @sergiordlr.

Details

In response to this:

/verified by @sergiordlr

Executed the test manually and checked that the test verifies the message and passes

Manual execution logs
 [sig-mco][Suite:openshift/machine-config-operator/longduration][Serial][Disruptive] MCO ocb longduration [PolarionID:85980][OTP][Skipped:Disconnected] Check when MOSB is degraded MCP should be degraded too with right fields updated. [Disruptive]
 /home/fedora/Workspace/machine-config-operator/test/extended-priv/mco_ocb_longduration.go:700
   STEP: Creating a kubernetes client @ 09/04/26 10:54:52.374
 I0904 10:54:52.598307  333525 client.go:163] configPath is now "/tmp/configfile205709390"
 I0904 10:54:52.598335  333525 client.go:290] The user is now "e2e-test-mco-ocb-longduration-sgjvf-user"
 I0904 10:54:52.598341  333525 client.go:292] Creating project "e2e-test-mco-ocb-longduration-sgjvf"
 I0904 10:54:52.703420  333525 client.go:301] Waiting on permissions in project "e2e-test-mco-ocb-longduration-sgjvf" ...
 I0904 10:54:52.797330  333525 client.go:362] Waiting for ServiceAccount "default" to be provisioned...
 I0904 10:54:52.920883  333525 client.go:362] Waiting for ServiceAccount "builder" to be provisioned...
 I0904 10:54:53.044357  333525 client.go:362] Waiting for ServiceAccount "deployer" to be provisioned...
 I0904 10:54:53.169177  333525 client.go:372] Waiting for RoleBinding "system:image-builders" to be provisioned...
 I0904 10:54:53.194104  333525 client.go:372] Waiting for RoleBinding "system:deployers" to be provisioned...
 I0904 10:54:53.219279  333525 client.go:372] Waiting for RoleBinding "system:image-pullers" to be provisioned...
 I0904 10:54:53.242324  333525 client.go:403] Project "e2e-test-mco-ocb-longduration-sgjvf" has been fully provisioned.
   STEP: MCO Preconditions Checks @ 09/04/26 10:54:53.242
 Sep  4 10:54:53.414: INFO: Check that master pool is ready for testing
 I0904 10:54:53.414489  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get mcp master -o jsonpath={.status.machineCount}'
 Sep  4 10:54:53.572: INFO: Num nodes: 3, wait time per node 13 minutes
 Sep  4 10:54:53.572: INFO: Increase waiting time because it is master pool
 Sep  4 10:54:53.572: INFO: Waiting 3m54s for MCP master to be completed.
 I0904 10:54:53.572731  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get mcp master -o jsonpath={.status.conditions[?(@.type=="Degraded")].status}'
 I0904 10:54:53.724821  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get mcp master -o jsonpath={.status.conditions[?(@.type=="Updated")].status}'
 Sep  4 10:54:53.879: INFO: MCP 'master' is ready for testing
 Sep  4 10:54:53.879: INFO: Check that worker pool is ready for testing
 I0904 10:54:53.879378  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get mcp worker -o jsonpath={.status.machineCount}'
 Sep  4 10:54:54.026: INFO: Num nodes: 2, wait time per node 13 minutes
 Sep  4 10:54:54.026: INFO: Waiting 2m0s for MCP worker to be completed.
 I0904 10:54:54.026863  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get mcp worker -o jsonpath={.status.conditions[?(@.type=="Degraded")].status}'
 I0904 10:54:54.179691  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get mcp worker -o jsonpath={.status.conditions[?(@.type=="Updated")].status}'
 Sep  4 10:54:54.333: INFO: MCP 'worker' is ready for testing
 Sep  4 10:54:54.333: INFO: Wait for MCC to get the leader lease
 I0904 10:54:54.333631  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get pod -n openshift-machine-config-operator -l k8s-app=machine-config-controller -o jsonpath={.items[0].metadata.name}'
 I0904 10:54:54.494993  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb logs -n openshift-machine-config-operator -c machine-config-controller machine-config-controller-b8ffdc494-6ln7t'
 Sep  4 10:54:54.756: INFO: End of MCO Preconditions

   STEP: Create custom infra MCP @ 09/04/26 10:54:54.902
 Sep  4 10:54:57.736: INFO: mco fixture dir is not initialized, start to create
 Sep  4 10:54:57.738: INFO: mco fixture dir is initialized: /tmp/fixture-testdata-dir2013934403
 I0904 10:55:00.740196  333525 client.go:742] showInfo is true
 I0904 10:55:00.740240  333525 client.go:744] Running 'oc --namespace=e2e-test-mco-ocb-longduration-sgjvf --kubeconfig=/tmp/422ocb process --ignore-unknown-parameters=true -f /tmp/fixture-testdata-dir2013934403/custom-machine-config-pool.yaml -p NAME=infra'
 I0904 10:55:00.892279  333525 template.go:66] the file of resource is /tmp/e2e-test-mco-ocb-longduration-sgjvf-mnzgghssconfig.json.stdout
 I0904 10:55:00.892339  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb create -f /tmp/e2e-test-mco-ocb-longduration-sgjvf-mnzgghssconfig.json.stdout'
 machineconfigpool.machineconfiguration.openshift.io/infra created
 I0904 10:55:01.506634  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb label node ip-10-0-11-233.us-east-2.compute.internal node-role.kubernetes.io/infra='
 node/ip-10-0-11-233.us-east-2.compute.internal labeled
 Sep  4 10:55:01.705: INFO: Node ip-10-0-11-233.us-east-2.compute.internal added to pool infra
 Sep  4 10:55:01.705: INFO: Waiting 5m0s for MCP infra to report 1 machine count.
 I0904 10:55:01.705248  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get mcp infra -o jsonpath={.status.machineCount}'
 Sep  4 10:55:01.872: ERROR: the err:.status.machineCount value is not already set in MCP infra, and try next round
 I0904 10:55:31.710818  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get mcp infra -o jsonpath={.status.machineCount}'
 Sep  4 10:55:31.866: INFO: MCP is reporting 1 machine count
 I0904 10:55:31.866304  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get mcp infra -o jsonpath={.status.machineCount}'
 Sep  4 10:55:32.014: INFO: Num nodes: 1, wait time per node 13 minutes
 Sep  4 10:55:32.218: INFO: Waiting 13m0s for MCP infra condition Updated to be True
 I0904 10:55:32.218437  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get mcp infra -o jsonpath={.status.conditions[?(@.type=="Updated")].status}'
 Sep  4 10:55:32.362: INFO: MCP infra condition Updated status is True
 Sep  4 10:55:34.522: INFO: Infra node: ip-10-0-11-233.us-east-2.compute.internal

 Sep  4 10:55:34.522: INFO: OK!

   STEP: Create MOSC with incorrect containerfile @ 09/04/26 10:55:34.522
 I0904 10:55:34.523049  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get clusterversion version -o jsonpath={.status.capabilities.enabledCapabilities}'
 Sep  4 10:55:34.687: INFO: enabled capabilities: ["Build","CSISnapshot","CloudControllerManager","CloudCredential","Console","DeploymentConfig","ImageRegistry","Ingress","Insights","MachineAPI","NodeTuning","OperatorLifecycleManager","OperatorLifecycleManagerV1","Storage","baremetal","marketplace","openshift-samples"]
 Sep  4 10:55:34.687: INFO: Capability [ImageRegistry] is enabled: true
 I0904 10:55:34.687780  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get configs.imageregistry.operator.openshift.io cluster -o jsonpath={.spec.storage.emptyDir}'
 Sep  4 10:55:40.332: INFO: Create a new secret with the credentials to login to the internal registry using a SA
 I0904 10:55:40.332835  333525 client.go:717] Running 'oc --namespace=e2e-test-mco-ocb-longduration-sgjvf --kubeconfig=/tmp/422ocb create -n openshift-machine-config-operator token builder --duration=72h'
 Sep  4 10:55:40.485: INFO: Use a master node to login to the internal registry using the new token
 I0904 10:55:40.953672  333525 client.go:742] showInfo is false
 Sep  4 10:55:44.092: INFO: Copy the docker.json file to local
 Sep  4 10:55:44.092: INFO: Node: ip-10-0-1-43.us-east-2.compute.internal. Copying file /tmp/e2e-test-mco-ocb-longduration-sgjvf-tmp-config.json to local path /tmp/e2e-test-mco-ocb-longduration-sgjvf-tmp-config.json
 I0904 10:55:44.092244  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get pods -n openshift-machine-config-operator -l k8s-app=machine-config-daemon --field-selector spec.nodeName=ip-10-0-1-43.us-east-2.compute.internal -o jsonpath='{..metadata.name}''
 I0904 10:55:44.268781  333525 client.go:717] Running 'oc --namespace=e2e-test-mco-ocb-longduration-sgjvf --kubeconfig=/tmp/422ocb cp -n openshift-machine-config-operator machine-config-daemon-zz5d7:/rootfs/tmp/e2e-test-mco-ocb-longduration-sgjvf-tmp-config.json /tmp/e2e-test-mco-ocb-longduration-sgjvf-tmp-config.json -c machine-config-daemon'
 tar: Removing leading `/' from member names
 Sep  4 10:55:44.532: INFO: OK!
 Sep  4 10:55:44.532: INFO: Create the secret with the credentials to push images to the internal registry
 I0904 10:55:44.532446  333525 client.go:717] Running 'oc --namespace=e2e-test-mco-ocb-longduration-sgjvf --kubeconfig=/tmp/422ocb create secret -n openshift-machine-config-operator docker-registry cloned-push-secretfzotpnpa --from-file=.dockerconfigjson=/tmp/e2e-test-mco-ocb-longduration-sgjvf-tmp-config.json'
 secret/cloned-push-secretfzotpnpa created
 Sep  4 10:55:44.675: INFO: OK!
 I0904 10:55:44.675389  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get -n openshift-machine-config-operator secret cloned-push-secretfzotpnpa -o jsonpath={.}'
 Sep  4 10:55:44.828: INFO: Cloning resource <Kind: secret, Name: pull-secret, Namespace: openshift-config> with name cloned-basepull-secret-d2me8n0s and namespace openshift-machine-config-operator
 I0904 10:55:44.828090  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get -n openshift-config secret pull-secret -o json'
 Sep  4 10:55:44.996: INFO: Executing extra modifications
 Sep  4 10:55:44.997: INFO: New resource created using definition file /tmp/e2e-test-mco-ocb-longduration-sgjvf-cloned-secret-cloned-basepull-secret-d2me8n0s-0224c656-c033-4828-a12b-5d9cd83d2781-namespace.json
 I0904 10:55:44.997307  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb create -f /tmp/e2e-test-mco-ocb-longduration-sgjvf-cloned-secret-cloned-basepull-secret-d2me8n0s-0224c656-c033-4828-a12b-5d9cd83d2781-namespace.json'
 Sep  4 10:55:45.187: INFO: Creating MachineOSConfig infra in pool infra with pullSecret cloned-basepull-secret-d2me8n0s pushSecret cloned-push-secretfzotpnpa and pushSpec image-registry.openshift-image-registry.svc:5000/openshift-machine-config-operator/ocb-infra-image:latest
 Sep  4 10:55:45.187: INFO: Using custom Containerfile [{"content":"FROM alpine:3.18\nRUN apt update \u0026\u0026 apt install -y cowsay\n"}]
 I0904 10:55:48.189233  333525 client.go:742] showInfo is true
 I0904 10:55:48.189286  333525 client.go:744] Running 'oc --namespace=e2e-test-mco-ocb-longduration-sgjvf --kubeconfig=/tmp/422ocb process --ignore-unknown-parameters=true -f /tmp/fixture-testdata-dir2013934403/generic-machine-os-config.yaml -p NAME=infra POOL=infra RENDEREDIMAGEPUSHSECRET=cloned-push-secretfzotpnpa PUSHSPEC=image-registry.openshift-image-registry.svc:5000/openshift-machine-config-operator/ocb-infra-image:latest BASEIMAGEPULLSECRET=cloned-basepull-secret-d2me8n0s CONTAINERFILE=[{"content":"FROM alpine:3.18\nRUN apt update \u0026\u0026 apt install -y cowsay\n"}]'
 I0904 10:55:48.344437  333525 template.go:66] the file of resource is /tmp/e2e-test-mco-ocb-longduration-sgjvf-kl4cgaldconfig.json.stdout
 I0904 10:55:48.344512  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb create -f /tmp/e2e-test-mco-ocb-longduration-sgjvf-kl4cgaldconfig.json.stdout'
 machineosconfig.machineconfiguration.openshift.io/infra created
 Sep  4 10:55:48.500: INFO: OK!

   STEP: Verify MOSB is created and fails @ 09/04/26 10:55:48.5
 I0904 10:55:48.500163  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get machineosconfig infra -o jsonpath={.metadata.annotations.machineconfiguration\.openshift\.io/current-machine-os-build}'
 I0904 10:56:08.663436  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get machineosconfig infra -o jsonpath={.metadata.annotations.machineconfiguration\.openshift\.io/current-machine-os-build}'
 I0904 10:56:08.815177  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get machineosbuild infra-ffa445ea2ccb4a6cd3fe78d99ca215a2 -o jsonpath={.}'
 I0904 10:56:08.970336  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get machineosconfig infra -o jsonpath={.metadata.annotations.machineconfiguration\.openshift\.io/current-machine-os-build}'
 Sep  4 10:56:09.118: INFO: MOSB created: infra-ffa445ea2ccb4a6cd3fe78d99ca215a2

 I0904 10:56:09.118292  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get machineosbuild infra-ffa445ea2ccb4a6cd3fe78d99ca215a2 -o jsonpath={.status.conditions[?(@.type=="Failed")]}'
 Sep  4 10:56:09.264: INFO: Value: False
 I0904 10:56:29.269872  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get machineosbuild infra-ffa445ea2ccb4a6cd3fe78d99ca215a2 -o jsonpath={.status.conditions[?(@.type=="Failed")]}'
 Sep  4 10:56:29.423: INFO: Value: False
 I0904 10:56:49.424519  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get machineosbuild infra-ffa445ea2ccb4a6cd3fe78d99ca215a2 -o jsonpath={.status.conditions[?(@.type=="Failed")]}'
 Sep  4 10:56:49.572: INFO: Value: False
 I0904 10:57:09.573265  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get machineosbuild infra-ffa445ea2ccb4a6cd3fe78d99ca215a2 -o jsonpath={.status.conditions[?(@.type=="Failed")]}'
 Sep  4 10:57:09.733: INFO: Value: False
 I0904 10:57:29.737970  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get machineosbuild infra-ffa445ea2ccb4a6cd3fe78d99ca215a2 -o jsonpath={.status.conditions[?(@.type=="Failed")]}'
 Sep  4 10:57:29.924: INFO: Value: True
 I0904 10:57:29.924875  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get machineosbuild infra-ffa445ea2ccb4a6cd3fe78d99ca215a2 -o jsonpath={.status.conditions[?(@.type=="Failed")]}'
 Sep  4 10:57:30.071: INFO: Value: Job "build-infra-ffa445ea2ccb4a6cd3fe78d99ca215a2" failed after 4 attempt(s): Job has reached the specified backoff limit
 Sep  4 10:57:30.071: INFO: MOSB failed as expected

   STEP: Verify MCP is degraded with ImageBuildDegraded condition @ 09/04/26 10:57:30.071
 I0904 10:57:30.071792  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get mcp infra -o jsonpath={.status.conditions[?(@.type=="Degraded")]}'
 Sep  4 10:57:30.223: INFO: Value: True
 I0904 10:57:30.223432  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get mcp infra -o jsonpath={.status.conditions[?(@.type=="ImageBuildDegraded")]}'
 Sep  4 10:57:30.372: INFO: Value: True
 I0904 10:57:30.372809  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get mcp infra -o jsonpath={.status.conditions[?(@.type=="ImageBuildDegraded")]}'
 Sep  4 10:57:30.529: INFO: Value: Failed to build OS image for pool infra (MachineOSBuild: infra-ffa445ea2ccb4a6cd3fe78d99ca215a2): BackoffLimitExceeded: Job "build-infra-ffa445ea2ccb4a6cd3fe78d99ca215a2" failed after 4 attempt(s): Job has reached the specified backoff limit
 I0904 10:57:30.529752  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get mcp infra -o jsonpath={.status.conditions[?(@.type=="Degraded")]}'
 Sep  4 10:57:30.670: INFO: Value: Custom OS image build failed
 Sep  4 10:57:30.670: INFO: OK!

   STEP: Fix the MOSC by updating containerfile @ 09/04/26 10:57:30.67
 I0904 10:57:30.670656  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb patch machineosconfig infra --type json -p [{"op": "replace", "path": "/spec/containerFile", "value":  [{"content":"FROM configs AS final\nRUN echo \"hello\" \u003e /etc/test.txt\n"}]}]'
 Sep  4 10:57:30.856: INFO: OK!

   STEP: Verify new MOSB is created and succeeds @ 09/04/26 10:57:30.856
 Sep  4 10:57:30.856: INFO: Current mosb: <Kind: machineosbuild, Name: infra-ffa445ea2ccb4a6cd3fe78d99ca215a2, Namespace: >
 I0904 10:57:30.857009  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get machineosconfig infra -o jsonpath={.metadata.annotations.machineconfiguration\.openshift\.io/current-machine-os-build}'
 I0904 10:57:51.030691  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get machineosconfig infra -o jsonpath={.metadata.annotations.machineconfiguration\.openshift\.io/current-machine-os-build}'
 Sep  4 10:57:51.179: INFO: New mosb: <Kind: machineosbuild, Name: infra-70b896756e1c3cd3dc7749a017795729, Namespace: >
 I0904 10:57:51.179741  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get machineosbuild infra-70b896756e1c3cd3dc7749a017795729 -o jsonpath={.status.conditions[?(@.type=="Building")]}'
 Sep  4 10:57:51.338: INFO: Value: True
 I0904 10:57:51.338333  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get machineosbuild infra-70b896756e1c3cd3dc7749a017795729 -o jsonpath={.status.conditions[?(@.type=="Building")]}'
 Sep  4 10:57:51.487: INFO: Value: True
 I0904 10:58:11.505807  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get machineosbuild infra-70b896756e1c3cd3dc7749a017795729 -o jsonpath={.status.conditions[?(@.type=="Building")]}'
 Sep  4 10:58:11.650: INFO: Value: True
 I0904 10:58:31.664890  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get machineosbuild infra-70b896756e1c3cd3dc7749a017795729 -o jsonpath={.status.conditions[?(@.type=="Building")]}'
 Sep  4 10:58:31.816: INFO: Value: True
 I0904 10:58:51.834131  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get machineosbuild infra-70b896756e1c3cd3dc7749a017795729 -o jsonpath={.status.conditions[?(@.type=="Building")]}'
 Sep  4 10:58:51.987: INFO: Value: True
 I0904 10:59:11.987441  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get machineosbuild infra-70b896756e1c3cd3dc7749a017795729 -o jsonpath={.status.conditions[?(@.type=="Building")]}'
 Sep  4 10:59:12.127: INFO: Value: True
 I0904 10:59:32.146670  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get machineosbuild infra-70b896756e1c3cd3dc7749a017795729 -o jsonpath={.status.conditions[?(@.type=="Building")]}'
 Sep  4 10:59:32.300: INFO: Value: True
 I0904 10:59:52.316226  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get machineosbuild infra-70b896756e1c3cd3dc7749a017795729 -o jsonpath={.status.conditions[?(@.type=="Building")]}'
 Sep  4 10:59:52.463: INFO: Value: True
 I0904 11:00:12.481876  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get machineosbuild infra-70b896756e1c3cd3dc7749a017795729 -o jsonpath={.status.conditions[?(@.type=="Building")]}'
 Sep  4 11:00:12.629: INFO: Value: True
 I0904 11:00:32.647032  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get machineosbuild infra-70b896756e1c3cd3dc7749a017795729 -o jsonpath={.status.conditions[?(@.type=="Building")]}'
 Sep  4 11:00:32.800: INFO: Value: True
 I0904 11:00:52.810291  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get machineosbuild infra-70b896756e1c3cd3dc7749a017795729 -o jsonpath={.status.conditions[?(@.type=="Building")]}'
 Sep  4 11:00:53.006: INFO: Value: True
 I0904 11:01:13.006752  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get machineosbuild infra-70b896756e1c3cd3dc7749a017795729 -o jsonpath={.status.conditions[?(@.type=="Building")]}'
 Sep  4 11:01:13.155: INFO: Value: True
 I0904 11:01:33.161781  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get machineosbuild infra-70b896756e1c3cd3dc7749a017795729 -o jsonpath={.status.conditions[?(@.type=="Building")]}'
 Sep  4 11:01:33.340: INFO: Value: True
 I0904 11:01:53.360093  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get machineosbuild infra-70b896756e1c3cd3dc7749a017795729 -o jsonpath={.status.conditions[?(@.type=="Building")]}'
 Sep  4 11:01:53.511: INFO: Value: True
 I0904 11:02:13.514054  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get machineosbuild infra-70b896756e1c3cd3dc7749a017795729 -o jsonpath={.status.conditions[?(@.type=="Building")]}'
 Sep  4 11:02:13.663: INFO: Value: True
 I0904 11:02:33.670630  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get machineosbuild infra-70b896756e1c3cd3dc7749a017795729 -o jsonpath={.status.conditions[?(@.type=="Building")]}'
 Sep  4 11:02:33.825: INFO: Value: True
 I0904 11:02:53.827741  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get machineosbuild infra-70b896756e1c3cd3dc7749a017795729 -o jsonpath={.status.conditions[?(@.type=="Building")]}'
 Sep  4 11:02:53.988: INFO: Value: True
 I0904 11:03:13.989194  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get machineosbuild infra-70b896756e1c3cd3dc7749a017795729 -o jsonpath={.status.conditions[?(@.type=="Building")]}'
 Sep  4 11:03:14.138: INFO: Value: True
 I0904 11:03:34.147412  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get machineosbuild infra-70b896756e1c3cd3dc7749a017795729 -o jsonpath={.status.conditions[?(@.type=="Building")]}'
 Sep  4 11:03:34.304: INFO: Value: True
 I0904 11:03:54.323497  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get machineosbuild infra-70b896756e1c3cd3dc7749a017795729 -o jsonpath={.status.conditions[?(@.type=="Building")]}'
 Sep  4 11:03:54.476: INFO: Value: True
 I0904 11:04:14.494960  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get machineosbuild infra-70b896756e1c3cd3dc7749a017795729 -o jsonpath={.status.conditions[?(@.type=="Building")]}'
 Sep  4 11:04:14.652: INFO: Value: True
 I0904 11:04:34.667314  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get machineosbuild infra-70b896756e1c3cd3dc7749a017795729 -o jsonpath={.status.conditions[?(@.type=="Building")]}'
 Sep  4 11:04:34.816: INFO: Value: False
 I0904 11:04:34.816580  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get machineosbuild infra-70b896756e1c3cd3dc7749a017795729 -o jsonpath={.status.conditions[?(@.type=="Succeeded")]}'
 Sep  4 11:04:34.963: INFO: Value: True
 I0904 11:04:34.963738  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get machineosbuild infra-70b896756e1c3cd3dc7749a017795729 -o jsonpath={.status.conditions[?(@.type=="Interrupted")]}'
 Sep  4 11:04:35.112: INFO: Value: False
 I0904 11:04:35.112485  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get machineosbuild infra-70b896756e1c3cd3dc7749a017795729 -o jsonpath={.status.conditions[?(@.type=="Failed")]}'
 Sep  4 11:04:35.274: INFO: Value: False
 I0904 11:04:35.274519  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get machineosconfig infra -o jsonpath={.metadata.annotations.machineconfiguration\.openshift\.io/current-machine-os-build}'
 Sep  4 11:04:35.425: INFO: New MOSB created: infra-70b896756e1c3cd3dc7749a017795729

   STEP: Verify old failed MOSB is deleted @ 09/04/26 11:04:35.425
 I0904 11:04:35.425182  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get machineosbuild infra-ffa445ea2ccb4a6cd3fe78d99ca215a2 -o jsonpath={.}'
 I0904 11:04:35.574921  333525 client.go:726] Error running /home/fedora/OCP_envs/5.0/oc --kubeconfig=/tmp/422ocb get machineosbuild infra-ffa445ea2ccb4a6cd3fe78d99ca215a2 -o jsonpath={.}:
 Error from server (NotFound): machineosbuilds.machineconfiguration.openshift.io "infra-ffa445ea2ccb4a6cd3fe78d99ca215a2" not found
 Sep  4 11:04:35.574: INFO: OK!

   STEP: Verify MCP recovers and is no longer degraded @ 09/04/26 11:04:35.575
 I0904 11:04:35.575054  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get mcp infra -o jsonpath={.status.conditions[?(@.type=="ImageBuildDegraded")]}'
 Sep  4 11:04:35.722: INFO: Value: False
 I0904 11:04:35.722127  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get mcp infra -o jsonpath={.status.conditions[?(@.type=="Degraded")]}'
 Sep  4 11:04:35.873: INFO: Value: False
 I0904 11:04:35.873606  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get mcp infra -o jsonpath={.status.conditions[?(@.type=="Updating")]}'
 Sep  4 11:04:36.025: INFO: Value: True
 Sep  4 11:04:36.025: INFO: OK!

   STEP: Wait for MCP to complete update @ 09/04/26 11:04:36.025
 I0904 11:04:36.025355  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get mcp infra -o jsonpath={.status.machineCount}'
 Sep  4 11:04:36.180: INFO: Num nodes: 1, wait time per node 13 minutes
 Sep  4 11:04:36.382: INFO: Waiting 13m0s for MCP infra to be completed.
 I0904 11:05:36.383319  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get mcp infra -o jsonpath={.status.degradedMachineCount}'
 I0904 11:05:36.525476  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get mcp infra -o jsonpath={.status.conditions[?(@.type=="Degraded")].status}'
 I0904 11:05:36.676537  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get mcp infra -o jsonpath={.status.conditions[?(@.type=="Updated")].status}'
 I0904 11:06:36.407658  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get mcp infra -o jsonpath={.status.degradedMachineCount}'
 I0904 11:06:36.560946  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get mcp infra -o jsonpath={.status.conditions[?(@.type=="Degraded")].status}'
 I0904 11:06:36.721419  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get mcp infra -o jsonpath={.status.conditions[?(@.type=="Updated")].status}'
 I0904 11:07:36.390003  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get mcp infra -o jsonpath={.status.degradedMachineCount}'
 I0904 11:07:36.535753  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get mcp infra -o jsonpath={.status.conditions[?(@.type=="Degraded")].status}'
 I0904 11:07:36.686712  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get mcp infra -o jsonpath={.status.conditions[?(@.type=="Updated")].status}'
 Sep  4 11:07:36.838: INFO: The new MC has been successfully applied to MCP 'infra'
 Sep  4 11:07:36.838: INFO: OK!

   STEP: Verify image is applied to node @ 09/04/26 11:07:36.838
 I0904 11:07:36.838925  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get machineosconfig infra -o jsonpath={.status.currentImagePullSpec}'
 I0904 11:07:37.166635  333525 client.go:742] showInfo is true
 I0904 11:07:37.166672  333525 client.go:744] Running 'oc --namespace=e2e-test-mco-ocb-longduration-sgjvf --kubeconfig=/tmp/422ocb debug node/ip-10-0-11-233.us-east-2.compute.internal -- chroot /host rpm-ostree status --json'
 Sep  4 11:07:44.841: INFO: Current booted container-image-reference: "ostree-unverified-registry:image-registry.openshift-image-registry.svc:5000/openshift-machine-config-operator/ocb-infra-image@sha256:68c4ce8c129a167f1cc78f988d638a2df0268d1ac7d989bb9fbb07815ee57521"
 Sep  4 11:07:44.841: INFO: Booted image: image-registry.openshift-image-registry.svc:5000/openshift-machine-config-operator/ocb-infra-image@sha256:68c4ce8c129a167f1cc78f988d638a2df0268d1ac7d989bb9fbb07815ee57521
 Sep  4 11:07:44.841: INFO: Node is using image: image-registry.openshift-image-registry.svc:5000/openshift-machine-config-operator/ocb-infra-image@sha256:68c4ce8c129a167f1cc78f988d638a2df0268d1ac7d989bb9fbb07815ee57521

 Sep  4 11:07:44.841: INFO: OK!

   STEP: Verify file created in containerfile exists on node @ 09/04/26 11:07:44.841
 I0904 11:07:45.149496  333525 client.go:742] showInfo is false
 Sep  4 11:07:46.834: INFO: OK!

 I0904 11:07:46.834568  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get machineosconfig infra -o jsonpath={.}'
 I0904 11:07:46.980551  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get machineosconfig infra -o jsonpath={.spec.baseImagePullSecret.name}'
 I0904 11:07:47.131167  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get -n openshift-machine-config-operator secret cloned-basepull-secret-d2me8n0s -o jsonpath={.}'
 I0904 11:07:47.301867  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get -n openshift-machine-config-operator secret cloned-basepull-secret-d2me8n0s -o jsonpath={.metadata.ownerReferences[0]}'
 I0904 11:07:47.472487  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb delete -n openshift-machine-config-operator secret cloned-basepull-secret-d2me8n0s'
 I0904 11:07:47.668078  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get machineosconfig infra -o jsonpath={.spec.renderedImagePushSecret.name}'
 I0904 11:07:47.824292  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get -n openshift-machine-config-operator secret cloned-push-secretfzotpnpa -o jsonpath={.}'
 I0904 11:07:47.965591  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get -n openshift-machine-config-operator secret cloned-push-secretfzotpnpa -o jsonpath={.metadata.ownerReferences[0]}'
 I0904 11:07:48.122482  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb delete -n openshift-machine-config-operator secret cloned-push-secretfzotpnpa'
 I0904 11:07:48.299774  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb delete machineosconfig infra'
 I0904 11:07:48.466998  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get mcp infra -o jsonpath={.}'
   STEP: Removing custom MCP infra @ 09/04/26 11:07:48.61
 Sep  4 11:07:50.754: INFO: Removing pool label from node ip-10-0-11-233.us-east-2.compute.internal
 I0904 11:07:50.754882  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb label node ip-10-0-11-233.us-east-2.compute.internal node-role.kubernetes.io/infra-'
 node/ip-10-0-11-233.us-east-2.compute.internal unlabeled
 Sep  4 11:07:50.956: INFO: Waiting for label node-role.kubernetes.io/infra to be removed from node ip-10-0-11-233.us-east-2.compute.internal
 I0904 11:07:50.956912  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get node ip-10-0-11-233.us-east-2.compute.internal -o jsonpath={.metadata.labels}'
 Sep  4 11:07:51.113: INFO: Label null has been removed from node ip-10-0-11-233.us-east-2.compute.internal
 Sep  4 11:07:51.113: INFO: Waiting 5m0s for MCP infra to report 0 machine count.
 I0904 11:07:51.113864  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get mcp infra -o jsonpath={.status.machineCount}'
 Sep  4 11:07:51.264: INFO: Expected machine count 0. Reported machine count 1
 I0904 11:08:21.143350  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get mcp infra -o jsonpath={.status.machineCount}'
 Sep  4 11:08:21.292: INFO: MCP is reporting 0 machine count
 I0904 11:08:21.292435  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get mcp worker -o jsonpath={.status.machineCount}'
 Sep  4 11:08:21.444: INFO: Num nodes: 2, wait time per node 13 minutes
 Sep  4 11:08:21.444: INFO: Waiting 26m0s for MCP worker to be completed.
 I0904 11:09:21.500732  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get mcp worker -o jsonpath={.status.degradedMachineCount}'
 I0904 11:09:21.652719  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get mcp worker -o jsonpath={.status.conditions[?(@.type=="Degraded")].status}'
 I0904 11:09:21.811158  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get mcp worker -o jsonpath={.status.conditions[?(@.type=="Updated")].status}'
 I0904 11:10:21.445356  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get mcp worker -o jsonpath={.status.degradedMachineCount}'
 I0904 11:10:21.594839  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get mcp worker -o jsonpath={.status.conditions[?(@.type=="Degraded")].status}'
 I0904 11:10:21.742760  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get mcp worker -o jsonpath={.status.conditions[?(@.type=="Updated")].status}'
 I0904 11:11:21.503699  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get mcp worker -o jsonpath={.status.degradedMachineCount}'
 I0904 11:11:21.648325  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get mcp worker -o jsonpath={.status.conditions[?(@.type=="Degraded")].status}'
 I0904 11:11:21.802927  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb get mcp worker -o jsonpath={.status.conditions[?(@.type=="Updated")].status}'
 Sep  4 11:11:21.954: INFO: The new MC has been successfully applied to MCP 'worker'
 I0904 11:11:21.954275  333525 client.go:717] Running 'oc --kubeconfig=/tmp/422ocb delete mcp infra'
 I0904 11:11:22.222379  333525 client.go:420] Deleted {user.openshift.io/v1, Resource=users  e2e-test-mco-ocb-longduration-sgjvf-user}, err: <nil>
 I0904 11:11:22.254920  333525 client.go:420] Deleted {oauth.openshift.io/v1, Resource=oauthclients  e2e-client-e2e-test-mco-ocb-longduration-sgjvf}, err: <nil>
 I0904 11:11:22.287454  333525 client.go:420] Deleted {oauth.openshift.io/v1, Resource=oauthaccesstokens  sha256~HJskJhfDRZ_HlzUa-zj-qPVsiJbz7jVSNHRlUxbUSXs}, err: <nil>
   STEP: Destroying namespace "e2e-test-mco-ocb-longduration-sgjvf" for this suite. @ 09/04/26 11:11:22.287
 • [989.942 seconds]
 ------------------------------
 [ReportAfterSuite] [sig-testing] Log Check
 /home/fedora/Workspace/machine-config-operator/vendor/k8s.io/kubernetes/test/e2e/invariants/logcheck/logcheck.go:179
 [ReportAfterSuite] PASSED [0.000 seconds]

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

@openshift-ci-robot

Copy link
Copy Markdown
Contributor

@sergiordlr: This pull request explicitly references no jira issue.

Details

In response to this:

- What I did

Check MOSB Failed message in test case 85980

After https://redhat.atlassian.net/browse/OCPBUGS-112465 when a MOSB fails it reports the failure message in the Failed condition.

- How to verify it

Test 85980 checks the failed message and passes

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

@ptalgulk01

Copy link
Copy Markdown
Contributor

/lgtm

@openshift-ci openshift-ci Bot added the lgtm Indicates that a PR is ready to be merged. label Sep 4, 2026
@openshift-ci

openshift-ci Bot commented Sep 4, 2026

Copy link
Copy Markdown
Contributor

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: ptalgulk01, sergiordlr

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Details Needs approval from an approver in each of these files:
  • OWNERS [ptalgulk01,sergiordlr]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@sergiordlr

Copy link
Copy Markdown
Contributor Author

/test bootstrap-unit

@openshift-ci

openshift-ci Bot commented Sep 4, 2026

Copy link
Copy Markdown
Contributor

@sergiordlr: all tests passed!

Full PR test history. Your PR dashboard.

Details

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. I understand the commands that are listed here.

@openshift-merge-bot
openshift-merge-bot Bot merged commit 21c9a22 into openshift:main Sep 4, 2026
9 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

approved Indicates a PR has been approved by an approver from all required OWNERS files. jira/valid-reference Indicates that this PR references a valid Jira ticket of any type. lgtm Indicates that a PR is ready to be merged. verified Signifies that the PR passed pre-merge verification criteria

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants