Bug 1982001: Bump RHCOS 4.8 boot image #5227

mike-nguyen · 2021-09-17T17:54:36Z

This updates the RHCOS boot image metadata in the installer with the
most recent version of RHCOS 4.8 artifacts.

This includes fixes for the following BZs:
2000696 - RHCOS live ISO can fail to boot in UEFI mode; drops to grub shell
1984086 - Installation with multipath parameters in parmfile fails (DNS resolution missing)
1983773 - coreos-installer fails to download Ignition (DNS error, failed to lookup address)
1982002 - On a Azure IPI installation MCO fails to create new nodes
2004677 - Boot option recovery menu prevents image boot
2004716 - Inexplicably slow kubelet on bootstrap makes installation fail
2007090 - Intermittent failure mounting /run/media/iso when booting live ISO from USB stick

ppc64le=48.84.202109242319-0
s390x=48.84.202109242319-0
x86_64=48.84.202109241901-0

openshift-ci · 2021-09-17T17:54:41Z

@mike-nguyen: This pull request references Bugzilla bug 1982001, which is invalid:

expected dependent Bugzilla bug 1981999 to be in one of the following states: VERIFIED, RELEASE_PENDING, CLOSED (ERRATA), CLOSED (CURRENTRELEASE), but it is POST instead
expected dependent Bugzilla bug 2004716 to be in one of the following states: VERIFIED, RELEASE_PENDING, CLOSED (ERRATA), CLOSED (CURRENTRELEASE), but it is NEW instead
expected dependent Bugzilla bug 2004716 to target a release in 4.9.0, but it targets "4.8.z" instead

Comment /bugzilla refresh to re-evaluate validity if changes to the Bugzilla bug are made, or edit the title of this pull request to link to a different bug.

In response to this:

Bug 1982001: Bump RHCOS 4.8 boot image

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

openshift-ci · 2021-09-17T18:05:30Z

@mike-nguyen: This pull request references Bugzilla bug 1982001, which is invalid:

expected dependent Bugzilla bug 1981999 to be in one of the following states: VERIFIED, RELEASE_PENDING, CLOSED (ERRATA), CLOSED (CURRENTRELEASE), but it is POST instead
expected dependent Bugzilla bug 2004716 to be in one of the following states: VERIFIED, RELEASE_PENDING, CLOSED (ERRATA), CLOSED (CURRENTRELEASE), but it is NEW instead
expected dependent Bugzilla bug 2004716 to target a release in 4.9.0, but it targets "4.8.z" instead

Comment /bugzilla refresh to re-evaluate validity if changes to the Bugzilla bug are made, or edit the title of this pull request to link to a different bug.

In response to this:

Bug 1982001: Bump RHCOS 4.8 boot image

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

bgilbert · 2021-09-17T18:47:12Z

/bugzilla refresh

openshift-ci · 2021-09-17T18:47:16Z

@bgilbert: This pull request references Bugzilla bug 1982001, which is invalid:

expected dependent Bugzilla bug 1981999 to be in one of the following states: VERIFIED, RELEASE_PENDING, CLOSED (ERRATA), CLOSED (CURRENTRELEASE), but it is POST instead

Comment /bugzilla refresh to re-evaluate validity if changes to the Bugzilla bug are made, or edit the title of this pull request to link to a different bug.

In response to this:

/bugzilla refresh

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

bgilbert · 2021-09-17T18:49:36Z

Per consensus, we're intentionally landing this bump before the corresponding 4.9 bump, which is blocked on a regression. We'll need an override for the Bugzilla check.

ashcrow · 2021-09-20T13:12:07Z

Overriding BZ check since this is expected to land before going into later boot image bumps.

mike-nguyen · 2021-09-20T13:22:02Z

/retest

mike-nguyen · 2021-09-20T20:35:46Z

/retest

mike-nguyen · 2021-09-20T20:43:13Z

/retest

mike-nguyen · 2021-09-21T12:52:16Z

/retest

mike-nguyen · 2021-09-21T14:37:30Z

/retest

sdodson · 2021-09-21T18:28:01Z

/test e2e-gcp
/test e2e-vsphere

sdodson · 2021-09-21T18:36:13Z

/test e2e-gcp
/test e2e-vsphere

mike-nguyen · 2021-09-22T02:00:30Z

/retest

mike-nguyen · 2021-09-22T12:36:27Z

It looks like all the installer PR CI tests are failing due to missing images. The possible fix may be here: openshift/release#22103

mike-nguyen · 2021-09-22T14:48:35Z

/retest

mike-nguyen · 2021-09-22T18:41:33Z

/retest

openshift-ci · 2021-09-22T20:27:54Z

@mike-nguyen: This pull request references Bugzilla bug 1982001, which is invalid:

expected dependent Bugzilla bug 1981999 to be in one of the following states: VERIFIED, RELEASE_PENDING, CLOSED (ERRATA), CLOSED (CURRENTRELEASE), but it is MODIFIED instead

Comment /bugzilla refresh to re-evaluate validity if changes to the Bugzilla bug are made, or edit the title of this pull request to link to a different bug.

Retaining the bugzilla/valid-bug label as it was manually added.

In response to this:

Bug 1982001: Bump RHCOS 4.8 boot image

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

mike-nguyen · 2021-09-23T01:15:02Z

/test e2e-openstack-kuryr

sdodson · 2021-09-23T01:34:38Z

/test e2e-gcp
/test e2e-vsphere
/test e2e-metal

mike-nguyen · 2021-09-23T11:43:33Z

/test e2e-vsphere
/test e2e-metal
/test e2e-openstack-kuryr

sdodson · 2021-09-23T12:38:37Z

/lgtm
/approve
Looks like the e2e-metal job is broken and needs to be fixed.
Everything else has passed.

mike-nguyen · 2021-09-23T18:10:47Z

/test e2e-libvirt

sdodson · 2021-09-23T18:12:56Z

/override ci/prow/e2e-libvirt
@mike-nguyen The installation for libvirt is successful. I'm not worried about the test passing, we're just waiting for patch manager approval now.

openshift-ci · 2021-09-23T18:12:59Z

@sdodson: Overrode contexts on behalf of sdodson: ci/prow/e2e-libvirt

In response to this:

/override ci/prow/e2e-libvirt
@mike-nguyen The installation for libvirt is successful. I'm not worried about the test passing, we're just waiting for patch manager approval now.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

openshift-bot · 2021-09-23T18:56:08Z

/retest-required

Please review the full test history for this PR and help us cut down flakes.

miabbott · 2021-09-23T19:33:21Z

/hold

We found a regression that can affect bare metal customers booting from external media

https://bugzilla.redhat.com/show_bug.cgi?id=2007085

We have a fix in flight and will generate new boot images ASAP

sdodson · 2021-09-23T19:40:46Z

/lgtm cancel

dhellmann · 2021-09-23T19:58:11Z

[patch-manager] ⌛ This pull request was not picked by the patch manager for the current z-stream window and have to wait for the next window.

skipped for today

Score: 0.20
Reason: skipping because "do-not-merge/hold" label found

NOTE: This message was automatically generated, if you have questions please ask on #forum-release

This updates the RHCOS boot image metadata in the installer with the most recent version of RHCOS 4.8 artifacts. This includes fixes for the following BZs: 2000696 - RHCOS live ISO can fail to boot in UEFI mode; drops to grub shell 1984086 - Installation with multipath parameters in parmfile fails (DNS resolution missing) 1983773 - coreos-installer fails to download Ignition (DNS error, failed to lookup address) 1982002 - On a Azure IPI installation MCO fails to create new nodes 2004677 - Boot option recovery menu prevents image boot 2004716 - Inexplicably slow kubelet on bootstrap makes installation fail 2007090 - Intermittent failure mounting /run/media/iso when booting live ISO from USB stick ppc64le=48.84.202109242319-0 s390x=48.84.202109242319-0 x86_64=48.84.202109241901-0

openshift-ci · 2021-09-27T13:30:38Z

@mike-nguyen: This pull request references Bugzilla bug 1982001, which is valid.

6 validation(s) were run on this bug

bug is open, matching expected state (open)
bug target release (4.8.z) matches configured target release for branch (4.8.z)
bug is in the state POST, which is one of the valid states (NEW, ASSIGNED, ON_DEV, POST, POST)
dependent bug Bugzilla bug 1981999 is in the state VERIFIED, which is one of the valid states (VERIFIED, RELEASE_PENDING, CLOSED (ERRATA), CLOSED (CURRENTRELEASE))
dependent Bugzilla bug 1981999 targets the "4.9.0" release, which is one of the valid target releases: 4.9.0
bug has dependents

Requesting review from QA contact:
/cc @HuijingHei

In response to this:

Bug 1982001: Bump RHCOS 4.8 boot image

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

mike-nguyen · 2021-09-27T13:32:40Z

Updated the boot image with the fix for https://bugzilla.redhat.com/show_bug.cgi?id=2007090. This should be ready when the CI passes.

miabbott · 2021-09-27T18:02:03Z

/hold cancel

miabbott · 2021-09-27T20:02:04Z

/test e2e-gcp

miabbott · 2021-09-27T20:02:49Z

Going to retry e2e-aws-upgrade, but it looks like the OS + API server came up, but some operators didn't roll out

time="2021-09-27T13:50:36Z" level=debug msg="Apply complete! Resources: 126 added, 0 changed, 0 destroyed."
time="2021-09-27T13:50:36Z" level=debug msg="OpenShift Installer unreleased-master-4685-g3d6ad281b466757e133263b08eb690ccf4743a5e-dirty"
time="2021-09-27T13:50:36Z" level=debug msg="Built from commit 3d6ad281b466757e133263b08eb690ccf4743a5e"
time="2021-09-27T13:50:36Z" level=info msg="Waiting up to 20m0s for the Kubernetes API at https://api.ci-op-5xt2t0f5-b9fb5.origin-ci-int-aws.dev.rhcloud.com:6443..."
time="2021-09-27T13:50:36Z" level=info msg="API v1.21.2-1503+a620f506e95653-dirty up"
time="2021-09-27T13:50:36Z" level=info msg="Waiting up to 30m0s for bootstrapping to complete..."

/test e2e-aws-upgrade

miabbott · 2021-09-27T20:03:01Z

/test e2e-vsphere

openshift-ci · 2021-09-27T21:26:19Z

@mike-nguyen: The following tests failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name	Commit	Details	Required	Rerun command
ci/prow/e2e-metal	`ec45ec2`	link	false	`/test e2e-metal`
ci/prow/e2e-libvirt	`a8d6a2b`	link	false	`/test e2e-libvirt`
ci/prow/e2e-vsphere	`a8d6a2b`	link	false	`/test e2e-vsphere`

Full PR test history. Your PR dashboard.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

mike-nguyen · 2021-09-27T22:50:37Z

/test e2e-gcp

sdodson · 2021-09-28T14:01:53Z

/lgtm

openshift-ci · 2021-09-28T14:03:22Z

@mike-nguyen: All pull requests linked via external trackers have merged:

openshift/installer#5227

Bugzilla bug 1982001 has been moved to the MODIFIED state.

In response to this:

Bug 1982001: Bump RHCOS 4.8 boot image

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

gpei · 2021-09-29T09:32:34Z

Do we want to update the other standalone boot image spec files as well?
data/data/rhcos-aarch64.json
data/data/rhcos-amd64.json
data/data/rhcos-ppc64le.json
data/data/rhcos-s390x.json
data/data/rhcos.json
They're not consistent with the data/data/rhcos-stream.jsonfile now.

bgilbert · 2021-09-29T16:30:08Z

Thanks for pointing that out. In a discussion with @cgwalters and @miabbott, we concluded that the inconsistency has no serious consequences. We're going to defer a fix for now, but are tracking the issue in BZ 2009000.

This updates the "legacy" RHCOS boot image metadata to match what is contained in the stream metadata in `data/data/rhcos-stream.json`. Note: this does not touch `data/data/rhcos-aarch64.json` as it already matches the stream metadata and was not updated as part of openshift#5227

openshift-ci bot added the bugzilla/severity-medium Referenced Bugzilla bug's severity is medium for the branch this PR is targeting. label Sep 17, 2021

openshift-ci bot added the bugzilla/invalid-bug Indicates that a referenced Bugzilla bug is invalid for the branch this PR is targeting. label Sep 17, 2021

openshift-ci bot requested review from e-tienne and jhixson74 September 17, 2021 17:55

mike-nguyen force-pushed the boot_image_48 branch from b0fd617 to 6a867fd Compare September 17, 2021 18:04

ashcrow added bugzilla/valid-bug Indicates that a referenced Bugzilla bug is valid for the branch this PR is targeting. and removed bugzilla/invalid-bug Indicates that a referenced Bugzilla bug is invalid for the branch this PR is targeting. labels Sep 20, 2021

mike-nguyen force-pushed the boot_image_48 branch from 6a867fd to ec45ec2 Compare September 22, 2021 20:29

openshift-ci bot added the do-not-merge/hold Indicates that a PR should not merge because someone has issued a /hold command. label Sep 23, 2021

openshift-ci bot removed the lgtm Indicates that a PR is ready to be merged. label Sep 23, 2021

mike-nguyen force-pushed the boot_image_48 branch from ec45ec2 to a8d6a2b Compare September 27, 2021 13:28

openshift-ci bot requested a review from HuijingHei September 27, 2021 13:30

openshift-ci bot removed the do-not-merge/hold Indicates that a PR should not merge because someone has issued a /hold command. label Sep 27, 2021

sdodson added the cherry-pick-approved Indicates a cherry-pick PR into a release branch has been approved by the release branch manager. label Sep 28, 2021

openshift-ci bot added the lgtm Indicates that a PR is ready to be merged. label Sep 28, 2021

openshift-merge-robot merged commit be83b7f into openshift:release-4.8 Sep 28, 2021

miabbott mentioned this pull request Sep 29, 2021

Bug 2009019: update legacy RHCOS boot image metadata #5255

Merged

Bug 1982001: Bump RHCOS 4.8 boot image #5227

Bug 1982001: Bump RHCOS 4.8 boot image #5227

Conversation

mike-nguyen commented Sep 17, 2021 • edited

openshift-ci bot commented Sep 17, 2021

openshift-ci bot commented Sep 17, 2021

bgilbert commented Sep 17, 2021

openshift-ci bot commented Sep 17, 2021

bgilbert commented Sep 17, 2021

ashcrow commented Sep 20, 2021

mike-nguyen commented Sep 20, 2021

mike-nguyen commented Sep 20, 2021

mike-nguyen commented Sep 20, 2021

mike-nguyen commented Sep 21, 2021

mike-nguyen commented Sep 21, 2021

sdodson commented Sep 21, 2021

sdodson commented Sep 21, 2021

mike-nguyen commented Sep 22, 2021

mike-nguyen commented Sep 22, 2021 • edited

mike-nguyen commented Sep 22, 2021

mike-nguyen commented Sep 22, 2021

openshift-ci bot commented Sep 22, 2021

mike-nguyen commented Sep 23, 2021

sdodson commented Sep 23, 2021

mike-nguyen commented Sep 23, 2021

sdodson commented Sep 23, 2021

mike-nguyen commented Sep 23, 2021

sdodson commented Sep 23, 2021

openshift-ci bot commented Sep 23, 2021

openshift-bot commented Sep 23, 2021

miabbott commented Sep 23, 2021

sdodson commented Sep 23, 2021

dhellmann commented Sep 23, 2021

openshift-ci bot commented Sep 27, 2021

mike-nguyen commented Sep 27, 2021

miabbott commented Sep 27, 2021

miabbott commented Sep 27, 2021 • edited

miabbott commented Sep 27, 2021 • edited

miabbott commented Sep 27, 2021

openshift-ci bot commented Sep 27, 2021 • edited

mike-nguyen commented Sep 27, 2021

sdodson commented Sep 28, 2021

openshift-ci bot commented Sep 28, 2021

gpei commented Sep 29, 2021

bgilbert commented Sep 29, 2021

mike-nguyen commented Sep 17, 2021 •

edited

mike-nguyen commented Sep 22, 2021 •

edited

miabbott commented Sep 27, 2021 •

edited

miabbott commented Sep 27, 2021 •

edited

openshift-ci bot commented Sep 27, 2021 •

edited