Bug 1804284: Revert "RHCOS: bump to 44.81.202002071430-0"

[miabbott]

This reverts commit 5654e02.

Seeing reports via Slack that networking is not coming up properly on masters. This is preventing bare metal installs from completing successfully.

See: https://bugzilla.redhat.com/show_bug.cgi?id=1803926

NOTE: This is not a fix for the issue but a return to a previously working state for ipv4 usage on bare metal.

[hardys]

Thanks @miabbott - I've reproduced the issue and am attempting to get some clues as to what's going wrong - it seems the external network doesn't come up on the masters, so they get stuck trying to download the ignition config from the bootstrap VM - reverting to the previous image does solve that problem

[hardys]

I tested a modified image, and can confirm that just reverting the ignition_network_kcmdline to ip=dhcp does fix the problem on ipv4 - obviously we then still have issues with ipv6 (not yet tested the latest image in an ipv6 setup yet)

[miabbott]

/test e2e-metal
/test e2e-azure
/test e2e-vsphere
/test e2e-gcp

[ashcrow]

Makes sense to roll back for the moment ... but I'm a little confused as I would think this would have happened as well for "ipv4 only" based on the dracut documentation.

[ashcrow]

/test e2e-aws
/test e2e-ovirt

[ashcrow]

/retest

[sdodson]

/approve
/lgtm
/hold
Clear the hold when RHCOS folks are happy with this.

[openshift-ci-robot]

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: sdodson

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

• OWNERS [sdodson]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

[ashcrow]

could not wait for build: the build openstack-installer failed after 7m1s with reason PushImageToRegistryFailed: Failed to push the image to the registry.

[ashcrow]

/retest

[ashcrow]

level=fatal msg="failed to fetch Cluster: failed to generate asset \"Cluster\": failed to create cluster: failed to apply using Terraform"

and

Throttling: Rate exceeded\n\tstatus code: 400,

[eranco74]

Seems to work 👍

[sdodson]

Critical platforms have all passed, gcp, metal, aws. Azure is an e2e flake.
/bugzilla refresh
/hold cancel

[openshift-ci-robot]

@sdodson: No Bugzilla bug is referenced in the title of this pull request.
To reference a bug, add 'Bug XXX:' to the title of this pull request and request another bug refresh with /bugzilla refresh.

In response to this:

Critical platforms have all passed, gcp, metal, aws. Azure is an e2e flake.
/bugzilla refresh
/hold cancel

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

[sdodson]

/refresh

[openshift-bot]

/retest

Please review the full test history for this PR and help us cut down flakes.

[openshift-bot]

/retest

Please review the full test history for this PR and help us cut down flakes.

[ashcrow]

 level=fatal msg="Bootstrap failed to complete: failed to wait for bootstrapping to complete: timed out waiting for the condition" 

[sdodson]

@miabbott @ashcrow Can we get a bug for the reported problems?

[ashcrow]

failed to acquire lease: resources not found

[ashcrow]

@sdodson The original one or the large amount of CI issues? 😄 The former has a bug and we'll update the PR to denote it.

Updated 👍

[ashcrow]

level=info msg="Cluster operator kube-controller-manager Progressing is True with NodeInstaller: NodeInstallerProgressing: 2 nodes are at revision 0; 1 nodes are at revision 3; 0 nodes have achieved new revision 6"

[sdodson]

/bugzilla refresh

[openshift-ci-robot]

@sdodson: No Bugzilla bug is referenced in the title of this pull request.
To reference a bug, add 'Bug XXX:' to the title of this pull request and request another bug refresh with /bugzilla refresh.

In response to this:

/bugzilla refresh

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

[ashcrow]

/test e2e-ovirt
/test e2e-vsphere

[openshift-ci-robot]

@miabbott: This pull request references Bugzilla bug 1803926, which is valid. The bug has been moved to the POST state. The bug has been updated to refer to the pull request using the external bug tracker.

In response to this:

Bug 1803926: Revert "RHCOS: bump to 44.81.202002071430-0"

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

[openshift-ci-robot]

@miabbott: This pull request references Bugzilla bug 1803926, which is valid.

In response to this:

Bug 1803926: Revert "RHCOS: bump to 44.81.202002071430-0"

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

[ashcrow]

Eh sorry @sdodson, forgot the space.

[openshift-bot]

/retest

Please review the full test history for this PR and help us cut down flakes.

[miabbott]

Err...I don't think we want to link this PR to that BZ. Merging this PR doesn't fix the root cause of that BZ, which we want to get to.

I'm going to create a separate BZ to indicate we need to unblock CI and appease the BZ gods.

[miabbott]

/retitle Bug 1804284: Revert "RHCOS: bump to 44.81.202002071430-0"

[openshift-ci-robot]

@miabbott: This pull request references Bugzilla bug 1804284, which is valid. The bug has been moved to the POST state. The bug has been updated to refer to the pull request using the external bug tracker.

In response to this:

Bug 1804284: Revert "RHCOS: bump to 44.81.202002071430-0"

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

[openshift-ci-robot]

@miabbott: All pull requests linked via external trackers have merged. Bugzilla bug 1804284 has been moved to the MODIFIED state.

In response to this:

Bug 1804284: Revert "RHCOS: bump to 44.81.202002071430-0"

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

[openshift-ci-robot]

@miabbott: The following tests failed, say /retest to rerun all failed tests:

Test name	Commit	Details	Rerun command
ci/prow/e2e-vsphere	1951df7	link	/test e2e-vsphere
ci/prow/e2e-libvirt	1951df7	link	/test e2e-libvirt
ci/prow/e2e-aws-scaleup-rhel7	1951df7	link	/test e2e-aws-scaleup-rhel7

Full PR test history. Your PR dashboard. Please help us cut down on flakes by linking to an open issue when you hit one in your PR.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.