Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

OCPBUGS-12707: always write AWS cloud.conf #7514

Conversation

patrickdillon
Copy link
Contributor

AWS Service endpoints are injected into the cloud.conf cloud-provider config by the cluster-config operator running on bootstrap, as described in:
https://github.com/openshift/enhancements/blob/master/enhancements/installer/aws-custom-region-and-endpoints.md

OCPBUGS-12707 occurs because the installer does not, by the design in the enhancement,
write the service endpoints to the cloud config and there are no other uses of the config, so the installer does not populate the config at all. Accordingly, with no installer-generated config, the infrastructure object does not include a reference to the config.

The bug occurs because the MCO's bootstrap mode rendering of the cloud provider config depends on the infrastructure object containing the name of the cloud.conf, but because that is not populated it produces an empty cloud.conf. Apparently the normal non-bootstrap mode differs and does correctly generate the cloud.conf. This causes an error because the MCO has a check to capture any drift between bootstrap and cluster.

This bug can be resolved by always populating the empty cloud.conf, as it will correctly setup the cluster infrastructure object. It would also be possible to limit populating the cloud.conf only when service endpoints are set, but there is no reason to add extra gating logic.

AWS Service endpoints are injected into the
cloud.conf cloud-provider config by the
cluster-config operator running on bootstrap,
as described in:
https://github.com/openshift/enhancements/blob/master/enhancements/installer/aws-custom-region-and-endpoints.md

OCPBUGS-12707 occurs because the installer
does not, by the design in the enhancement,
write the service endpoints to the cloud
config and there are no other uses of the
config, so the installer does not populate
the config at all. Accordingly, with no
installer-generated config, the infrastructure
object does not include a reference to the
config.

The bug occurs because the MCO's bootstrap mode
rendering of the cloud provider config depends
on the infrastructure object containing the name
of the cloud.conf, but because that is not populated
it produces an empty cloud.conf. Apparently the normal
non-bootstrap mode differs and does correctly generate
the cloud.conf. This causes an error because the MCO
has a check to capture any drift between bootstrap and
cluster.

This bug can be resolved by always populating the empty cloud.conf,
as it will correctly setup the cluster infrastructure object. It
would also be possible to limit populating the cloud.conf only
when service endpoints are set, but there is no reason to add
extra gating logic.
@openshift-ci-robot openshift-ci-robot added jira/severity-critical Referenced Jira bug's severity is critical for the branch this PR is targeting. jira/valid-reference Indicates that this PR references a valid Jira ticket of any type. labels Sep 21, 2023
@openshift-ci-robot
Copy link
Contributor

@patrickdillon: This pull request references Jira Issue OCPBUGS-12707, which is invalid:

  • expected the bug to target the "4.15.0" version, but no target version was set

Comment /jira refresh to re-evaluate validity if changes to the Jira bug are made, or edit the title of this pull request to link to a different bug.

The bug has been updated to refer to the pull request using the external bug tracker.

In response to this:

AWS Service endpoints are injected into the cloud.conf cloud-provider config by the cluster-config operator running on bootstrap, as described in:
https://github.com/openshift/enhancements/blob/master/enhancements/installer/aws-custom-region-and-endpoints.md

OCPBUGS-12707 occurs because the installer does not, by the design in the enhancement,
write the service endpoints to the cloud config and there are no other uses of the config, so the installer does not populate the config at all. Accordingly, with no installer-generated config, the infrastructure object does not include a reference to the config.

The bug occurs because the MCO's bootstrap mode rendering of the cloud provider config depends on the infrastructure object containing the name of the cloud.conf, but because that is not populated it produces an empty cloud.conf. Apparently the normal non-bootstrap mode differs and does correctly generate the cloud.conf. This causes an error because the MCO has a check to capture any drift between bootstrap and cluster.

This bug can be resolved by always populating the empty cloud.conf, as it will correctly setup the cluster infrastructure object. It would also be possible to limit populating the cloud.conf only when service endpoints are set, but there is no reason to add extra gating logic.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

@openshift-ci-robot openshift-ci-robot added the jira/invalid-bug Indicates that a referenced Jira bug is invalid for the branch this PR is targeting. label Sep 21, 2023
@patrickdillon
Copy link
Contributor Author

/jira refresh

@openshift-ci-robot
Copy link
Contributor

@patrickdillon: This pull request references Jira Issue OCPBUGS-12707, which is invalid:

  • expected the bug to target the "4.15.0" version, but it targets "4.15" instead

Comment /jira refresh to re-evaluate validity if changes to the Jira bug are made, or edit the title of this pull request to link to a different bug.

In response to this:

/jira refresh

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

@patrickdillon
Copy link
Contributor Author

Will want to watch aws tests for regressions

@r4f4
Copy link
Contributor

r4f4 commented Sep 21, 2023

/jira refresh

@openshift-ci-robot openshift-ci-robot added the jira/valid-bug Indicates that a referenced Jira bug is valid for the branch this PR is targeting. label Sep 21, 2023
@openshift-ci-robot
Copy link
Contributor

@r4f4: This pull request references Jira Issue OCPBUGS-12707, which is valid. The bug has been moved to the POST state.

3 validation(s) were run on this bug
  • bug is open, matching expected state (open)
  • bug target version (4.15.0) matches configured target version for branch (4.15.0)
  • bug is in the state ASSIGNED, which is one of the valid states (NEW, ASSIGNED, POST)

Requesting review from QA contact:
/cc @sergiordlr

In response to this:

/jira refresh

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

@openshift-ci-robot openshift-ci-robot removed the jira/invalid-bug Indicates that a referenced Jira bug is invalid for the branch this PR is targeting. label Sep 21, 2023
@r4f4
Copy link
Contributor

r4f4 commented Sep 21, 2023

/approve

@openshift-ci
Copy link
Contributor

openshift-ci bot commented Sep 21, 2023

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: r4f4

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@openshift-ci openshift-ci bot added the approved Indicates a PR has been approved by an approver from all required OWNERS files. label Sep 21, 2023
@sadasu
Copy link
Contributor

sadasu commented Sep 21, 2023

/lgtm

@openshift-ci openshift-ci bot added the lgtm Indicates that a PR is ready to be merged. label Sep 21, 2023
@openshift-ci-robot
Copy link
Contributor

/retest-required

Remaining retests: 0 against base HEAD 010d875 and 2 for PR HEAD 360f025 in total

@openshift-ci
Copy link
Contributor

openshift-ci bot commented Sep 21, 2023

@patrickdillon: The following tests failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name Commit Details Required Rerun command
ci/prow/okd-e2e-aws-ovn 360f025 link false /test okd-e2e-aws-ovn
ci/prow/okd-e2e-aws-ovn-upgrade 360f025 link false /test okd-e2e-aws-ovn-upgrade

Full PR test history. Your PR dashboard.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

@openshift-ci-robot
Copy link
Contributor

/retest-required

Remaining retests: 0 against base HEAD b2f5f80 and 1 for PR HEAD 360f025 in total

@openshift-merge-robot openshift-merge-robot merged commit cb3289c into openshift:master Sep 22, 2023
21 of 23 checks passed
@openshift-ci-robot
Copy link
Contributor

@patrickdillon: Jira Issue OCPBUGS-12707: All pull requests linked via external trackers have merged:

Jira Issue OCPBUGS-12707 has been moved to the MODIFIED state.

In response to this:

AWS Service endpoints are injected into the cloud.conf cloud-provider config by the cluster-config operator running on bootstrap, as described in:
https://github.com/openshift/enhancements/blob/master/enhancements/installer/aws-custom-region-and-endpoints.md

OCPBUGS-12707 occurs because the installer does not, by the design in the enhancement,
write the service endpoints to the cloud config and there are no other uses of the config, so the installer does not populate the config at all. Accordingly, with no installer-generated config, the infrastructure object does not include a reference to the config.

The bug occurs because the MCO's bootstrap mode rendering of the cloud provider config depends on the infrastructure object containing the name of the cloud.conf, but because that is not populated it produces an empty cloud.conf. Apparently the normal non-bootstrap mode differs and does correctly generate the cloud.conf. This causes an error because the MCO has a check to capture any drift between bootstrap and cluster.

This bug can be resolved by always populating the empty cloud.conf, as it will correctly setup the cluster infrastructure object. It would also be possible to limit populating the cloud.conf only when service endpoints are set, but there is no reason to add extra gating logic.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

@patrickdillon
Copy link
Contributor Author

/cherry-pick release-4.14

@openshift-cherrypick-robot

@patrickdillon: new pull request created: #7578

In response to this:

/cherry-pick release-4.14

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved Indicates a PR has been approved by an approver from all required OWNERS files. jira/severity-critical Referenced Jira bug's severity is critical for the branch this PR is targeting. jira/valid-bug Indicates that a referenced Jira bug is valid for the branch this PR is targeting. jira/valid-reference Indicates that this PR references a valid Jira ticket of any type. lgtm Indicates that a PR is ready to be merged.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

6 participants