Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

bootkube.sh: CEO: properly handle etcd endpoints on retry #2767

Merged
merged 1 commit into from Dec 9, 2019

Conversation

hexfusion
Copy link
Contributor

@hexfusion hexfusion commented Dec 7, 2019

This PR resolves an issue where on retry ETCD_ENDPOINTS was not properly handled. The result was an invalid list which could lead to installer timeouts.

This issue would not yet have affected any clusters as the issue would only be possible if CEO was in a Managed state which to date has not been true.

@openshift-ci-robot openshift-ci-robot added the size/XS Denotes a PR that changes 0-9 lines, ignoring generated files. label Dec 7, 2019
@alaypatel07
Copy link
Contributor

/lgtm

@openshift-ci-robot openshift-ci-robot added the lgtm Indicates that a PR is ready to be merged. label Dec 7, 2019
@hexfusion
Copy link
Contributor Author

/test e2e-openstack

@hexfusion
Copy link
Contributor Author

test flake

/test e2e-openstack

@@ -5,7 +5,8 @@ set -euoE pipefail ## -E option will cause functions to inherit trap

mkdir --parents /etc/kubernetes/{manifests,bootstrap-configs,bootstrap-manifests}

ETCD_ENDPOINTS={{.EtcdCluster}}
BOOTSTRAP_IP=$(hostname -I | awk '{ print $1 }')
ETCD_ENDPOINTS=https://"${BOOTSTRAP_IP}":2379
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Until CEO is ready, can we make sure this value is known empty/broken by default so that the error is clear. And set the correct value in the if else?

Copy link
Contributor Author

@hexfusion hexfusion Dec 9, 2019

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I left ETCD_ENDPOINTS empty. Then added an additional if block[1] to handle retry.

[1] https://github.com/openshift/installer/pull/2767/files#diff-ce82c1d8a44f7dfc41dfc024085ccfeeR118

@openshift-ci-robot openshift-ci-robot added size/M Denotes a PR that changes 30-99 lines, ignoring generated files. and removed lgtm Indicates that a PR is ready to be merged. size/XS Denotes a PR that changes 0-9 lines, ignoring generated files. labels Dec 9, 2019
Signed-off-by: Sam Batschelet <sbatsche@redhat.com>
@abhinavdahiya
Copy link
Contributor

/approve

@openshift-ci-robot openshift-ci-robot added the approved Indicates a PR has been approved by an approver from all required OWNERS files. label Dec 9, 2019
@hexfusion
Copy link
Contributor Author

hexfusion commented Dec 9, 2019

OOMKilled :)

/test govet

@hexfusion
Copy link
Contributor Author

hexfusion commented Dec 9, 2019

level=fatal msg="failed to fetch Cluster: failed to generate asset "Cluster": failed to create cluster: failed to apply using Terraform"

Infra flake

@hexfusion
Copy link
Contributor Author

/test e2e-openstack

@alaypatel07
Copy link
Contributor

/lgtm

@openshift-ci-robot openshift-ci-robot added the lgtm Indicates that a PR is ready to be merged. label Dec 9, 2019
@openshift-ci-robot
Copy link
Contributor

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: abhinavdahiya, alaypatel07, hexfusion

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@openshift-bot
Copy link
Contributor

/retest

Please review the full test history for this PR and help us cut down flakes.

2 similar comments
@openshift-bot
Copy link
Contributor

/retest

Please review the full test history for this PR and help us cut down flakes.

@openshift-bot
Copy link
Contributor

/retest

Please review the full test history for this PR and help us cut down flakes.

@openshift-merge-robot openshift-merge-robot merged commit 5dd2719 into openshift:master Dec 9, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved Indicates a PR has been approved by an approver from all required OWNERS files. lgtm Indicates that a PR is ready to be merged. size/M Denotes a PR that changes 30-99 lines, ignoring generated files.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

6 participants