Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Wait for provisioning interface and db sync #15

Merged
merged 3 commits into from Aug 20, 2019

Conversation

hardys
Copy link

@hardys hardys commented Aug 16, 2019

Cherry-picks of the following upstream PRs

metal3-io#88

metal3-io#89

Steven Hardy added 2 commits August 16, 2019 16:01
We've seen some issues where the static-ip-refresh doesn't happen quickly
enough, and/or static-ip-set from initContainers expires before we start
the ironic containers.

To ensure we don't fail in that case, wait for the provisioning IP to be
assigned, then the exact order of container start is not important, and
we'll wait until static-ip-refresh has configured the nic.
I've seen some situations where mariadb is not up soon enough for the
dbsync, despite the 10 retries done inside ironic-dbsync.

In this situation we start the ironic services anyway and since metal3-io#80 got reverted,
we can't rely on pod/container restart to handle this, so lets retry inside
the script logging a warning instead.
@openshift-ci-robot openshift-ci-robot added the size/S Denotes a PR that changes 10-29 lines, ignoring generated files. label Aug 16, 2019
@hardys hardys requested a review from russellb August 16, 2019 15:03
@openshift-ci-robot openshift-ci-robot added the approved Indicates a PR has been approved by an approver from all required OWNERS files. label Aug 16, 2019
@russellb
Copy link
Member

Image build in CI failed on:

No package python3-PyMySQL available.

@russellb
Copy link
Member

/retest

@russellb
Copy link
Member

Based on the build log, it looks like it's building with el7 rpms, but Dockerfile.ocp has python3-PyMySQL assuming el8.

Copy link

@juliakreger juliakreger left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

/approve

@hardys
Copy link
Author

hardys commented Aug 20, 2019

/retest

hardys pushed a commit to hardys/ironic-image that referenced this pull request Aug 20, 2019
This is a dependency of the ironic packages (via the python2-oslo-db
package) already, and copying this dependency to the downstream el8
based dockerfile has caused issues since[1] made some of the image
building checks stricter, I assume this is because the package name
is different but I don't have a specfile reference atm.

This has led to [2] failing CI, and rather than just fix that downstream
we should probably make things consistent and remove this spuruious
install, then let RPM dependencies defined by the package maintainers
do the right thing on each platform?

[1] openshift/images#11
[2] openshift#15
This is a dependency of the ironic packages (via the python2-oslo-db
package) already, and copying this dependency to the downstream el8
based dockerfile has caused issues since[1] made some of the image
building checks stricter, I assume this is because the package name
is different but I don't have a specfile reference atm.

This has led to [2] failing CI, and rather than just fix that downstream
we should probably make things consistent and remove this spuruious
install, then let RPM dependencies defined by the package maintainers
do the right thing on each platform?

[1] openshift/images#11
[2] openshift#15
@hardys hardys changed the title Wait for provisioning interface and db sync WIP: Wait for provisioning interface and db sync Aug 20, 2019
@openshift-ci-robot openshift-ci-robot added the do-not-merge/work-in-progress Indicates that a PR should not merge because it is a work in progress. label Aug 20, 2019
@hardys
Copy link
Author

hardys commented Aug 20, 2019

Thanks to @stbenjam for pointing out openshift/images#11 which may be the root cause of the CI failure, e.g some errors from yum have been ignored but now cause failure.

I pushed metal3-io#90 and added the same commit here to see if that is sufficient to resolve the build issue, marked this WIP until that is confirmed

@hardys hardys changed the title WIP: Wait for provisioning interface and db sync Wait for provisioning interface and db sync Aug 20, 2019
@openshift-ci-robot openshift-ci-robot removed the do-not-merge/work-in-progress Indicates that a PR should not merge because it is a work in progress. label Aug 20, 2019
@elfosardo
Copy link

we can remove the WIP, verified the correct package is installed
the name is python-PyMySQL and it's installed as oslo-db dependency

@elfosardo
Copy link

/lgtm

@openshift-ci-robot openshift-ci-robot added the lgtm Indicates that a PR is ready to be merged. label Aug 20, 2019
@openshift-ci-robot
Copy link

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: elfosardo, hardys, juliakreger

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:
  • OWNERS [elfosardo,hardys,juliakreger]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved Indicates a PR has been approved by an approver from all required OWNERS files. lgtm Indicates that a PR is ready to be merged. size/S Denotes a PR that changes 10-29 lines, ignoring generated files.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

6 participants