Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[WIP] [CI:BUILD] Update CI VM images w/ newer automation-library + enable multi-arch image build debugging #19720

Closed
wants to merge 2 commits into from

Conversation

cevich
Copy link
Member

@cevich cevich commented Aug 23, 2023

DO NOT MERGE: Debugging in progress


The v4.3.1 version of the library defines a common passthrough_envars() so it doesn't need to be duplicated in podman and buildah CI. It also includes an update to build-push which should make debugging easier...


A jq error has been plaguing all flavors of all multi-arch image builds on podman, buildah, and skopeo:

jq: error (at <stdin>:29): Cannot iterate over null (null)

Unfortunately the issue does not reproduce locally nor in test-builds. Several script changes included in the most recent CI VM images are intended to help debug this. Enable the debug option on one build to provide (hopefully) helpful clues as to what's going wrong.

Does this PR introduce a user-facing change?

None

@openshift-ci openshift-ci bot added release-note-none do-not-merge/work-in-progress Indicates that a PR should not merge because it is a work in progress. labels Aug 23, 2023
@openshift-ci
Copy link
Contributor

openshift-ci bot commented Aug 23, 2023

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by: cevich
Once this PR has been reviewed and has the lgtm label, please assign mtrmac for approval. For more information see the Kubernetes Code Review Process.

The full list of commands accepted by this bot can be found here.

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@cevich cevich changed the title [CI:BUILD] Enable stable multi-arch image build debugging [WIP] [CI:BUILD] Enable stable multi-arch image build debugging Aug 23, 2023
@cevich
Copy link
Member Author

cevich commented Aug 23, 2023

Looks like the problem isn't apparent in test-runs comes down to a too-old automation-library version. Will need to build new images to incorporate that (which also necessitates other followup changes in podman and buildah CI).

@cevich cevich changed the title [WIP] [CI:BUILD] Enable stable multi-arch image build debugging [WIP] [CI:BUILD] Update CI VM images w/ newer automation-library + enable multi-arch image build debugging Aug 23, 2023
@openshift-merge-robot openshift-merge-robot added the needs-rebase Indicates a PR cannot be merged because it has merge conflicts with HEAD. label Aug 23, 2023
The `v4.3.1` version of the library defines a common
`passthrough_envars()` so it doesn't need to be duplicated in podman and
buildah CI.  It also includes an update to build-push which should make
debugging easier.

Signed-off-by: Chris Evich <cevich@redhat.com>
A jq error has been plaguing all flavors of all multi-arch image builds
on podman, buildah, and skopeo:

```
jq: error (at <stdin>:29): Cannot iterate over null (null)
```

Unfortunately the issue does not reproduce locally nor in test-builds.
Several script changes included in the most recent CI VM images are
intended to help debug this.  Enable the debug option on one build
to provide (hopefully) helpful clues as to what's going wrong.

Signed-off-by: Chris Evich <cevich@redhat.com>
@openshift-merge-robot openshift-merge-robot added needs-rebase Indicates a PR cannot be merged because it has merge conflicts with HEAD. and removed needs-rebase Indicates a PR cannot be merged because it has merge conflicts with HEAD. labels Aug 23, 2023
@openshift-merge-robot
Copy link
Collaborator

PR needs rebase.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

@cevich cevich closed this Aug 25, 2023
cevich added a commit to cevich/buildah that referenced this pull request Aug 28, 2023
These jobs have been failing since early August due to
technical/scripting problems.  Disable/remove entirely since a fix is
unlikely to be implemented anytime soon.

Ref: Abandoned recent attempt at debugging
containers/podman#19720

Signed-off-by: Chris Evich <cevich@redhat.com>
cevich added a commit to cevich/podman that referenced this pull request Aug 28, 2023
These jobs have been failing since early August due to
technical/scripting problems.  Disable/remove entirely since a fix is
unlikely to be implemented anytime soon.

Ref: Abandoned recent attempt at debugging
containers#19720

Signed-off-by: Chris Evich <cevich@redhat.com>
cevich added a commit to cevich/buildah that referenced this pull request Sep 13, 2023
These jobs have been failing since early August due to
technical/scripting problems.  Disable/remove entirely since a fix is
unlikely to be implemented anytime soon.

Ref: Abandoned recent attempt at debugging
containers/podman#19720

Signed-off-by: Chris Evich <cevich@redhat.com>
ranjithrajaram pushed a commit to ranjithrajaram/buildah that referenced this pull request Sep 25, 2023
These jobs have been failing since early August due to
technical/scripting problems.  Disable/remove entirely since a fix is
unlikely to be implemented anytime soon.

Ref: Abandoned recent attempt at debugging
containers/podman#19720

Signed-off-by: Chris Evich <cevich@redhat.com>
@github-actions github-actions bot added the locked - please file new issue/PR Assist humans wanting to comment on an old issue or PR with locked comments. label Nov 24, 2023
@github-actions github-actions bot locked as resolved and limited conversation to collaborators Nov 24, 2023
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
do-not-merge/work-in-progress Indicates that a PR should not merge because it is a work in progress. locked - please file new issue/PR Assist humans wanting to comment on an old issue or PR with locked comments. needs-rebase Indicates a PR cannot be merged because it has merge conflicts with HEAD. release-note-none
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants