Skip to content

CORS-3460: capi: collect generated assets in hidden dir and save into log bundle#8387

Merged
openshift-merge-bot[bot] merged 2 commits intoopenshift:masterfrom
r4f4:capi-manifests-hidden-dir
May 15, 2024
Merged

CORS-3460: capi: collect generated assets in hidden dir and save into log bundle#8387
openshift-merge-bot[bot] merged 2 commits intoopenshift:masterfrom
r4f4:capi-manifests-hidden-dir

Conversation

@r4f4
Copy link
Contributor

@r4f4 r4f4 commented May 9, 2024

  • This way they don't pollute the workdir neither confuse users by their existence.
  • These manifests could provide debugging information about the capi resources configuration and last known state.

@openshift-ci-robot openshift-ci-robot added the jira/valid-reference Indicates that this PR references a valid Jira ticket of any type. label May 9, 2024
@openshift-ci-robot
Copy link
Contributor

openshift-ci-robot commented May 9, 2024

@r4f4: This pull request references CORS-3460 which is a valid jira issue.

Warning: The referenced jira issue has an invalid target version for the target branch this PR targets: expected the story to target the "4.16.0" version, but no target version was set.

Details

In response to this:

  • This way they don't pollute the workdir neither confuse users by their existence.
  • These manifests could provide debugging information about the capi resources configuration and last known state.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

@r4f4
Copy link
Contributor Author

r4f4 commented May 9, 2024

Results from local testing:

$ tree . -a
.
├── auth
│   ├── envtest.kubeconfig
│   ├── kubeadmin-password
│   └── kubeconfig
├── bin
├── .capi_output
│   ├── AWSClusterControllerIdentity--default.yaml
│   ├── AWSCluster-openshift-cluster-api-guests-rdossant-installer-05-lr98z.yaml
│   ├── AWSMachine-openshift-cluster-api-guests-rdossant-installer-05-lr98z-bootstrap.yaml
│   ├── AWSMachine-openshift-cluster-api-guests-rdossant-installer-05-lr98z-master-0.yaml
│   ├── AWSMachine-openshift-cluster-api-guests-rdossant-installer-05-lr98z-master-1.yaml
│   ├── AWSMachine-openshift-cluster-api-guests-rdossant-installer-05-lr98z-master-2.yaml
│   ├── Cluster-openshift-cluster-api-guests-rdossant-installer-05-lr98z.yaml
│   ├── Machine-openshift-cluster-api-guests-rdossant-installer-05-lr98z-bootstrap.yaml
│   ├── Machine-openshift-cluster-api-guests-rdossant-installer-05-lr98z-master-0.yaml
│   ├── Machine-openshift-cluster-api-guests-rdossant-installer-05-lr98z-master-1.yaml
│   ├── Machine-openshift-cluster-api-guests-rdossant-installer-05-lr98z-master-2.yaml
│   ├── Namespace--openshift-cluster-api-guests.yaml
│   ├── Secret-openshift-cluster-api-guests-rdossant-installer-05-lr98z-bootstrap.yaml
│   └── Secret-openshift-cluster-api-guests-rdossant-installer-05-lr98z-master.yaml
├── metadata.json
├── openshift-install
├── .openshift_install.log
├── .openshift_install_state.json
├── terraform.platform.auto.tfvars.json
├── terraform.tfvars.json
└── tls
    ├── journal-gatewayd.crt
    └── journal-gatewayd.key

5 directories, 25 files
$ tar tvf log-bundle-20240510004759.tar.gz --wildcards '*/clusterapi/*'
-rw-r----- root/root 124046 2024-05-09 21:08 log-bundle-20240510004759/clusterapi/AWSCluster-openshift-cluster-api-guests-rdossant-installer-05-lr98z.yaml
-rw-r----- root/root   1703 2024-05-09 21:08 log-bundle-20240510004759/clusterapi/AWSClusterControllerIdentity--default.yaml
-rw-r----- root/root  15858 2024-05-09 21:08 log-bundle-20240510004759/clusterapi/AWSMachine-openshift-cluster-api-guests-rdossant-installer-05-lr98z-bootstrap.yaml
-rw-r----- root/root  15237 2024-05-09 21:08 log-bundle-20240510004759/clusterapi/AWSMachine-openshift-cluster-api-guests-rdossant-installer-05-lr98z-master-0.yaml
-rw-r----- root/root  15239 2024-05-09 21:08 log-bundle-20240510004759/clusterapi/AWSMachine-openshift-cluster-api-guests-rdossant-installer-05-lr98z-master-1.yaml
-rw-r----- root/root  15241 2024-05-09 21:08 log-bundle-20240510004759/clusterapi/AWSMachine-openshift-cluster-api-guests-rdossant-installer-05-lr98z-master-2.yaml
-rw-r----- root/root   8527 2024-05-09 21:08 log-bundle-20240510004759/clusterapi/Cluster-openshift-cluster-api-guests-rdossant-installer-05-lr98z.yaml
-rw-r----- root/root   8818 2024-05-09 21:08 log-bundle-20240510004759/clusterapi/Machine-openshift-cluster-api-guests-rdossant-installer-05-lr98z-bootstrap.yaml
-rw-r----- root/root   8676 2024-05-09 21:08 log-bundle-20240510004759/clusterapi/Machine-openshift-cluster-api-guests-rdossant-installer-05-lr98z-master-0.yaml
-rw-r----- root/root   8678 2024-05-09 21:08 log-bundle-20240510004759/clusterapi/Machine-openshift-cluster-api-guests-rdossant-installer-05-lr98z-master-1.yaml
-rw-r----- root/root   8678 2024-05-09 21:08 log-bundle-20240510004759/clusterapi/Machine-openshift-cluster-api-guests-rdossant-installer-05-lr98z-master-2.yaml
-rw-r----- root/root   1546 2024-05-09 21:08 log-bundle-20240510004759/clusterapi/Namespace--openshift-cluster-api-guests.yaml
-rw-r----- root/root 2234089 2024-05-09 21:08 log-bundle-20240510004759/clusterapi/Secret-openshift-cluster-api-guests-rdossant-installer-05-lr98z-bootstrap.yaml
-rw-r----- root/root   15149 2024-05-09 21:08 log-bundle-20240510004759/clusterapi/Secret-openshift-cluster-api-guests-rdossant-installer-05-lr98z-master.yaml

@r4f4
Copy link
Contributor Author

r4f4 commented May 9, 2024

@openshift-ci openshift-ci bot requested review from barbacbd and patrickdillon and removed request for AnnaZivkovic and pawanpinjarkar May 9, 2024 23:13
@r4f4
Copy link
Contributor Author

r4f4 commented May 10, 2024

/hold
Added a commit to fail the bootstrap process so we can see the gather in action.

@openshift-ci openshift-ci bot added the do-not-merge/hold Indicates that a PR should not merge because someone has issued a /hold command. label May 10, 2024
@r4f4
Copy link
Contributor Author

r4f4 commented May 10, 2024

/test altinfra-e2e-aws-ovn

@r4f4
Copy link
Contributor Author

r4f4 commented May 10, 2024

Added a commit to fail the bootstrap process so we can see the gather in action.

It seems the way I did it is it's not triggering the gather bootstrap. For some reason I thought that happened in our CI scripts, but it's actually triggered by the installer itself.

Trying again.

@r4f4 r4f4 force-pushed the capi-manifests-hidden-dir branch from 629aa82 to 9f5f3ff Compare May 10, 2024 11:16
@r4f4
Copy link
Contributor Author

r4f4 commented May 10, 2024

/test altinfra-e2e-aws-ovn

2 similar comments
@r4f4
Copy link
Contributor Author

r4f4 commented May 10, 2024

/test altinfra-e2e-aws-ovn

@r4f4
Copy link
Contributor Author

r4f4 commented May 10, 2024

/test altinfra-e2e-aws-ovn

@r4f4 r4f4 force-pushed the capi-manifests-hidden-dir branch from 9f5f3ff to d3c5fa1 Compare May 10, 2024 18:02
@r4f4
Copy link
Contributor Author

r4f4 commented May 10, 2024

I think I was stopping the bootstrap too early. Let's try again:
/test altinfra-e2e-aws-ovn

@r4f4
Copy link
Contributor Author

r4f4 commented May 10, 2024

I was saving the capi manifests in the wrong path and didn't realize it because I ran the Installer from a container and the workdir was an absolute path.

/test altinfra-e2e-aws-ovn

@r4f4
Copy link
Contributor Author

r4f4 commented May 10, 2024

It's working now: https://gcsweb-ci.apps.ci.l2s4.p1.openshiftapps.com/gcs/test-platform-results/pr-logs/pull/openshift_installer/8387/pull-ci-openshift-installer-master-altinfra-e2e-aws-ovn/1789019242780168192/artifacts/e2e-aws-ovn/ipi-install-install/artifacts/log-bundle-20240510203407.tar

$ tar tfv log-bundle-20240510203407.tar --wildcards '*/clusterapi/*'
-rw-r----- 1003980000/root 118472 2024-05-10 22:21 log-bundle-20240510203407/clusterapi/AWSCluster-openshift-cluster-api-guests-ci-op-p2rftdc3-2d061-ss7sj.yaml
-rw-r----- 1003980000/root   1703 2024-05-10 22:21 log-bundle-20240510203407/clusterapi/AWSClusterControllerIdentity--default.yaml
-rw-r----- 1003980000/root  16603 2024-05-10 22:21 log-bundle-20240510203407/clusterapi/AWSMachine-openshift-cluster-api-guests-ci-op-p2rftdc3-2d061-ss7sj-bootstrap.yaml
-rw-r----- 1003980000/root  15977 2024-05-10 22:21 log-bundle-20240510203407/clusterapi/AWSMachine-openshift-cluster-api-guests-ci-op-p2rftdc3-2d061-ss7sj-master-0.yaml
-rw-r----- 1003980000/root  15978 2024-05-10 22:21 log-bundle-20240510203407/clusterapi/AWSMachine-openshift-cluster-api-guests-ci-op-p2rftdc3-2d061-ss7sj-master-1.yaml
-rw-r----- 1003980000/root  15983 2024-05-10 22:21 log-bundle-20240510203407/clusterapi/AWSMachine-openshift-cluster-api-guests-ci-op-p2rftdc3-2d061-ss7sj-master-2.yaml
-rw-r----- 1003980000/root   7959 2024-05-10 22:21 log-bundle-20240510203407/clusterapi/Cluster-openshift-cluster-api-guests-ci-op-p2rftdc3-2d061-ss7sj.yaml
-rw-r----- 1003980000/root   8817 2024-05-10 22:21 log-bundle-20240510203407/clusterapi/Machine-openshift-cluster-api-guests-ci-op-p2rftdc3-2d061-ss7sj-bootstrap.yaml
-rw-r----- 1003980000/root   8675 2024-05-10 22:21 log-bundle-20240510203407/clusterapi/Machine-openshift-cluster-api-guests-ci-op-p2rftdc3-2d061-ss7sj-master-0.yaml
-rw-r----- 1003980000/root   8675 2024-05-10 22:21 log-bundle-20240510203407/clusterapi/Machine-openshift-cluster-api-guests-ci-op-p2rftdc3-2d061-ss7sj-master-1.yaml
-rw-r----- 1003980000/root   8677 2024-05-10 22:21 log-bundle-20240510203407/clusterapi/Machine-openshift-cluster-api-guests-ci-op-p2rftdc3-2d061-ss7sj-master-2.yaml
-rw-r----- 1003980000/root   1546 2024-05-10 22:21 log-bundle-20240510203407/clusterapi/Namespace--openshift-cluster-api-guests.yaml
-rw-r----- 1003980000/root 2596440 2024-05-10 22:21 log-bundle-20240510203407/clusterapi/Secret-openshift-cluster-api-guests-ci-op-p2rftdc3-2d061-ss7sj-bootstrap.yaml
-rw-r----- 1003980000/root   15167 2024-05-10 22:21 log-bundle-20240510203407/clusterapi/Secret-openshift-cluster-api-guests-ci-op-p2rftdc3-2d061-ss7sj-master.yaml

@r4f4 r4f4 force-pushed the capi-manifests-hidden-dir branch from cac0e31 to 21f0427 Compare May 10, 2024 20:45
@r4f4
Copy link
Contributor Author

r4f4 commented May 10, 2024

/hold cancel

@openshift-ci openshift-ci bot removed the do-not-merge/hold Indicates that a PR should not merge because someone has issued a /hold command. label May 10, 2024
@r4f4
Copy link
Contributor Author

r4f4 commented May 10, 2024

In the terraform-based job: https://prow.ci.openshift.org/view/gs/test-platform-results/pr-logs/pull/openshift_installer/8387/pull-ci-openshift-installer-master-e2e-aws-ovn/1788993024060035072

level=info msg=Pulling Cluster API manifests
level=info msg=Failed to gather Cluster API manifests: either Cluster API manifests not generated or terraform provision

Copy link
Contributor

@barbacbd barbacbd left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

/lgtm

@openshift-ci openshift-ci bot added the lgtm Indicates that a PR is ready to be merged. label May 13, 2024
Copy link
Contributor

@patrickdillon patrickdillon left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ug sorry @r4f4 I started this comment in a pending review and never submitted it

r4f4 added 2 commits May 14, 2024 11:39
This way they don't pollute the workdir neither confuse users by their
existence.
These manifests could provide debugging information about the capi
resources configuration and last known state.
@r4f4 r4f4 force-pushed the capi-manifests-hidden-dir branch from 21f0427 to fa8074a Compare May 14, 2024 15:39
@openshift-ci openshift-ci bot removed the lgtm Indicates that a PR is ready to be merged. label May 14, 2024
@r4f4
Copy link
Contributor Author

r4f4 commented May 14, 2024

Update: addressed review feedback.

@patrickdillon
Copy link
Contributor

/lgtm
/approve
/label acknowledge-critical-fixes-only

@openshift-ci openshift-ci bot added the acknowledge-critical-fixes-only Indicates if the issuer of the label is OK with the policy. label May 14, 2024
@openshift-ci openshift-ci bot added the lgtm Indicates that a PR is ready to be merged. label May 14, 2024
@openshift-ci
Copy link
Contributor

openshift-ci bot commented May 14, 2024

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: patrickdillon

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Details Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@openshift-ci openshift-ci bot added the approved Indicates a PR has been approved by an approver from all required OWNERS files. label May 14, 2024
@openshift-ci
Copy link
Contributor

openshift-ci bot commented May 14, 2024

@r4f4: The following tests failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name Commit Details Required Rerun command
ci/prow/altinfra-e2e-aws-ovn cac0e31efc139e86b0ef9ddd1fa606711b4ba814 link false /test altinfra-e2e-aws-ovn
ci/prow/okd-e2e-aws-ovn-upgrade fa8074a link false /test okd-e2e-aws-ovn-upgrade

Full PR test history. Your PR dashboard.

Details

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. I understand the commands that are listed here.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

acknowledge-critical-fixes-only Indicates if the issuer of the label is OK with the policy. approved Indicates a PR has been approved by an approver from all required OWNERS files. jira/valid-reference Indicates that this PR references a valid Jira ticket of any type. lgtm Indicates that a PR is ready to be merged.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants