🐛 Fix or reduce frequency or switch off perma-failing jobs

[dims]

Data as of June 3rd, 9:00 PM Eastern. Latest data can be found here:
http://storage.googleapis.com/k8s-metrics/failures-latest.json

CI Job	Days Failed
post-cluster-api-provider-cloudstack-push-images	201
pull-cluster-api-e2e-scale-main-experimental	100
post-cluster-api-operator-push-images	89
periodic-cluster-api-provider-digitalocean-conformance-ci-artifacts	53
pull-cluster-api-e2e-mink8s-main	3
pull-cluster-api-provider-aws-e2e-eks-release-1-5	108

Additional Context:
kubernetes/test-infra#18600

Folks, i am aware that not all jobs may not be related to this repository per se, please feel free to divvy this up to respective teams/folks/repos

[sbueringer]

To split this up

core CAPI:

• pull-cluster-api-e2e-scale-main-experimental
  • We added this job as an experiment and will probably eventually use it to run some sort of scale e2e tests (with a mock provider).
  • I think the jobs shouldn't be a problem, it's an optional presubmit that only runs when it is manually triggered
• pull-cluster-api-e2e-mink8s-main
  • Again this is an optional presubmit. We recently added it and had an initial configuration error. It should work now (https://prow.k8s.io/job-history/gs/kubernetes-jenkins/pr-logs/directory/pull-cluster-api-e2e-mink8s-main)
  • EDIT: Might not be stable yet, but it's supposed to be stable. I'll take a closer look :)

CloudStack

• post-cluster-api-provider-cloudstack-push-images
  • @rohityadavcloud @davidjumani @jweite-amazon @dims @g-gaston @chrisdoherty4 @weizhouapache Can one of you please take a look?

Cluster API Operator:

• post-cluster-api-operator-push-images
  • @JoelSpeed @Fedosin @alexander-demicev @damdo Can one of you please take a look?

Digital Ocean:

• periodic-cluster-api-provider-digitalocean-conformance-ci-artifacts
  • @cpanato @gottwald @prksu @timoreimann Can one of you please take a look?

AWS:

• pull-cluster-api-provider-aws-e2e-eks-release-1-5
  • @richardcase @sedefsavas @Skarlso @Ankitasw @dlipovetsky Can one of you please take a look?

[killianmuldoon]

/triage accepted

[Ankitasw]

Raised fix for pull-cluster-api-provider-aws-e2e-eks-release-1-5: kubernetes-sigs/cluster-api-provider-aws#4314

[furkatgofurov7]

Cluster API Operator:

• post-cluster-api-operator-push-images

  • @JoelSpeed @Fedosin @alexander-demicev @damdo Can one of you please take a look?

Fix is up: kubernetes-sigs/cluster-api-operator#133

[cpanato]

for CAPDO is fixed now :)

[killianmuldoon]

To keep track:

• post-cluster-api-provider-cloudstack-push-images "post-cluster-api-provider-cloudstack-push-images" job failed for 201 days cluster-api-provider-cloudstack#266
• pull-cluster-api-e2e-scale-main-experimental (experimenal presubmit - not running regularly)
• post-cluster-api-operator-push-images 🐛 build: fix image push job by disabling CGO when building kustomize cluster-api-operator#133
• periodic-cluster-api-provider-digitalocean-conformance-ci-artifacts not fail the command if is not able to delete the key cluster-api-provider-digitalocean#498
• pull-cluster-api-e2e-mink8s-main (bad config - fixed)
• pull-cluster-api-provider-aws-e2e-eks-release-1-5 [release-1.5] [E2E] Fix kubernetes version for EKS upgrade tests cluster-api-provider-aws#4314

[killianmuldoon]

I think that's all of the jobs fixed - thanks again @dims for bringing this up, and thanks everyone for getting the fixes in quickly!

[dims]

thanks for the prompt responses @killianmuldoon

[sbueringer]

Should / can we close the issue?

[killianmuldoon]

/close

(Thought I did that 🙂)

[k8s-ci-robot]

@killianmuldoon: Closing this issue.

In response to this:

/close

(Thought I did that 🙂)

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.