Add OpenShift cleaner script

[atodorov]

No description provided.

[atodorov]

Example of running this script locally:

WARNING: Using insecure TLS client config. Setting this option is not supported!

Logged into "https://api.ocp-virt.prod.psi.redhat.com:6443" as "system:serviceaccount:image-builder:gitab-ci" using the token provided.

You have access to the following projects and can switch between them with 'oc project <projectname>':

    cnv-qe
  * image-builder
    openshift-virtualization-os-images

Using project "image-builder".

'ATTENTION: Feb 6 2023, the my_ldap_provider will no longer be available
as a login option. Please see the "[PSI Openshift] Important Authentication Update"
email for details.'
system:serviceaccount:image-builder:gitab-ci
Already on project "image-builder" on server "https://api.ocp-virt.prod.psi.redhat.com:6443".
virtualmachine.kubevirt.io "image-builder-vm-rhel-8-10-x86-64-main-6311253374" deleted
The VM 'image-builder-vm-rhel-8-10-x86-64-main-6311253374' was terminated
persistentvolumeclaim "image-builder-data-volume-rhel-8-10-x86-64-main-6311253374" deleted
The PVC 'image-builder-data-volume-rhel-8-10-x86-64-main-6311253374' was terminated
persistentvolumeclaim "image-builder-data-volume-rhel-8-10-x86-64-pr-4032-6449247316" deleted
The PVC 'image-builder-data-volume-rhel-8-10-x86-64-pr-4032-6449247316' was terminated
persistentvolumeclaim "image-builder-data-volume-rhel-8-10-x86-64-pr-4032-6449247316-scratch" deleted
The PVC 'image-builder-data-volume-rhel-8-10-x86-64-pr-4032-6449247316-scratch' was terminated
persistentvolumeclaim "image-builder-data-volume-rhel-8-10-x86-64-pr-4032-6450318042" deleted
The PVC 'image-builder-data-volume-rhel-8-10-x86-64-pr-4032-6450318042' was terminated

[atodorov]

The PVC 'image-builder-data-volume-rhel-8-10-x86-64-main-6311253374' was terminated
persistentvolumeclaim "image-builder-data-volume-rhel-8-10-x86-64-pr-4032-6449247316" deleted

Hmmm, even though this is supposed to be removed I can still see the PVC in the OpenShift UI.

executing the removal script again this time tells me that this PVC was created recently and will not be removed:

PVC 'image-builder-data-volume-rhel-8-10-x86-64-pr-4032-6449247316' was created less than 6 hours ago

Not quite sure what's going on here.

[jrusz]

The PVC 'image-builder-data-volume-rhel-8-10-x86-64-main-6311253374' was terminated
persistentvolumeclaim "image-builder-data-volume-rhel-8-10-x86-64-pr-4032-6449247316" deleted

Hmmm, even though this is supposed to be removed I can still see the PVC in the OpenShift UI.

executing the removal script again this time tells me that this PVC was created recently and will not be removed:

PVC 'image-builder-data-volume-rhel-8-10-x86-64-pr-4032-6449247316' was created less than 6 hours ago

Not quite sure what's going on here.

Hm, that's strange. Can you delete it manually? I think that once you delete the VM you should be able to delete the PVC... Maybe a slight delay would be required between the two?

[jrusz]

LGTM, just one question and I'm not sure what's up with that PVC, seems more investigation is required.

[atodorov]

FTR I am having issues deleting some of the PVCs, created RITM1742240 ticket to ask for help.

[atodorov]

FTR I am having issues deleting some of the PVCs, created RITM1742240 ticket to ask for help.

@jrusz I got my ticket resolved but didn't actually get a good technical explanation as to how the problem happened in the first place. Let's merge this script and monitor how the cleaner job runs in the next few days. WDYT ?

[jrusz]

FTR I am having issues deleting some of the PVCs, created RITM1742240 ticket to ask for help.

@jrusz I got my ticket resolved but didn't actually get a good technical explanation as to how the problem happened in the first place. Let's merge this script and monitor how the cleaner job runs in the next few days. WDYT ?

Sounds good, so it works as expected now?