K8S version upgrade v0.29.x and related changes

[mabhi]

Change Overview

The following PR is the revert of previous reverted PR: #2676 .
This PR includes :

• Restore changes on k8s upgrade version v0.29.x
• A change wherein validation webhook being created is added explicitly to the controller manager.
  Without the second change there was always a chance that the mutating/validating webhook request never reached the controller
• New validation methods added to service validation webhook requests.

Pull request type

Please check the type of change your PR introduces:

• 🚧 Work in Progress
• 🌈 Refactoring (no functional changes, no api changes)
• 🐹 Trivial/Minor
• 🐛 Bugfix
• 🌻 Feature
• 🗺️ Documentation
• 🤖 Test

Issues

• fixes #issue-number

Test Plan

• 💪 Manual
• ⚡ Unit test
• 💚 E2E

Install kanister controller using private image in repo with local changes (TAG=v0.0.6)
helm upgrade --install kanister ./helm/kanister-operator --create-namespace -n kanister --set image.repository=mabhi2ic/controller --set image.tag=${TAG}

Check the correct version of the controller image with the changes

(⎈|kind-local:default)➜  kanister git:(revert-k8s-upgrade-v0-29-x) ✗ k describe -n kanister po kanister-kanister-operator-7c8bf8766-kd8lp

Name:             kanister-kanister-operator-7c8bf8766-kd8lp
Namespace:        kanister
....
Status:           Running
IP:               10.244.0.16
......
Containers:
  kanister-kanister-operator:
    Container ID:   containerd://f21dab87ebdd6515c5b2261e5db81aaf533fbccb5312ea4e58d05ae68debfacb
    Image:          mabhi2ic/controller:v0.0.6
     .....
    Mounts:
      /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-xlc5l (ro)
      /var/run/webhook/serving-cert from webhook-certs (rw)
Conditions:
  Type              Status
  Initialized       True 
  Ready             True 
  ContainersReady   True 
  PodScheduled      True 
Volumes:
  webhook-certs:
    Type:        Secret (a volume populated by a Secret)
    SecretName:  kanister-webhook-certs
    Optional:    false

Testing by issuing a valid blueprint

(⎈|kind-local:default)➜  kanister git:(revert-k8s-upgrade-v0-29-x) k get po -n kanister   
NAME                                          READY   STATUS    RESTARTS   AGE
kanister-kanister-operator-7df894bb95-gmlmr   1/1     Running   0          29s
(⎈|kind-local:default)➜  kanister git:(revert-k8s-upgrade-v0-29-x) k create -f ./examples/mysql/mysql-blueprint.yaml -n kanister
blueprint.cr.kanister.io/mysql-blueprint created

Container logs for the above -

-------------------------------------------------------------------------
Passed the 'validation of phase restoreFromBlobStore in action restore' check.. ✅
Passed the 'validation of phase dumpToObjectStore in action backup' check.. ✅
Passed the 'validation of phase deleteFromBlobStore in action delete' check.. ✅
{"level":"info","ts":"2024-02-20T18:40:10Z","logger":"admission","msg":"Validating blueprint","object":{"name":"mysql-blueprint","namespace":"kanister"},"namespace":"kanister","name":"mysql-blueprint","resource":{"group":"cr.kanister.io","version":"v1alpha1","resource":"blueprints"},"user":"kubernetes-admin","requestID":"5d22fff4-4ec5-4719-b24e-b1212935f35b"}
{"File":"pkg/controller/controller.go","Function":"github.com/kanisterio/kanister/pkg/controller.(*Controller).onAddBlueprint","Line":231,"cluster_name":"94c9c8a4-f51d-46eb-a15c-019e6d6beabc","hostname":"kanister-kanister-operator-7df894bb95-gmlmr","level":"info","msg":"Added blueprint mysql-blueprint","time":"2024-02-20T18:40:10.553588555Z"}

Testing issuing an invalid blueprint

(⎈|kind-local:default)➜  kanister git:(revert-k8s-upgrade-v0-29-x) k create -f ./examples/mysql/mysql-blueprint.yaml -n kanister
Error from server (Forbidden): error when creating "./examples/mysql/mysql-blueprint.yaml": admission webhook "blueprints.cr.kanister.io" denied the request: Invalid blueprint, Failed to validate action backup: Requested function {KubeTaskInvalid} has not been registered

Container logs for the above -

----------------------------------------------------------------------------  
Failed the 'validation of action backup' check.. ❌
{"level":"info","ts":"2024-02-20T18:41:29Z","logger":"admission","msg":"Validating blueprint","object":{"name":"mysql-blueprint","namespace":"kanister"},"namespace":"kanister","name":"mysql-blueprint","resource":{"group":"cr.kanister.io","version":"v1alpha1","resource":"blueprints"},"user":"kubernetes-admin","requestID":"109071e5-cafc-43d2-b8c1-408bb6fa1384"}
{"BlueprintName":"mysql-blueprint","File":"pkg/controller/controller.go","Function":"github.com/kanisterio/kanister/pkg/controller.(*Controller).onDeleteBlueprint","Line":300,"cluster_name":"94c9c8a4-f51d-46eb-a15c-019e6d6beabc","hostname":"kanister-kanister-operator-7df894bb95-gmlmr","level":"info","msg":"Deleted Blueprint ","time":"2024-02-20T18:44:02.815380997Z"}
{"level":"info","ts":"2024-02-20T18:44:13Z","logger":"admission","msg":"Validating blueprint","object":{"name":"mysql-blueprint","namespace":"kanister"},"namespace":"kanister","name":"mysql-blueprint","resource":{"group":"cr.kanister.io","version":"v1alpha1","resource":"blueprints"},"user":"kubernetes-admin","requestID":"c6413c18-a770-486b-89fa-10df3574dd13"}

[PrasadG193]

LGTM