➜ etcd-druid git:(azurite) ✗ make ci-e2e-kind-azure BUCKET_NAME="e2e-test" ./hack/ci-e2e-kind-azure.sh 📌 NOTE: To target the newly created KinD cluster, please run the following command: export KUBECONFIG=/Users/i585850/go/src/github.com/gardener/etcd-druid/hack/e2e-test/infrastructure/kind/kubeconfig ./hack/kind-up.sh Creating cluster "etcd-druid-e2e" ... ✓ Ensuring node image (kindest/node:v1.27.1) đŸ–ŧ ✓ Preparing nodes đŸ“Ļ ✓ Writing configuration 📜 ✓ Starting control-plane 🕹ī¸ ✓ Installing CNI 🔌 ✓ Installing StorageClass 💾 Set kubectl context to "kind-etcd-druid-e2e" You can now use your cluster with: kubectl cluster-info --context kind-etcd-druid-e2e Thanks for using kind! 😊 node/etcd-druid-e2e-control-plane condition met ./hack/deploy-azurite.sh deployment.apps/azurite created service/azurite-service created Waiting for deployment "azurite" rollout to finish: 0 of 1 updated replicas are available... deployment "azurite" successfully rolled out pod/azurite-95f4c6d9c-ftg7z condition met namespace/e2e-test created ------------------- Setting up environment ------------------- namespace/e2e-test unchanged Generating tags... Checking cache... Starting test... Tags used in deployment: Starting deploy... Starting pre-deploy hooks... Deleting previous job No resources found Completed pre-deploy hooks Loading images into kind cluster nodes... Images loaded in 250ns - configmap/az-infra-common created - configmap/az-run-script created - secret/az-infra-secret created - job.batch/az-infra-job created Starting post-deploy hooks... Wait until job is ready job.batch/az-infra-job condition met Completed post-deploy hooks You can also run [skaffold run --tail] to get the logs ------------------- Deploying Druid ------------------- Generating tags... - europe-docker.pkg.dev/gardener-project/public/gardener/etcd-druid -> europe-docker.pkg.dev/gardener-project/public/gardener/etcd-druid:v0.22.0-6-g6e3c8804-dirty Checking cache... ERRO[0003] gcloud binary not found - europe-docker.pkg.dev/gardener-project/public/gardener/etcd-druid: Not found. Building Starting build... Found [kind-etcd-druid-e2e] context, using local docker daemon. Building [europe-docker.pkg.dev/gardener-project/public/gardener/etcd-druid]... Target platforms: [linux/arm64] [+] Building 16.7s (14/14) FINISHED docker:desktop-linux => [internal] load .dockerignore 0.0s => => transferring context: 274B 0.0s => [internal] load build definition from Dockerfile 0.0s => => transferring dockerfile: 708B 0.0s => [internal] load metadata for gcr.io/distroless/static-debian11:nonroot 0.8s => [internal] load metadata for docker.io/library/golang:1.21.4 3.4s => [auth] library/golang:pull token for registry-1.docker.io 0.0s => [builder 1/4] FROM docker.io/library/golang:1.21.4@sha256:9baee0edab4139ae9b108fffabb8e2e98a67f0b259fd25283c2a084bd 0.0s => [internal] load build context 0.4s => => transferring context: 1.69MB 0.4s => [druid 1/4] FROM gcr.io/distroless/static-debian11:nonroot@sha256:112a87f19e83c83711cc81ce8ed0b4d79acd65789682a6a27 0.0s => CACHED [builder 2/4] WORKDIR /go/src/github.com/gardener/etcd-druid 0.0s => [builder 3/4] COPY . . 0.7s => [builder 4/4] RUN .ci/build 12.2s => CACHED [druid 2/4] COPY --from=builder /go/src/github.com/gardener/etcd-druid/bin/etcd-druid /etcd-druid 0.0s => CACHED [druid 3/4] COPY charts charts 0.0s => exporting to image 0.0s => => exporting layers 0.0s => => writing image sha256:94ed069363ee7b996a3ba6f616cc0419a5bdc13c4dbb44914cdabbaf0a26d835 0.0s => => naming to europe-docker.pkg.dev/gardener-project/public/gardener/etcd-druid:v0.22.0-6-g6e3c8804-dirty 0.0s What's Next? View a summary of image vulnerabilities and recommendations → docker scout quickview Build [europe-docker.pkg.dev/gardener-project/public/gardener/etcd-druid] succeeded Starting test... Tags used in deployment: - europe-docker.pkg.dev/gardener-project/public/gardener/etcd-druid -> europe-docker.pkg.dev/gardener-project/public/gardener/etcd-druid:94ed069363ee7b996a3ba6f616cc0419a5bdc13c4dbb44914cdabbaf0a26d835 Starting deploy... Loading images into kind cluster nodes... - europe-docker.pkg.dev/gardener-project/public/gardener/etcd-druid:94ed069363ee7b996a3ba6f616cc0419a5bdc13c4dbb44914cdabbaf0a26d835 -> Loaded Images loaded in 1.355 second Helm release etcd-druid not installed. Installing... NAME: etcd-druid LAST DEPLOYED: Fri Feb 9 12:11:56 2024 NAMESPACE: e2e-test STATUS: deployed REVISION: 1 TEST SUITE: None Waiting for deployments to stabilize... - e2e-test:deployment/etcd-druid is ready. Deployments stabilized in 1.252 second You can also run [skaffold run --tail] to get the logs ------------------- Running e2e tests ------------------- === RUN TestIntegration Running Suite: e2e Suite - /Users/i585850/go/src/github.com/gardener/etcd-druid/test/e2e ======================================================================================== Random Seed: 1707460923 Will run 7 of 7 specs ------------------------------ [BeforeSuite] /Users/i585850/go/src/github.com/gardener/etcd-druid/test/e2e/suite_test.go:72 > Enter [BeforeSuite] TOP-LEVEL @ 02/09/24 12:12:03.895 {"level":"info","ts":"2024-02-09T12:12:03+05:30","msg":"creating namespace","namespace":"shoot"} {"level":"info","ts":"2024-02-09T12:12:03+05:30","msg":"creating secret","secret":{"namespace":"shoot","name":"ca-etcd-az"}} {"level":"info","ts":"2024-02-09T12:12:03+05:30","msg":"creating secret","secret":{"namespace":"shoot","name":"etcd-server-cert-az"}} {"level":"info","ts":"2024-02-09T12:12:03+05:30","msg":"creating secret","secret":{"namespace":"shoot","name":"etcd-client-tls-az"}} < Exit [BeforeSuite] TOP-LEVEL @ 02/09/24 12:12:03.932 (38ms) [BeforeSuite] PASSED [0.038 seconds] ------------------------------ Etcd when multi-node is configured should perform etcd operations /Users/i585850/go/src/github.com/gardener/etcd-druid/test/e2e/etcd_multi_node_test.go:87 > Enter [BeforeEach] Etcd @ 02/09/24 12:12:03.932 {"level":"info","ts":"2024-02-09T12:12:03+05:30","msg":"creating secret","secret":{"namespace":"shoot","name":"etcd-backup-az"}} < Exit [BeforeEach] Etcd @ 02/09/24 12:12:03.945 (12ms) > Enter [It] should perform etcd operations @ 02/09/24 12:12:03.945 STEP: Create etcd @ 02/09/24 12:12:03.945 {"level":"info","ts":"2024-02-09T12:12:03+05:30","msg":"Waiting for etcd to become ready","etcd-multi-node":"shoot/etcd-az"} {"level":"info","ts":"2024-02-09T12:14:36+05:30","msg":"etcd is ready","etcd-multi-node":"shoot/etcd-az"} {"level":"info","ts":"2024-02-09T12:14:36+05:30","msg":"Checking statefulset","etcd-multi-node":"shoot/etcd-az"} {"level":"info","ts":"2024-02-09T12:14:36+05:30","msg":"Checking configmap","etcd-multi-node":"shoot/etcd-az"} {"level":"info","ts":"2024-02-09T12:14:36+05:30","msg":"Checking client service","etcd-multi-node":"shoot/etcd-az"} STEP: Hibernate etcd (Scale down from 3 replicas to 0) @ 02/09/24 12:14:36.796 {"level":"info","ts":"2024-02-09T12:14:36+05:30","msg":"Waiting to hibernate","etcd-multi-node":"shoot/etcd-az"} {"level":"info","ts":"2024-02-09T12:14:36+05:30","msg":"Checking etcd","etcd-multi-node":"shoot/etcd-az"} {"level":"info","ts":"2024-02-09T12:14:38+05:30","msg":"Checking statefulset","etcd-multi-node":"shoot/etcd-az"} {"level":"info","ts":"2024-02-09T12:14:38+05:30","msg":"etcd is hibernated","etcd-multi-node":"shoot/etcd-az"} STEP: Wakeup etcd (Scale up from 0->3 replicas) @ 02/09/24 12:14:38.837 {"level":"info","ts":"2024-02-09T12:16:43+05:30","msg":"Waiting for etcd to become ready"} {"level":"info","ts":"2024-02-09T12:16:43+05:30","msg":"etcd is ready"} {"level":"info","ts":"2024-02-09T12:16:43+05:30","msg":"Checking statefulset"} {"level":"info","ts":"2024-02-09T12:16:43+05:30","msg":"Checking configmap"} {"level":"info","ts":"2024-02-09T12:16:43+05:30","msg":"Checking client service"} STEP: Zero downtime rolling updates @ 02/09/24 12:16:43.484 {"level":"info","ts":"2024-02-09T12:16:43+05:30","msg":"Creating job to ensure etcd zero downtime","job":"etcd-zero-down-time-validator-rolling-update"} {"level":"info","ts":"2024-02-09T12:16:59+05:30","msg":"Job is ready","job":"etcd-zero-down-time-validator-rolling-update"} {"level":"info","ts":"2024-02-09T12:18:35+05:30","msg":"Waiting for etcd to become ready","etcd-multi-node":"shoot/etcd-az"} {"level":"info","ts":"2024-02-09T12:18:35+05:30","msg":"etcd is ready","etcd-multi-node":"shoot/etcd-az"} {"level":"info","ts":"2024-02-09T12:18:35+05:30","msg":"Checking statefulset","etcd-multi-node":"shoot/etcd-az"} {"level":"info","ts":"2024-02-09T12:18:35+05:30","msg":"Checking configmap","etcd-multi-node":"shoot/etcd-az"} {"level":"info","ts":"2024-02-09T12:18:35+05:30","msg":"Checking client service","etcd-multi-node":"shoot/etcd-az"} {"level":"info","ts":"2024-02-09T12:18:35+05:30","msg":"Etcd Cluster is healthy and there is no downtime","etcd-multi-node":"shoot/etcd-az"} STEP: Zero downtime maintenance operation: defragmentation @ 02/09/24 12:18:35.921 {"level":"info","ts":"2024-02-09T12:18:35+05:30","msg":"Configure defragmentation schedule for every 1 minute","etcd-multi-node":"shoot/etcd-az"} {"level":"info","ts":"2024-02-09T12:19:42+05:30","msg":"Waiting for etcd to become ready","etcd-multi-node":"shoot/etcd-az"} {"level":"info","ts":"2024-02-09T12:19:42+05:30","msg":"etcd is ready","etcd-multi-node":"shoot/etcd-az"} {"level":"info","ts":"2024-02-09T12:19:42+05:30","msg":"Checking statefulset","etcd-multi-node":"shoot/etcd-az"} {"level":"info","ts":"2024-02-09T12:19:42+05:30","msg":"Checking configmap","etcd-multi-node":"shoot/etcd-az"} {"level":"info","ts":"2024-02-09T12:19:42+05:30","msg":"Checking client service","etcd-multi-node":"shoot/etcd-az"} {"level":"info","ts":"2024-02-09T12:19:42+05:30","msg":"Etcd Cluster is healthy and there is no downtime","etcd-multi-node":"shoot/etcd-az"} {"level":"info","ts":"2024-02-09T12:19:42+05:30","msg":"Waiting for defragmentation to finish","etcd-multi-node":"shoot/etcd-az"} {"level":"info","ts":"2024-02-09T12:21:01+05:30","msg":"Defragmentation is finished","etcd-multi-node":"shoot/etcd-az"} {"level":"info","ts":"2024-02-09T12:21:01+05:30","msg":"Checking any Etcd downtime","etcd-multi-node":"shoot/etcd-az"} {"level":"info","ts":"2024-02-09T12:21:01+05:30","msg":"Etcd Cluster is healthy and there is no downtime","etcd-multi-node":"shoot/etcd-az"} STEP: Member restart with data-dir/pvc intact @ 02/09/24 12:21:01.07 {"level":"info","ts":"2024-02-09T12:21:01+05:30","msg":"Delete one member pod","etcd-multi-node":"shoot/etcd-az"} {"level":"info","ts":"2024-02-09T12:21:01+05:30","msg":"waiting for sts to become unready","etcd-multi-node":"shoot/etcd-az"} {"level":"info","ts":"2024-02-09T12:21:03+05:30","msg":"sts is unready","etcd-multi-node":"shoot/etcd-az"} {"level":"info","ts":"2024-02-09T12:21:03+05:30","msg":"Waiting for etcd to become ready","etcd-multi-node":"shoot/etcd-az"} {"level":"info","ts":"2024-02-09T12:21:19+05:30","msg":"etcd is ready","etcd-multi-node":"shoot/etcd-az"} {"level":"info","ts":"2024-02-09T12:21:19+05:30","msg":"Checking statefulset","etcd-multi-node":"shoot/etcd-az"} {"level":"info","ts":"2024-02-09T12:21:19+05:30","msg":"Checking configmap","etcd-multi-node":"shoot/etcd-az"} {"level":"info","ts":"2024-02-09T12:21:19+05:30","msg":"Checking client service","etcd-multi-node":"shoot/etcd-az"} STEP: Single member restoration @ 02/09/24 12:21:19.168 {"level":"info","ts":"2024-02-09T12:21:19+05:30","msg":"Create debug pod","etcd-multi-node":"shoot/etcd-az"} {"level":"info","ts":"2024-02-09T12:21:33+05:30","msg":"Delete member dir of one member pod","etcd-multi-node":"shoot/etcd-az"} {"level":"info","ts":"2024-02-09T12:21:33+05:30","msg":"waiting for sts to become unready","etcd-multi-node":"shoot/etcd-az"} {"level":"info","ts":"2024-02-09T12:21:53+05:30","msg":"sts is unready","etcd-multi-node":"shoot/etcd-az"} {"level":"info","ts":"2024-02-09T12:21:53+05:30","msg":"Waiting for etcd to become ready","etcd-multi-node":"shoot/etcd-az"} {"level":"info","ts":"2024-02-09T12:22:09+05:30","msg":"etcd is ready","etcd-multi-node":"shoot/etcd-az"} {"level":"info","ts":"2024-02-09T12:22:09+05:30","msg":"Checking statefulset","etcd-multi-node":"shoot/etcd-az"} {"level":"info","ts":"2024-02-09T12:22:09+05:30","msg":"Checking configmap","etcd-multi-node":"shoot/etcd-az"} {"level":"info","ts":"2024-02-09T12:22:09+05:30","msg":"Checking client service","etcd-multi-node":"shoot/etcd-az"} STEP: Delete debug pod @ 02/09/24 12:22:09.366 STEP: Delete etcd @ 02/09/24 12:22:09.372 {"level":"info","ts":"2024-02-09T12:22:09+05:30","msg":"Checking if etcd is gone","etcd-multi-node":"shoot/etcd-az"} {"level":"info","ts":"2024-02-09T12:22:15+05:30","msg":"Checking if statefulset is gone","etcd-multi-node":"shoot/etcd-az"} {"level":"info","ts":"2024-02-09T12:22:15+05:30","msg":"Checking if configmap is gone","etcd-multi-node":"shoot/etcd-az"} {"level":"info","ts":"2024-02-09T12:22:15+05:30","msg":"Checking client service is gone","etcd-multi-node":"shoot/etcd-az"} < Exit [It] should perform etcd operations @ 02/09/24 12:22:15.449 (10m11.502s) > Enter [AfterEach] Etcd @ 02/09/24 12:22:15.449 < Exit [AfterEach] Etcd @ 02/09/24 12:22:15.452 (2ms) â€ĸ [611.516 seconds] ------------------------------ Etcd when a single-node is configured should scale a single-node etcd (TLS not enabled for peerUrl) to a multi-node etcd cluster (TLS not enabled for peerUrl) /Users/i585850/go/src/github.com/gardener/etcd-druid/test/e2e/etcd_multi_node_test.go:152 > Enter [BeforeEach] Etcd @ 02/09/24 12:22:15.452 {"level":"info","ts":"2024-02-09T12:22:15+05:30","msg":"creating secret","secret":{"namespace":"shoot","name":"etcd-backup-az"}} < Exit [BeforeEach] Etcd @ 02/09/24 12:22:15.465 (13ms) > Enter [It] should scale a single-node etcd (TLS not enabled for peerUrl) to a multi-node etcd cluster (TLS not enabled for peerUrl) @ 02/09/24 12:22:15.465 STEP: Creating a single-node etcd @ 02/09/24 12:22:15.465 {"level":"info","ts":"2024-02-09T12:22:15+05:30","msg":"Waiting for etcd to become ready","etcd-multi-node":"shoot/etcd-az"} {"level":"info","ts":"2024-02-09T12:22:43+05:30","msg":"etcd is ready","etcd-multi-node":"shoot/etcd-az"} {"level":"info","ts":"2024-02-09T12:22:43+05:30","msg":"Checking statefulset","etcd-multi-node":"shoot/etcd-az"} {"level":"info","ts":"2024-02-09T12:22:43+05:30","msg":"Checking configmap","etcd-multi-node":"shoot/etcd-az"} {"level":"info","ts":"2024-02-09T12:22:43+05:30","msg":"Checking client service","etcd-multi-node":"shoot/etcd-az"} STEP: Scaling up a healthy cluster (from 1 to 3 replicas) @ 02/09/24 12:22:43.627 {"level":"info","ts":"2024-02-09T12:24:00+05:30","msg":"Waiting for etcd to become ready","etcd-multi-node":"shoot/etcd-az"} {"level":"info","ts":"2024-02-09T12:24:00+05:30","msg":"etcd is ready","etcd-multi-node":"shoot/etcd-az"} {"level":"info","ts":"2024-02-09T12:24:00+05:30","msg":"Checking statefulset","etcd-multi-node":"shoot/etcd-az"} {"level":"info","ts":"2024-02-09T12:24:00+05:30","msg":"Checking configmap","etcd-multi-node":"shoot/etcd-az"} {"level":"info","ts":"2024-02-09T12:24:00+05:30","msg":"Checking client service","etcd-multi-node":"shoot/etcd-az"} STEP: Deleting etcd @ 02/09/24 12:24:00.033 {"level":"info","ts":"2024-02-09T12:24:00+05:30","msg":"Checking if etcd is gone","etcd-multi-node":"shoot/etcd-az"} {"level":"info","ts":"2024-02-09T12:24:02+05:30","msg":"Checking if statefulset is gone","etcd-multi-node":"shoot/etcd-az"} {"level":"info","ts":"2024-02-09T12:24:02+05:30","msg":"Checking if configmap is gone","etcd-multi-node":"shoot/etcd-az"} {"level":"info","ts":"2024-02-09T12:24:02+05:30","msg":"Checking client service is gone","etcd-multi-node":"shoot/etcd-az"} < Exit [It] should scale a single-node etcd (TLS not enabled for peerUrl) to a multi-node etcd cluster (TLS not enabled for peerUrl) @ 02/09/24 12:24:02.085 (1m46.62s) > Enter [AfterEach] Etcd @ 02/09/24 12:24:02.085 < Exit [AfterEach] Etcd @ 02/09/24 12:24:02.09 (4ms) â€ĸ [106.638 seconds] ------------------------------ Etcd when a single-node is configured should scale a single-node etcd (TLS not enabled for peerUrl) to a multi-node etcd cluster (TLS enabled for peerUrl) /Users/i585850/go/src/github.com/gardener/etcd-druid/test/e2e/etcd_multi_node_test.go:171 > Enter [BeforeEach] Etcd @ 02/09/24 12:24:02.09 {"level":"info","ts":"2024-02-09T12:24:02+05:30","msg":"creating secret","secret":{"namespace":"shoot","name":"etcd-backup-az"}} < Exit [BeforeEach] Etcd @ 02/09/24 12:24:02.12 (30ms) > Enter [It] should scale a single-node etcd (TLS not enabled for peerUrl) to a multi-node etcd cluster (TLS enabled for peerUrl) @ 02/09/24 12:24:02.12 STEP: Creating a single-node etcd @ 02/09/24 12:24:02.12 {"level":"info","ts":"2024-02-09T12:24:02+05:30","msg":"Waiting for etcd to become ready","etcd-multi-node":"shoot/etcd-az"} {"level":"info","ts":"2024-02-09T12:24:30+05:30","msg":"etcd is ready","etcd-multi-node":"shoot/etcd-az"} {"level":"info","ts":"2024-02-09T12:24:30+05:30","msg":"Checking statefulset","etcd-multi-node":"shoot/etcd-az"} {"level":"info","ts":"2024-02-09T12:24:30+05:30","msg":"Checking configmap","etcd-multi-node":"shoot/etcd-az"} {"level":"info","ts":"2024-02-09T12:24:30+05:30","msg":"Checking client service","etcd-multi-node":"shoot/etcd-az"} STEP: Scaling up a healthy cluster (from 1 to 3 replicas) with TLS enabled for peerUrl @ 02/09/24 12:24:30.31 {"level":"info","ts":"2024-02-09T12:27:13+05:30","msg":"Waiting for etcd to become ready","etcd-multi-node":"shoot/etcd-az"} {"level":"info","ts":"2024-02-09T12:27:17+05:30","msg":"etcd is ready","etcd-multi-node":"shoot/etcd-az"} {"level":"info","ts":"2024-02-09T12:27:17+05:30","msg":"Checking statefulset","etcd-multi-node":"shoot/etcd-az"} {"level":"info","ts":"2024-02-09T12:27:17+05:30","msg":"Checking configmap","etcd-multi-node":"shoot/etcd-az"} {"level":"info","ts":"2024-02-09T12:27:17+05:30","msg":"Checking client service","etcd-multi-node":"shoot/etcd-az"} STEP: Deleting the single-node etcd @ 02/09/24 12:27:17.308 {"level":"info","ts":"2024-02-09T12:27:17+05:30","msg":"Checking if etcd is gone","etcd-multi-node":"shoot/etcd-az"} {"level":"info","ts":"2024-02-09T12:27:23+05:30","msg":"Checking if statefulset is gone","etcd-multi-node":"shoot/etcd-az"} {"level":"info","ts":"2024-02-09T12:27:23+05:30","msg":"Checking if configmap is gone","etcd-multi-node":"shoot/etcd-az"} {"level":"info","ts":"2024-02-09T12:27:23+05:30","msg":"Checking client service is gone","etcd-multi-node":"shoot/etcd-az"} < Exit [It] should scale a single-node etcd (TLS not enabled for peerUrl) to a multi-node etcd cluster (TLS enabled for peerUrl) @ 02/09/24 12:27:23.376 (3m21.255s) > Enter [AfterEach] Etcd @ 02/09/24 12:27:23.376 < Exit [AfterEach] Etcd @ 02/09/24 12:27:23.379 (3ms) â€ĸ [201.288 seconds] ------------------------------ Etcd when a single-node is configured should scale down a single-node etcd to 0, then scale up from 0->1 replicas and then from 1->3 replicas /Users/i585850/go/src/github.com/gardener/etcd-druid/test/e2e/etcd_multi_node_test.go:191 > Enter [BeforeEach] Etcd @ 02/09/24 12:27:23.379 {"level":"info","ts":"2024-02-09T12:27:23+05:30","msg":"creating secret","secret":{"namespace":"shoot","name":"etcd-backup-az"}} < Exit [BeforeEach] Etcd @ 02/09/24 12:27:23.394 (15ms) > Enter [It] should scale down a single-node etcd to 0, then scale up from 0->1 replicas and then from 1->3 replicas @ 02/09/24 12:27:23.394 STEP: Creating a single-node etcd @ 02/09/24 12:27:23.394 {"level":"info","ts":"2024-02-09T12:27:23+05:30","msg":"Waiting for etcd to become ready","etcd-multi-node":"shoot/etcd-az"} {"level":"info","ts":"2024-02-09T12:27:51+05:30","msg":"etcd is ready","etcd-multi-node":"shoot/etcd-az"} {"level":"info","ts":"2024-02-09T12:27:51+05:30","msg":"Checking statefulset","etcd-multi-node":"shoot/etcd-az"} {"level":"info","ts":"2024-02-09T12:27:51+05:30","msg":"Checking configmap","etcd-multi-node":"shoot/etcd-az"} {"level":"info","ts":"2024-02-09T12:27:51+05:30","msg":"Checking client service","etcd-multi-node":"shoot/etcd-az"} STEP: Scaling down a healthy cluster (from 1 to 0 replica) @ 02/09/24 12:27:51.563 {"level":"info","ts":"2024-02-09T12:27:57+05:30","msg":"Waiting for etcd to become ready","etcd-multi-node":"shoot/etcd-az"} {"level":"info","ts":"2024-02-09T12:27:57+05:30","msg":"etcd is ready","etcd-multi-node":"shoot/etcd-az"} {"level":"info","ts":"2024-02-09T12:27:57+05:30","msg":"Checking statefulset","etcd-multi-node":"shoot/etcd-az"} {"level":"info","ts":"2024-02-09T12:27:57+05:30","msg":"Checking configmap","etcd-multi-node":"shoot/etcd-az"} {"level":"info","ts":"2024-02-09T12:27:57+05:30","msg":"Checking client service","etcd-multi-node":"shoot/etcd-az"} STEP: Scaling up cluster (from 0 to 1 replica) @ 02/09/24 12:27:57.645 {"level":"info","ts":"2024-02-09T12:28:23+05:30","msg":"Waiting for etcd to become ready","etcd-multi-node":"shoot/etcd-az"} {"level":"info","ts":"2024-02-09T12:28:23+05:30","msg":"etcd is ready","etcd-multi-node":"shoot/etcd-az"} {"level":"info","ts":"2024-02-09T12:28:23+05:30","msg":"Checking statefulset","etcd-multi-node":"shoot/etcd-az"} {"level":"info","ts":"2024-02-09T12:28:23+05:30","msg":"Checking configmap","etcd-multi-node":"shoot/etcd-az"} {"level":"info","ts":"2024-02-09T12:28:23+05:30","msg":"Checking client service","etcd-multi-node":"shoot/etcd-az"} STEP: Scaling up a healthy cluster (from 1 to 3 replica) @ 02/09/24 12:28:23.826 {"level":"info","ts":"2024-02-09T12:29:50+05:30","msg":"Waiting for etcd to become ready","etcd-multi-node":"shoot/etcd-az"} {"level":"info","ts":"2024-02-09T12:29:52+05:30","msg":"etcd is ready","etcd-multi-node":"shoot/etcd-az"} {"level":"info","ts":"2024-02-09T12:29:52+05:30","msg":"Checking statefulset","etcd-multi-node":"shoot/etcd-az"} {"level":"info","ts":"2024-02-09T12:29:52+05:30","msg":"Checking configmap","etcd-multi-node":"shoot/etcd-az"} {"level":"info","ts":"2024-02-09T12:29:52+05:30","msg":"Checking client service","etcd-multi-node":"shoot/etcd-az"} STEP: Deleting the single-node etcd @ 02/09/24 12:29:52.351 {"level":"info","ts":"2024-02-09T12:29:52+05:30","msg":"Checking if etcd is gone","etcd-multi-node":"shoot/etcd-az"} {"level":"info","ts":"2024-02-09T12:29:58+05:30","msg":"Checking if statefulset is gone","etcd-multi-node":"shoot/etcd-az"} {"level":"info","ts":"2024-02-09T12:29:58+05:30","msg":"Checking if configmap is gone","etcd-multi-node":"shoot/etcd-az"} {"level":"info","ts":"2024-02-09T12:29:58+05:30","msg":"Checking client service is gone","etcd-multi-node":"shoot/etcd-az"} < Exit [It] should scale down a single-node etcd to 0, then scale up from 0->1 replicas and then from 1->3 replicas @ 02/09/24 12:29:58.421 (2m35.027s) > Enter [AfterEach] Etcd @ 02/09/24 12:29:58.421 < Exit [AfterEach] Etcd @ 02/09/24 12:29:58.424 (3ms) â€ĸ [155.046 seconds] ------------------------------ Etcd when a single-node is configured should scale down a single-node etcd to 0 replica, then scale up from 0->1 replica and then from 1->3 replicas with TLS enabled for cluster peerUrl /Users/i585850/go/src/github.com/gardener/etcd-druid/test/e2e/etcd_multi_node_test.go:220 > Enter [BeforeEach] Etcd @ 02/09/24 12:29:58.424 {"level":"info","ts":"2024-02-09T12:29:58+05:30","msg":"creating secret","secret":{"namespace":"shoot","name":"etcd-backup-az"}} < Exit [BeforeEach] Etcd @ 02/09/24 12:29:58.433 (9ms) > Enter [It] should scale down a single-node etcd to 0 replica, then scale up from 0->1 replica and then from 1->3 replicas with TLS enabled for cluster peerUrl @ 02/09/24 12:29:58.433 STEP: Creating a single-node etcd @ 02/09/24 12:29:58.433 {"level":"info","ts":"2024-02-09T12:29:58+05:30","msg":"Waiting for etcd to become ready","etcd-multi-node":"shoot/etcd-az"} {"level":"info","ts":"2024-02-09T12:30:26+05:30","msg":"etcd is ready","etcd-multi-node":"shoot/etcd-az"} {"level":"info","ts":"2024-02-09T12:30:26+05:30","msg":"Checking statefulset","etcd-multi-node":"shoot/etcd-az"} {"level":"info","ts":"2024-02-09T12:30:26+05:30","msg":"Checking configmap","etcd-multi-node":"shoot/etcd-az"} {"level":"info","ts":"2024-02-09T12:30:26+05:30","msg":"Checking client service","etcd-multi-node":"shoot/etcd-az"} STEP: Scaling down a healthy cluster (from 1 to 0 replica) @ 02/09/24 12:30:26.582 {"level":"info","ts":"2024-02-09T12:30:32+05:30","msg":"Waiting for etcd to become ready","etcd-multi-node":"shoot/etcd-az"} {"level":"info","ts":"2024-02-09T12:30:32+05:30","msg":"etcd is ready","etcd-multi-node":"shoot/etcd-az"} {"level":"info","ts":"2024-02-09T12:30:32+05:30","msg":"Checking statefulset","etcd-multi-node":"shoot/etcd-az"} {"level":"info","ts":"2024-02-09T12:30:32+05:30","msg":"Checking configmap","etcd-multi-node":"shoot/etcd-az"} {"level":"info","ts":"2024-02-09T12:30:32+05:30","msg":"Checking client service","etcd-multi-node":"shoot/etcd-az"} STEP: Scaling up cluster (from 0 to 1 replica) @ 02/09/24 12:30:32.677 {"level":"info","ts":"2024-02-09T12:30:58+05:30","msg":"Waiting for etcd to become ready","etcd-multi-node":"shoot/etcd-az"} {"level":"info","ts":"2024-02-09T12:30:58+05:30","msg":"etcd is ready","etcd-multi-node":"shoot/etcd-az"} {"level":"info","ts":"2024-02-09T12:30:58+05:30","msg":"Checking statefulset","etcd-multi-node":"shoot/etcd-az"} {"level":"info","ts":"2024-02-09T12:30:58+05:30","msg":"Checking configmap","etcd-multi-node":"shoot/etcd-az"} {"level":"info","ts":"2024-02-09T12:30:58+05:30","msg":"Checking client service","etcd-multi-node":"shoot/etcd-az"} STEP: Scaling up a healthy cluster (from 1 to 3 replica) with TLS enabled for peerUrl @ 02/09/24 12:30:58.912 {"level":"info","ts":"2024-02-09T12:33:44+05:30","msg":"Waiting for etcd to become ready","etcd-multi-node":"shoot/etcd-az"} {"level":"info","ts":"2024-02-09T12:33:44+05:30","msg":"etcd is ready","etcd-multi-node":"shoot/etcd-az"} {"level":"info","ts":"2024-02-09T12:33:44+05:30","msg":"Checking statefulset","etcd-multi-node":"shoot/etcd-az"} {"level":"info","ts":"2024-02-09T12:33:44+05:30","msg":"Checking configmap","etcd-multi-node":"shoot/etcd-az"} {"level":"info","ts":"2024-02-09T12:33:44+05:30","msg":"Checking client service","etcd-multi-node":"shoot/etcd-az"} STEP: Deleting the single-node etcd @ 02/09/24 12:33:44.063 {"level":"info","ts":"2024-02-09T12:33:44+05:30","msg":"Checking if etcd is gone","etcd-multi-node":"shoot/etcd-az"} {"level":"info","ts":"2024-02-09T12:33:50+05:30","msg":"Checking if statefulset is gone","etcd-multi-node":"shoot/etcd-az"} {"level":"info","ts":"2024-02-09T12:33:50+05:30","msg":"Checking if configmap is gone","etcd-multi-node":"shoot/etcd-az"} {"level":"info","ts":"2024-02-09T12:33:50+05:30","msg":"Checking client service is gone","etcd-multi-node":"shoot/etcd-az"} < Exit [It] should scale down a single-node etcd to 0 replica, then scale up from 0->1 replica and then from 1->3 replicas with TLS enabled for cluster peerUrl @ 02/09/24 12:33:50.139 (3m51.705s) > Enter [AfterEach] Etcd @ 02/09/24 12:33:50.139 < Exit [AfterEach] Etcd @ 02/09/24 12:33:50.142 (3ms) â€ĸ [231.717 seconds] ------------------------------ Etcd Backup when single-node etcd is configured with provider az Should create, test backup and delete etcd with backup /Users/i585850/go/src/github.com/gardener/etcd-druid/test/e2e/etcd_backup_test.go:78 > Enter [BeforeEach] Etcd Backup @ 02/09/24 12:33:50.143 < Exit [BeforeEach] Etcd Backup @ 02/09/24 12:33:50.143 (0s) > Enter [BeforeEach] with provider az @ 02/09/24 12:33:50.143 {"level":"info","ts":"2024-02-09T12:33:50+05:30","msg":"creating secret","secret":{"namespace":"shoot","name":"etcd-backup-az"}} < Exit [BeforeEach] with provider az @ 02/09/24 12:33:50.166 (23ms) > Enter [It] Should create, test backup and delete etcd with backup @ 02/09/24 12:33:50.166 STEP: Create etcd @ 02/09/24 12:33:50.166 {"level":"info","ts":"2024-02-09T12:33:50+05:30","msg":"Waiting for etcd to become ready","etcd":"shoot/etcd-az"} {"level":"info","ts":"2024-02-09T12:34:22+05:30","msg":"etcd is ready","etcd":"shoot/etcd-az"} {"level":"info","ts":"2024-02-09T12:34:22+05:30","msg":"Checking statefulset","etcd":"shoot/etcd-az"} {"level":"info","ts":"2024-02-09T12:34:22+05:30","msg":"Checking configmap","etcd":"shoot/etcd-az"} {"level":"info","ts":"2024-02-09T12:34:22+05:30","msg":"Checking client service","etcd":"shoot/etcd-az"} STEP: Create debug pod @ 02/09/24 12:34:22.405 STEP: Check initial snapshot is available @ 02/09/24 12:34:26.448 STEP: Put keys into etcd @ 02/09/24 12:34:26.548 {"level":"info","ts":"2024-02-09T12:34:26+05:30","msg":"populating etcd with sequential key-value pairs","fromKey":"foo-1","fromValue":"bar-1","toKey":"foo-10","toValue":"bar-10"} {"level":"info","ts":"2024-02-09T12:34:36+05:30","msg":"put key-value successful","key":"foo-1","value":"bar-1"} {"level":"info","ts":"2024-02-09T12:34:36+05:30","msg":"put key-value successful","key":"foo-2","value":"bar-2"} {"level":"info","ts":"2024-02-09T12:34:36+05:30","msg":"put key-value successful","key":"foo-3","value":"bar-3"} {"level":"info","ts":"2024-02-09T12:34:37+05:30","msg":"put key-value successful","key":"foo-4","value":"bar-4"} {"level":"info","ts":"2024-02-09T12:34:37+05:30","msg":"put key-value successful","key":"foo-5","value":"bar-5"} {"level":"info","ts":"2024-02-09T12:34:37+05:30","msg":"put key-value successful","key":"foo-6","value":"bar-6"} {"level":"info","ts":"2024-02-09T12:34:37+05:30","msg":"put key-value successful","key":"foo-7","value":"bar-7"} {"level":"info","ts":"2024-02-09T12:34:37+05:30","msg":"put key-value successful","key":"foo-8","value":"bar-8"} {"level":"info","ts":"2024-02-09T12:34:37+05:30","msg":"put key-value successful","key":"foo-9","value":"bar-9"} {"level":"info","ts":"2024-02-09T12:34:38+05:30","msg":"put key-value successful","key":"foo-10","value":"bar-10"} STEP: Check snapshot after putting data into etcd @ 02/09/24 12:34:38.181 STEP: Trigger on-demand full snapshot @ 02/09/24 12:34:38.286 STEP: Put additional data into etcd @ 02/09/24 12:34:38.352 {"level":"info","ts":"2024-02-09T12:34:38+05:30","msg":"populating etcd with sequential key-value pairs","fromKey":"foo-11","fromValue":"bar-11","toKey":"foo-15","toValue":"bar-15"} {"level":"info","ts":"2024-02-09T12:34:47+05:30","msg":"put key-value successful","key":"foo-11","value":"bar-11"} {"level":"info","ts":"2024-02-09T12:34:47+05:30","msg":"put key-value successful","key":"foo-12","value":"bar-12"} {"level":"info","ts":"2024-02-09T12:34:47+05:30","msg":"put key-value successful","key":"foo-13","value":"bar-13"} {"level":"info","ts":"2024-02-09T12:34:47+05:30","msg":"put key-value successful","key":"foo-14","value":"bar-14"} {"level":"info","ts":"2024-02-09T12:34:47+05:30","msg":"put key-value successful","key":"foo-15","value":"bar-15"} STEP: Trigger on-demand delta snapshot @ 02/09/24 12:34:47.826 STEP: Test cluster restoration by deleting data directory @ 02/09/24 12:34:47.877 {"level":"info","ts":"2024-02-09T12:34:47+05:30","msg":"waiting for sts to become unready","statefulSetName":"etcd-az"} {"level":"info","ts":"2024-02-09T12:35:08+05:30","msg":"sts is unready","statefulSetName":"etcd-az"} {"level":"info","ts":"2024-02-09T12:35:08+05:30","msg":"waiting for sts to become ready again","statefulSetName":"etcd-az"} {"level":"info","ts":"2024-02-09T12:35:26+05:30","msg":"sts is ready","statefulSetName":"etcd-az"} {"level":"info","ts":"2024-02-09T12:35:26+05:30","msg":"fetching etcd key-value pairs"} {"level":"info","ts":"2024-02-09T12:35:26+05:30","msg":"fetched key-value pair from etcd","key":"foo-1","value":"bar-1"} {"level":"info","ts":"2024-02-09T12:35:26+05:30","msg":"fetched key-value pair from etcd","key":"foo-2","value":"bar-2"} {"level":"info","ts":"2024-02-09T12:35:26+05:30","msg":"fetched key-value pair from etcd","key":"foo-3","value":"bar-3"} {"level":"info","ts":"2024-02-09T12:35:26+05:30","msg":"fetched key-value pair from etcd","key":"foo-4","value":"bar-4"} {"level":"info","ts":"2024-02-09T12:35:27+05:30","msg":"fetched key-value pair from etcd","key":"foo-5","value":"bar-5"} {"level":"info","ts":"2024-02-09T12:35:27+05:30","msg":"fetched key-value pair from etcd","key":"foo-6","value":"bar-6"} {"level":"info","ts":"2024-02-09T12:35:27+05:30","msg":"fetched key-value pair from etcd","key":"foo-7","value":"bar-7"} {"level":"info","ts":"2024-02-09T12:35:27+05:30","msg":"fetched key-value pair from etcd","key":"foo-8","value":"bar-8"} {"level":"info","ts":"2024-02-09T12:35:27+05:30","msg":"fetched key-value pair from etcd","key":"foo-9","value":"bar-9"} {"level":"info","ts":"2024-02-09T12:35:28+05:30","msg":"fetched key-value pair from etcd","key":"foo-10","value":"bar-10"} {"level":"info","ts":"2024-02-09T12:35:28+05:30","msg":"fetched key-value pair from etcd","key":"foo-11","value":"bar-11"} {"level":"info","ts":"2024-02-09T12:35:28+05:30","msg":"fetched key-value pair from etcd","key":"foo-12","value":"bar-12"} {"level":"info","ts":"2024-02-09T12:35:28+05:30","msg":"fetched key-value pair from etcd","key":"foo-13","value":"bar-13"} {"level":"info","ts":"2024-02-09T12:35:28+05:30","msg":"fetched key-value pair from etcd","key":"foo-14","value":"bar-14"} {"level":"info","ts":"2024-02-09T12:35:29+05:30","msg":"fetched key-value pair from etcd","key":"foo-15","value":"bar-15"} STEP: Delete debug pod @ 02/09/24 12:35:29.11 STEP: Delete etcd @ 02/09/24 12:35:29.113 {"level":"info","ts":"2024-02-09T12:35:29+05:30","msg":"Checking if etcd is gone","etcd":"shoot/etcd-az"} {"level":"info","ts":"2024-02-09T12:35:31+05:30","msg":"Checking if statefulset is gone","etcd":"shoot/etcd-az"} {"level":"info","ts":"2024-02-09T12:35:31+05:30","msg":"Checking if configmap is gone","etcd":"shoot/etcd-az"} {"level":"info","ts":"2024-02-09T12:35:31+05:30","msg":"Checking client service is gone","etcd":"shoot/etcd-az"} < Exit [It] Should create, test backup and delete etcd with backup @ 02/09/24 12:35:31.157 (1m40.991s) â€ĸ [101.014 seconds] ------------------------------ Etcd Compaction when compaction is enabled for single-node etcd with provider az should test compaction on backup /Users/i585850/go/src/github.com/gardener/etcd-druid/test/e2e/etcd_compaction_test.go:71 > Enter [BeforeEach] Etcd Compaction @ 02/09/24 12:35:31.157 < Exit [BeforeEach] Etcd Compaction @ 02/09/24 12:35:31.157 (0s) > Enter [BeforeEach] with provider az @ 02/09/24 12:35:31.157 {"level":"info","ts":"2024-02-09T12:35:31+05:30","msg":"creating secret","secret":{"namespace":"shoot","name":"etcd-backup-az"}} < Exit [BeforeEach] with provider az @ 02/09/24 12:35:31.195 (38ms) > Enter [It] should test compaction on backup @ 02/09/24 12:35:31.195 STEP: Create etcd @ 02/09/24 12:35:31.195 {"level":"info","ts":"2024-02-09T12:35:31+05:30","msg":"Waiting for etcd to become ready","etcd":"shoot/etcd-az"} {"level":"info","ts":"2024-02-09T12:35:59+05:30","msg":"etcd is ready","etcd":"shoot/etcd-az"} {"level":"info","ts":"2024-02-09T12:35:59+05:30","msg":"Checking statefulset","etcd":"shoot/etcd-az"} {"level":"info","ts":"2024-02-09T12:35:59+05:30","msg":"Checking configmap","etcd":"shoot/etcd-az"} {"level":"info","ts":"2024-02-09T12:35:59+05:30","msg":"Checking client service","etcd":"shoot/etcd-az"} STEP: Create debug pod @ 02/09/24 12:35:59.364 STEP: Check initial snapshot is available @ 02/09/24 12:36:03.386 STEP: Put keys into etcd @ 02/09/24 12:36:03.456 {"level":"info","ts":"2024-02-09T12:36:03+05:30","msg":"populating etcd with sequential key-value pairs","fromKey":"foo-1","fromValue":"bar-1","toKey":"foo-10","toValue":"bar-10"} {"level":"info","ts":"2024-02-09T12:36:12+05:30","msg":"put key-value successful","key":"foo-1","value":"bar-1"} {"level":"info","ts":"2024-02-09T12:36:12+05:30","msg":"put key-value successful","key":"foo-2","value":"bar-2"} {"level":"info","ts":"2024-02-09T12:36:12+05:30","msg":"put key-value successful","key":"foo-3","value":"bar-3"} {"level":"info","ts":"2024-02-09T12:36:12+05:30","msg":"put key-value successful","key":"foo-4","value":"bar-4"} {"level":"info","ts":"2024-02-09T12:36:13+05:30","msg":"put key-value successful","key":"foo-5","value":"bar-5"} {"level":"info","ts":"2024-02-09T12:36:13+05:30","msg":"put key-value successful","key":"foo-6","value":"bar-6"} {"level":"info","ts":"2024-02-09T12:36:13+05:30","msg":"put key-value successful","key":"foo-7","value":"bar-7"} {"level":"info","ts":"2024-02-09T12:36:13+05:30","msg":"put key-value successful","key":"foo-8","value":"bar-8"} {"level":"info","ts":"2024-02-09T12:36:13+05:30","msg":"put key-value successful","key":"foo-9","value":"bar-9"} {"level":"info","ts":"2024-02-09T12:36:14+05:30","msg":"put key-value successful","key":"foo-10","value":"bar-10"} STEP: Check snapshot after putting data into etcd @ 02/09/24 12:36:14.015 STEP: Put additional data into etcd @ 02/09/24 12:36:14.115 {"level":"info","ts":"2024-02-09T12:36:14+05:30","msg":"populating etcd with sequential key-value pairs","fromKey":"foo-11","fromValue":"bar-11","toKey":"foo-15","toValue":"bar-15"} {"level":"info","ts":"2024-02-09T12:36:22+05:30","msg":"put key-value successful","key":"foo-11","value":"bar-11"} {"level":"info","ts":"2024-02-09T12:36:23+05:30","msg":"put key-value successful","key":"foo-12","value":"bar-12"} {"level":"info","ts":"2024-02-09T12:36:23+05:30","msg":"put key-value successful","key":"foo-13","value":"bar-13"} {"level":"info","ts":"2024-02-09T12:36:23+05:30","msg":"put key-value successful","key":"foo-14","value":"bar-14"} {"level":"info","ts":"2024-02-09T12:36:23+05:30","msg":"put key-value successful","key":"foo-15","value":"bar-15"} STEP: Trigger on-demand delta snapshot @ 02/09/24 12:36:23.638 {"level":"info","ts":"2024-02-09T12:36:23+05:30","msg":"waiting for compaction job to become successful"} {"level":"info","ts":"2024-02-09T12:36:57+05:30","msg":"compaction job is successful"} STEP: Verify that all the delta snapshots are compacted to full snapshots by compaction triggerred at first 15th revision @ 02/09/24 12:36:57.789 STEP: Put additional data into etcd @ 02/09/24 12:36:57.881 {"level":"info","ts":"2024-02-09T12:36:57+05:30","msg":"populating etcd with sequential key-value pairs","fromKey":"foo-16","fromValue":"bar-16","toKey":"foo-20","toValue":"bar-20"} {"level":"info","ts":"2024-02-09T12:37:07+05:30","msg":"put key-value successful","key":"foo-16","value":"bar-16"} {"level":"info","ts":"2024-02-09T12:37:07+05:30","msg":"put key-value successful","key":"foo-17","value":"bar-17"} {"level":"info","ts":"2024-02-09T12:37:07+05:30","msg":"put key-value successful","key":"foo-18","value":"bar-18"} {"level":"info","ts":"2024-02-09T12:37:07+05:30","msg":"put key-value successful","key":"foo-19","value":"bar-19"} {"level":"info","ts":"2024-02-09T12:37:07+05:30","msg":"put key-value successful","key":"foo-20","value":"bar-20"} STEP: Trigger on-demand delta snapshot @ 02/09/24 12:37:07.849 STEP: Verify that there are new delta snapshots as compaction is not triggered yet because delta events have not reached next 15 revision @ 02/09/24 12:37:07.901 STEP: Delete debug pod @ 02/09/24 12:37:07.947 STEP: Delete etcd @ 02/09/24 12:37:07.951 {"level":"info","ts":"2024-02-09T12:37:07+05:30","msg":"Checking if etcd is gone","etcd":"shoot/etcd-az"} {"level":"info","ts":"2024-02-09T12:37:13+05:30","msg":"Checking if statefulset is gone","etcd":"shoot/etcd-az"} {"level":"info","ts":"2024-02-09T12:37:13+05:30","msg":"Checking if configmap is gone","etcd":"shoot/etcd-az"} {"level":"info","ts":"2024-02-09T12:37:13+05:30","msg":"Checking client service is gone","etcd":"shoot/etcd-az"} < Exit [It] should test compaction on backup @ 02/09/24 12:37:14.012 (1m42.817s) â€ĸ [102.855 seconds] ------------------------------ [AfterSuite] /Users/i585850/go/src/github.com/gardener/etcd-druid/test/e2e/suite_test.go:108 > Enter [AfterSuite] TOP-LEVEL @ 02/09/24 12:37:14.012 {"level":"info","ts":"2024-02-09T12:37:14+05:30","msg":"deleting namespace","namespace":"shoot","namespace":"shoot"} < Exit [AfterSuite] TOP-LEVEL @ 02/09/24 12:37:20.05 (6.038s) [AfterSuite] PASSED [6.038 seconds] ------------------------------ Ran 7 of 7 Specs in 1516.151 seconds SUCCESS! -- 7 Passed | 0 Failed | 0 Pending | 0 Skipped --- PASS: TestIntegration (1516.15s) PASS ok github.com/gardener/etcd-druid/test/e2e 1516.207s hack/tools/bin/kind delete cluster --name etcd-druid-e2e Deleting cluster "etcd-druid-e2e" ... Deleted nodes: ["etcd-druid-e2e-control-plane"]