Local cluster cannot be accessed (127.0.0.1 connection refused) when testing against 1.21+

[bobbygryzynger]

When attempting to run tests against the local cluster created by envtest, the logs repeatedly show connection refused errors and ultimately the tests fail because of this.

Logged output from:

$ KUBEBUILDER_ASSETS="/home/bgryzyng/.local/share/kubebuilder-envtest/k8s/1.21.2-linux-amd64" KUBEBUILDER_ATTACH_CONTROL_PLANE_OUTPUT=true go test ./... -coverprofile cover.out

Running Suite: Controller Suite
===============================
Random Seed: 1633961579
Will run 1 of 1 specs
[WARNING] Deprecated '--logger=capnslog' flag is set; use '--logger=zap' flag instead

2021-10-11 10:12:59.733856 I | etcdmain: etcd Version: 3.4.16

2021-10-11 10:12:59.733920 I | etcdmain: Git SHA: d19fbe541

2021-10-11 10:12:59.733924 I | etcdmain: Go Version: go1.12.17

2021-10-11 10:12:59.733928 I | etcdmain: Go OS/Arch: linux/amd64

2021-10-11 10:12:59.733932 I | etcdmain: setting maximum number of CPUs to 12, total number of available CPUs is 12

[WARNING] Deprecated '--logger=capnslog' flag is set; use '--logger=zap' flag instead

2021-10-11 10:12:59.734493 I | embed: name = default

2021-10-11 10:12:59.734504 I | embed: data dir = /tmp/k8s_test_framework_1420357164

2021-10-11 10:12:59.734509 I | embed: member dir = /tmp/k8s_test_framework_1420357164/member

2021-10-11 10:12:59.734513 I | embed: heartbeat = 100ms

2021-10-11 10:12:59.734520 I | embed: election = 1000ms

2021-10-11 10:12:59.734524 I | embed: snapshot count = 100000

2021-10-11 10:12:59.734533 I | embed: advertise client URLs = http://127.0.0.1:43255

2021-10-11 10:12:59.746077 I | etcdserver: starting member 8e9e05c52164694d in cluster cdf818194e3a8c32

raft2021/10/11 10:12:59 INFO: 8e9e05c52164694d switched to configuration voters=()

raft2021/10/11 10:12:59 INFO: 8e9e05c52164694d became follower at term 0

raft2021/10/11 10:12:59 INFO: newRaft 8e9e05c52164694d [peers: [], term: 0, commit: 0, applied: 0, lastindex: 0, lastterm: 0]

raft2021/10/11 10:12:59 INFO: 8e9e05c52164694d became follower at term 1

raft2021/10/11 10:12:59 INFO: 8e9e05c52164694d switched to configuration voters=(10276657743932975437)

2021-10-11 10:12:59.746538 W | auth: simple token is not cryptographically signed

2021-10-11 10:12:59.747084 I | etcdserver: starting server... [version: 3.4.16, cluster version: to_be_decided]

2021-10-11 10:12:59.747344 I | etcdserver: 8e9e05c52164694d as single-node; fast-forwarding 9 ticks (election ticks 10)

raft2021/10/11 10:12:59 INFO: 8e9e05c52164694d switched to configuration voters=(10276657743932975437)

2021-10-11 10:12:59.747559 I | etcdserver/membership: added member 8e9e05c52164694d [http://localhost:2380] to cluster cdf818194e3a8c32

2021-10-11 10:12:59.749014 I | embed: listening for peers on 127.0.0.1:37707

raft2021/10/11 10:13:00 INFO: 8e9e05c52164694d is starting a new election at term 1

raft2021/10/11 10:13:00 INFO: 8e9e05c52164694d became candidate at term 2

raft2021/10/11 10:13:00 INFO: 8e9e05c52164694d received MsgVoteResp from 8e9e05c52164694d at term 2

raft2021/10/11 10:13:00 INFO: 8e9e05c52164694d became leader at term 2

raft2021/10/11 10:13:00 INFO: raft.node: 8e9e05c52164694d elected leader 8e9e05c52164694d at term 2

2021-10-11 10:13:00.046742 I | etcdserver: published {Name:default ClientURLs:[http://127.0.0.1:43255]} to cluster cdf818194e3a8c32

2021-10-11 10:13:00.046759 I | embed: ready to serve client requests

2021-10-11 10:13:00.046796 I | etcdserver: setting up the initial cluster version to 3.4

2021-10-11 10:13:00.046868 N | etcdserver/membership: set the initial cluster version to 3.4

2021-10-11 10:13:00.046903 I | etcdserver/api: enabled capabilities for version 3.4

2021-10-11 10:13:00.047256 N | embed: serving insecure client requests on 127.0.0.1:43255, this is strongly discouraged!

I1011 10:13:00.697999 1219802 server.go:629] external host was not specified, using 192.168.1.190

I1011 10:13:00.698308 1219802 server.go:181] Version: v1.21.2

I1011 10:13:01.201599 1219802 plugins.go:158] Loaded 10 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,StorageObjectInUseProtection,RuntimeClass,DefaultIngressClass,MutatingAdmissionWebhook.

I1011 10:13:01.201614 1219802 plugins.go:161] Loaded 9 validating admission controller(s) successfully in the following order: LimitRanger,Priority,PersistentVolumeClaimResize,RuntimeClass,CertificateApproval,CertificateSigning,CertificateSubjectRestriction,ValidatingAdmissionWebhook,ResourceQuota.

I1011 10:13:01.202569 1219802 plugins.go:158] Loaded 10 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,StorageObjectInUseProtection,RuntimeClass,DefaultIngressClass,MutatingAdmissionWebhook.

I1011 10:13:01.202580 1219802 plugins.go:161] Loaded 9 validating admission controller(s) successfully in the following order: LimitRanger,Priority,PersistentVolumeClaimResize,RuntimeClass,CertificateApproval,CertificateSigning,CertificateSubjectRestriction,ValidatingAdmissionWebhook,ResourceQuota.

I1011 10:13:01.204672 1219802 client.go:360] parsed scheme: "endpoint"

I1011 10:13:01.204693 1219802 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{http://127.0.0.1:43255   0 }]

I1011 10:13:01.205318 1219802 client.go:360] parsed scheme: "endpoint"

I1011 10:13:01.205332 1219802 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{http://127.0.0.1:43255   0 }]

I1011 10:13:01.205785 1219802 client.go:360] parsed scheme: "passthrough"

I1011 10:13:01.205804 1219802 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{http://127.0.0.1:43255   0 }]  }

I1011 10:13:01.205811 1219802 clientconn.go:948] ClientConn switching balancer to "pick_first"

I1011 10:13:01.206150 1219802 client.go:360] parsed scheme: "endpoint"

I1011 10:13:01.206164 1219802 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{http://127.0.0.1:43255   0 }]

I1011 10:13:01.226136 1219802 instance.go:283] Using reconciler: lease

I1011 10:13:01.226249 1219802 client.go:360] parsed scheme: "endpoint"

I1011 10:13:01.226261 1219802 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{http://127.0.0.1:43255   0 }]

I1011 10:13:01.227955 1219802 client.go:360] parsed scheme: "endpoint"

I1011 10:13:01.227971 1219802 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{http://127.0.0.1:43255   0 }]

I1011 10:13:01.228515 1219802 client.go:360] parsed scheme: "endpoint"

I1011 10:13:01.228809 1219802 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{http://127.0.0.1:43255   0 }]

I1011 10:13:01.230374 1219802 client.go:360] parsed scheme: "endpoint"

I1011 10:13:01.230413 1219802 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{http://127.0.0.1:43255   0 }]

I1011 10:13:01.231156 1219802 client.go:360] parsed scheme: "endpoint"

I1011 10:13:01.231168 1219802 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{http://127.0.0.1:43255   0 }]

I1011 10:13:01.231728 1219802 client.go:360] parsed scheme: "endpoint"

I1011 10:13:01.231745 1219802 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{http://127.0.0.1:43255   0 }]

I1011 10:13:01.232240 1219802 client.go:360] parsed scheme: "endpoint"

I1011 10:13:01.232258 1219802 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{http://127.0.0.1:43255   0 }]

I1011 10:13:01.232752 1219802 client.go:360] parsed scheme: "endpoint"

I1011 10:13:01.232768 1219802 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{http://127.0.0.1:43255   0 }]

I1011 10:13:01.233241 1219802 client.go:360] parsed scheme: "endpoint"

I1011 10:13:01.233256 1219802 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{http://127.0.0.1:43255   0 }]

I1011 10:13:01.233802 1219802 client.go:360] parsed scheme: "endpoint"

I1011 10:13:01.233819 1219802 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{http://127.0.0.1:43255   0 }]

I1011 10:13:01.235010 1219802 client.go:360] parsed scheme: "endpoint"

I1011 10:13:01.235024 1219802 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{http://127.0.0.1:43255   0 }]

I1011 10:13:01.235444 1219802 client.go:360] parsed scheme: "endpoint"

I1011 10:13:01.235457 1219802 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{http://127.0.0.1:43255   0 }]

I1011 10:13:01.235875 1219802 client.go:360] parsed scheme: "endpoint"

I1011 10:13:01.235892 1219802 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{http://127.0.0.1:43255   0 }]

I1011 10:13:01.236334 1219802 client.go:360] parsed scheme: "endpoint"

I1011 10:13:01.236350 1219802 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{http://127.0.0.1:43255   0 }]

I1011 10:13:01.236714 1219802 client.go:360] parsed scheme: "endpoint"

I1011 10:13:01.236730 1219802 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{http://127.0.0.1:43255   0 }]

I1011 10:13:01.237022 1219802 client.go:360] parsed scheme: "endpoint"

I1011 10:13:01.237040 1219802 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{http://127.0.0.1:43255   0 }]

I1011 10:13:01.237401 1219802 client.go:360] parsed scheme: "endpoint"

I1011 10:13:01.237415 1219802 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{http://127.0.0.1:43255   0 }]

I1011 10:13:01.237816 1219802 client.go:360] parsed scheme: "endpoint"

I1011 10:13:01.237834 1219802 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{http://127.0.0.1:43255   0 }]

I1011 10:13:01.238154 1219802 rest.go:130] the default service ipfamily for this cluster is: IPv4

I1011 10:13:01.295993 1219802 client.go:360] parsed scheme: "endpoint"

I1011 10:13:01.296018 1219802 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{http://127.0.0.1:43255   0 }]

I1011 10:13:01.296827 1219802 client.go:360] parsed scheme: "endpoint"

I1011 10:13:01.296851 1219802 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{http://127.0.0.1:43255   0 }]

I1011 10:13:01.297432 1219802 client.go:360] parsed scheme: "endpoint"

I1011 10:13:01.297456 1219802 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{http://127.0.0.1:43255   0 }]

I1011 10:13:01.297907 1219802 client.go:360] parsed scheme: "endpoint"

I1011 10:13:01.297923 1219802 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{http://127.0.0.1:43255   0 }]

I1011 10:13:01.298437 1219802 client.go:360] parsed scheme: "endpoint"

I1011 10:13:01.298453 1219802 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{http://127.0.0.1:43255   0 }]

I1011 10:13:01.299572 1219802 client.go:360] parsed scheme: "endpoint"

I1011 10:13:01.299589 1219802 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{http://127.0.0.1:43255   0 }]

I1011 10:13:01.300212 1219802 client.go:360] parsed scheme: "endpoint"

I1011 10:13:01.300229 1219802 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{http://127.0.0.1:43255   0 }]

I1011 10:13:01.300698 1219802 client.go:360] parsed scheme: "endpoint"

I1011 10:13:01.300716 1219802 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{http://127.0.0.1:43255   0 }]

I1011 10:13:01.301218 1219802 client.go:360] parsed scheme: "endpoint"

I1011 10:13:01.301231 1219802 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{http://127.0.0.1:43255   0 }]

I1011 10:13:01.301702 1219802 client.go:360] parsed scheme: "endpoint"

I1011 10:13:01.301718 1219802 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{http://127.0.0.1:43255   0 }]

I1011 10:13:01.302203 1219802 client.go:360] parsed scheme: "endpoint"

I1011 10:13:01.302215 1219802 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{http://127.0.0.1:43255   0 }]

I1011 10:13:01.302612 1219802 client.go:360] parsed scheme: "endpoint"

I1011 10:13:01.302625 1219802 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{http://127.0.0.1:43255   0 }]

I1011 10:13:01.303037 1219802 client.go:360] parsed scheme: "endpoint"

I1011 10:13:01.303049 1219802 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{http://127.0.0.1:43255   0 }]

I1011 10:13:01.303544 1219802 client.go:360] parsed scheme: "endpoint"

I1011 10:13:01.303557 1219802 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{http://127.0.0.1:43255   0 }]

I1011 10:13:01.303846 1219802 client.go:360] parsed scheme: "endpoint"

I1011 10:13:01.303857 1219802 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{http://127.0.0.1:43255   0 }]

I1011 10:13:01.304233 1219802 client.go:360] parsed scheme: "endpoint"

I1011 10:13:01.304248 1219802 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{http://127.0.0.1:43255   0 }]

I1011 10:13:01.304730 1219802 client.go:360] parsed scheme: "endpoint"

I1011 10:13:01.304749 1219802 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{http://127.0.0.1:43255   0 }]

I1011 10:13:01.305165 1219802 client.go:360] parsed scheme: "endpoint"

I1011 10:13:01.305179 1219802 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{http://127.0.0.1:43255   0 }]

I1011 10:13:01.305854 1219802 client.go:360] parsed scheme: "endpoint"

I1011 10:13:01.305866 1219802 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{http://127.0.0.1:43255   0 }]

I1011 10:13:01.306522 1219802 client.go:360] parsed scheme: "endpoint"

I1011 10:13:01.306535 1219802 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{http://127.0.0.1:43255   0 }]

I1011 10:13:01.306969 1219802 client.go:360] parsed scheme: "endpoint"

I1011 10:13:01.306984 1219802 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{http://127.0.0.1:43255   0 }]

I1011 10:13:01.307420 1219802 client.go:360] parsed scheme: "endpoint"

I1011 10:13:01.307438 1219802 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{http://127.0.0.1:43255   0 }]

I1011 10:13:01.308484 1219802 client.go:360] parsed scheme: "endpoint"

I1011 10:13:01.308514 1219802 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{http://127.0.0.1:43255   0 }]

I1011 10:13:01.309084 1219802 client.go:360] parsed scheme: "endpoint"

I1011 10:13:01.309098 1219802 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{http://127.0.0.1:43255   0 }]

I1011 10:13:01.309577 1219802 client.go:360] parsed scheme: "endpoint"

I1011 10:13:01.309592 1219802 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{http://127.0.0.1:43255   0 }]

I1011 10:13:01.312500 1219802 client.go:360] parsed scheme: "endpoint"

I1011 10:13:01.312530 1219802 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{http://127.0.0.1:43255   0 }]

I1011 10:13:01.313322 1219802 client.go:360] parsed scheme: "endpoint"

I1011 10:13:01.313344 1219802 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{http://127.0.0.1:43255   0 }]

I1011 10:13:01.313847 1219802 client.go:360] parsed scheme: "endpoint"

I1011 10:13:01.313860 1219802 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{http://127.0.0.1:43255   0 }]

I1011 10:13:01.314340 1219802 client.go:360] parsed scheme: "endpoint"

I1011 10:13:01.314356 1219802 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{http://127.0.0.1:43255   0 }]

I1011 10:13:01.314752 1219802 client.go:360] parsed scheme: "endpoint"

I1011 10:13:01.314768 1219802 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{http://127.0.0.1:43255   0 }]

I1011 10:13:01.315194 1219802 client.go:360] parsed scheme: "endpoint"

I1011 10:13:01.315230 1219802 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{http://127.0.0.1:43255   0 }]

I1011 10:13:01.316635 1219802 client.go:360] parsed scheme: "endpoint"

I1011 10:13:01.316650 1219802 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{http://127.0.0.1:43255   0 }]

I1011 10:13:01.317090 1219802 client.go:360] parsed scheme: "endpoint"

I1011 10:13:01.317106 1219802 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{http://127.0.0.1:43255   0 }]

I1011 10:13:01.317635 1219802 client.go:360] parsed scheme: "endpoint"

I1011 10:13:01.317650 1219802 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{http://127.0.0.1:43255   0 }]

I1011 10:13:01.318020 1219802 client.go:360] parsed scheme: "endpoint"

I1011 10:13:01.318040 1219802 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{http://127.0.0.1:43255   0 }]

I1011 10:13:01.318411 1219802 client.go:360] parsed scheme: "endpoint"

I1011 10:13:01.318427 1219802 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{http://127.0.0.1:43255   0 }]

I1011 10:13:01.318854 1219802 client.go:360] parsed scheme: "endpoint"

I1011 10:13:01.318869 1219802 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{http://127.0.0.1:43255   0 }]

I1011 10:13:01.319317 1219802 client.go:360] parsed scheme: "endpoint"

I1011 10:13:01.319333 1219802 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{http://127.0.0.1:43255   0 }]

I1011 10:13:01.319731 1219802 client.go:360] parsed scheme: "endpoint"

I1011 10:13:01.319747 1219802 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{http://127.0.0.1:43255   0 }]

I1011 10:13:01.320178 1219802 client.go:360] parsed scheme: "endpoint"

I1011 10:13:01.320193 1219802 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{http://127.0.0.1:43255   0 }]

I1011 10:13:01.320548 1219802 client.go:360] parsed scheme: "endpoint"

I1011 10:13:01.320566 1219802 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{http://127.0.0.1:43255   0 }]

I1011 10:13:01.320935 1219802 client.go:360] parsed scheme: "endpoint"

I1011 10:13:01.320949 1219802 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{http://127.0.0.1:43255   0 }]

I1011 10:13:01.321388 1219802 client.go:360] parsed scheme: "endpoint"

I1011 10:13:01.321399 1219802 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{http://127.0.0.1:43255   0 }]

I1011 10:13:01.321788 1219802 client.go:360] parsed scheme: "endpoint"

I1011 10:13:01.321801 1219802 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{http://127.0.0.1:43255   0 }]

I1011 10:13:01.322334 1219802 client.go:360] parsed scheme: "endpoint"

I1011 10:13:01.322350 1219802 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{http://127.0.0.1:43255   0 }]

I1011 10:13:01.322765 1219802 client.go:360] parsed scheme: "endpoint"

I1011 10:13:01.322781 1219802 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{http://127.0.0.1:43255   0 }]

I1011 10:13:01.323243 1219802 client.go:360] parsed scheme: "endpoint"

I1011 10:13:01.323260 1219802 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{http://127.0.0.1:43255   0 }]

I1011 10:13:01.323689 1219802 client.go:360] parsed scheme: "endpoint"

I1011 10:13:01.323705 1219802 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{http://127.0.0.1:43255   0 }]

I1011 10:13:01.325043 1219802 client.go:360] parsed scheme: "endpoint"

I1011 10:13:01.325057 1219802 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{http://127.0.0.1:43255   0 }]

I1011 10:13:01.325783 1219802 client.go:360] parsed scheme: "endpoint"

I1011 10:13:01.325798 1219802 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{http://127.0.0.1:43255   0 }]

I1011 10:13:01.326257 1219802 client.go:360] parsed scheme: "endpoint"

I1011 10:13:01.326274 1219802 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{http://127.0.0.1:43255   0 }]

I1011 10:13:01.326696 1219802 client.go:360] parsed scheme: "endpoint"

I1011 10:13:01.326708 1219802 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{http://127.0.0.1:43255   0 }]

I1011 10:13:01.327090 1219802 client.go:360] parsed scheme: "endpoint"

I1011 10:13:01.327103 1219802 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{http://127.0.0.1:43255   0 }]

I1011 10:13:01.327554 1219802 client.go:360] parsed scheme: "endpoint"

I1011 10:13:01.327570 1219802 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{http://127.0.0.1:43255   0 }]

I1011 10:13:01.327953 1219802 client.go:360] parsed scheme: "endpoint"

I1011 10:13:01.327967 1219802 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{http://127.0.0.1:43255   0 }]

W1011 10:13:01.458220 1219802 genericapiserver.go:425] Skipping API node.k8s.io/v1alpha1 because it has no resources.

W1011 10:13:01.469269 1219802 genericapiserver.go:425] Skipping API rbac.authorization.k8s.io/v1alpha1 because it has no resources.

W1011 10:13:01.473150 1219802 genericapiserver.go:425] Skipping API scheduling.k8s.io/v1alpha1 because it has no resources.

W1011 10:13:01.479115 1219802 genericapiserver.go:425] Skipping API storage.k8s.io/v1alpha1 because it has no resources.

W1011 10:13:01.481739 1219802 genericapiserver.go:425] Skipping API flowcontrol.apiserver.k8s.io/v1alpha1 because it has no resources.

W1011 10:13:01.487559 1219802 genericapiserver.go:425] Skipping API apps/v1beta2 because it has no resources.

W1011 10:13:01.487591 1219802 genericapiserver.go:425] Skipping API apps/v1beta1 because it has no resources.

I1011 10:13:01.503478 1219802 plugins.go:158] Loaded 10 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,StorageObjectInUseProtection,RuntimeClass,DefaultIngressClass,MutatingAdmissionWebhook.

I1011 10:13:01.503495 1219802 plugins.go:161] Loaded 9 validating admission controller(s) successfully in the following order: LimitRanger,Priority,PersistentVolumeClaimResize,RuntimeClass,CertificateApproval,CertificateSigning,CertificateSubjectRestriction,ValidatingAdmissionWebhook,ResourceQuota.

I1011 10:13:01.504769 1219802 client.go:360] parsed scheme: "endpoint"

I1011 10:13:01.504791 1219802 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{http://127.0.0.1:43255   0 }]

I1011 10:13:01.505644 1219802 client.go:360] parsed scheme: "endpoint"

I1011 10:13:01.505662 1219802 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{http://127.0.0.1:43255   0 }]

I1011 10:13:02.199846 1219802 client.go:360] parsed scheme: "endpoint"

I1011 10:13:02.199920 1219802 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{http://127.0.0.1:43255   0 }]

I1011 10:13:03.895794 1219802 dynamic_cafile_content.go:167] Starting client-ca-bundle::/tmp/k8s_test_framework_3326568104/client-cert-auth-ca.crt

I1011 10:13:03.896060 1219802 dynamic_serving_content.go:130] Starting serving-cert::/tmp/k8s_test_framework_3326568104/apiserver.crt::/tmp/k8s_test_framework_3326568104/apiserver.key

I1011 10:13:03.896489 1219802 secure_serving.go:197] Serving securely on 127.0.0.1:41877

I1011 10:13:03.896563 1219802 controller.go:83] Starting OpenAPI AggregationController

I1011 10:13:03.900036 1219802 customresource_discovery_controller.go:209] Starting DiscoveryController

I1011 10:13:03.900218 1219802 controller.go:86] Starting OpenAPI controller

I1011 10:13:03.900239 1219802 naming_controller.go:291] Starting NamingConditionController

I1011 10:13:03.900261 1219802 establishing_controller.go:76] Starting EstablishingController

I1011 10:13:03.900280 1219802 nonstructuralschema_controller.go:192] Starting NonStructuralSchemaConditionController

I1011 10:13:03.900296 1219802 apiapproval_controller.go:186] Starting KubernetesAPIApprovalPolicyConformantConditionController

I1011 10:13:03.900310 1219802 crd_finalizer.go:266] Starting CRDFinalizer

I1011 10:13:03.896565 1219802 available_controller.go:475] Starting AvailableConditionController

I1011 10:13:03.902431 1219802 cache.go:32] Waiting for caches to sync for AvailableConditionController controller

I1011 10:13:03.896577 1219802 tlsconfig.go:240] Starting DynamicServingCertificateController

I1011 10:13:03.897060 1219802 apiservice_controller.go:97] Starting APIServiceRegistrationController

I1011 10:13:03.902469 1219802 cache.go:32] Waiting for caches to sync for APIServiceRegistrationController controller

I1011 10:13:03.897077 1219802 autoregister_controller.go:141] Starting autoregister controller

I1011 10:13:03.902500 1219802 cache.go:32] Waiting for caches to sync for autoregister controller

I1011 10:13:03.897091 1219802 apf_controller.go:294] Starting API Priority and Fairness config controller

I1011 10:13:03.897119 1219802 cluster_authentication_trust_controller.go:440] Starting cluster_authentication_trust_controller controller

I1011 10:13:03.902519 1219802 shared_informer.go:240] Waiting for caches to sync for cluster_authentication_trust_controller

I1011 10:13:03.897141 1219802 dynamic_cafile_content.go:167] Starting client-ca-bundle::/tmp/k8s_test_framework_3326568104/client-cert-auth-ca.crt

I1011 10:13:03.904464 1219802 crdregistration_controller.go:111] Starting crd-autoregister controller

I1011 10:13:03.904482 1219802 shared_informer.go:240] Waiting for caches to sync for crd-autoregister

E1011 10:13:03.905811 1219802 controller.go:152] Unable to remove old endpoints from kubernetes service: StorageError: key not found, Code: 1, Key: /registry/masterleases/192.168.1.190, ResourceVersion: 0, AdditionalErrorMsg:

I1011 10:13:03.922040 1219802 controller.go:611] quota admission added evaluator for: namespaces

I1011 10:13:04.003328 1219802 apf_controller.go:299] Running API Priority and Fairness config worker

I1011 10:13:04.003328 1219802 cache.go:39] Caches are synced for AvailableConditionController controller

I1011 10:13:04.003328 1219802 cache.go:39] Caches are synced for APIServiceRegistrationController controller

I1011 10:13:04.003348 1219802 cache.go:39] Caches are synced for autoregister controller

I1011 10:13:04.003328 1219802 shared_informer.go:247] Caches are synced for cluster_authentication_trust_controller

I1011 10:13:04.004528 1219802 shared_informer.go:247] Caches are synced for crd-autoregister

I1011 10:13:04.895976 1219802 controller.go:132] OpenAPI AggregationController: action for item : Nothing (removed from the queue).

I1011 10:13:04.896076 1219802 controller.go:132] OpenAPI AggregationController: action for item k8s_internal_local_delegation_chain_0000000000: Nothing (removed from the queue).

I1011 10:13:04.904144 1219802 storage_scheduling.go:132] created PriorityClass system-node-critical with value 2000001000

I1011 10:13:04.905862 1219802 storage_scheduling.go:132] created PriorityClass system-cluster-critical with value 2000000000

I1011 10:13:04.905872 1219802 storage_scheduling.go:148] all system priority classes are created successfully or already exist.

I1011 10:13:05.086960 1219802 controller.go:611] quota admission added evaluator for: roles.rbac.authorization.k8s.io

I1011 10:13:05.104163 1219802 controller.go:611] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io

W1011 10:13:05.129027 1219802 lease.go:233] Resetting endpoints for master service "kubernetes" to [192.168.1.190]

I1011 10:13:05.129683 1219802 controller.go:611] quota admission added evaluator for: endpoints

I1011 10:13:05.131481 1219802 controller.go:611] quota admission added evaluator for: endpointslices.discovery.k8s.io

I1011 10:13:05.965804 1219802 client.go:360] parsed scheme: "endpoint"

I1011 10:13:05.965824 1219802 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{http://127.0.0.1:43255   0 }]

I1011 10:13:05.987623 1219802 client.go:360] parsed scheme: "endpoint"

I1011 10:13:05.987650 1219802 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{http://127.0.0.1:43255   0 }]

I1011 10:13:07.969254 1219802 controller.go:611] quota admission added evaluator for: drops.drupal.dat.dxp.redhat.com

•I1011 10:13:07.976266 1219802 controller.go:181] Shutting down kubernetes service endpoint reconciler

I1011 10:13:07.976360 1219802 dynamic_cafile_content.go:182] Shutting down client-ca-bundle::/tmp/k8s_test_framework_3326568104/client-cert-auth-ca.crt

I1011 10:13:07.976405 1219802 controller.go:89] Shutting down OpenAPI AggregationController

I1011 10:13:07.976420 1219802 dynamic_cafile_content.go:182] Shutting down client-ca-bundle::/tmp/k8s_test_framework_3326568104/client-cert-auth-ca.crt

I1011 10:13:07.976437 1219802 tlsconfig.go:255] Shutting down DynamicServingCertificateController

I1011 10:13:07.976486 1219802 dynamic_serving_content.go:145] Shutting down serving-cert::/tmp/k8s_test_framework_3326568104/apiserver.crt::/tmp/k8s_test_framework_3326568104/apiserver.key

I1011 10:13:07.976494 1219802 secure_serving.go:241] Stopped listening on 127.0.0.1:41877

I1011 10:13:07.976603 1219802 controller.go:123] Shutting down OpenAPI controller

I1011 10:13:07.976625 1219802 crdregistration_controller.go:142] Shutting down crd-autoregister controller

I1011 10:13:07.976639 1219802 cluster_authentication_trust_controller.go:463] Shutting down cluster_authentication_trust_controller controller

I1011 10:13:07.976653 1219802 autoregister_controller.go:165] Shutting down autoregister controller

I1011 10:13:07.976666 1219802 apiservice_controller.go:131] Shutting down APIServiceRegistrationController

I1011 10:13:07.976683 1219802 available_controller.go:487] Shutting down AvailableConditionController

I1011 10:13:07.976697 1219802 apf_controller.go:303] Shutting down API Priority and Fairness config worker

I1011 10:13:07.976709 1219802 apiapproval_controller.go:198] Shutting down KubernetesAPIApprovalPolicyConformantConditionController

I1011 10:13:07.976720 1219802 customresource_discovery_controller.go:245] Shutting down DiscoveryController

I1011 10:13:07.976737 1219802 nonstructuralschema_controller.go:204] Shutting down NonStructuralSchemaConditionController

I1011 10:13:07.976747 1219802 establishing_controller.go:87] Shutting down EstablishingController

I1011 10:13:07.976759 1219802 crd_finalizer.go:278] Shutting down CRDFinalizer

I1011 10:13:07.976770 1219802 naming_controller.go:302] Shutting down NamingConditionController

E1011 10:13:07.978218 1219802 controller.go:184] Get "https://127.0.0.1:41877/api/v1/namespaces/default/endpoints/kubernetes": dial tcp 127.0.0.1:41877: connect: connection refused

2021-10-11 10:13:27.977224 N | pkg/osutil: received terminated signal, shutting down...

I1011 10:13:27.977896 1219802 clientconn.go:897] blockingPicker: the picked transport is not ready, loop back to repick

2021-10-11 10:13:27.978013 I | etcdserver: skipped leadership transfer for single voting member cluster

W1011 10:13:27.978296 1219802 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {http://127.0.0.1:43255   0 }. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:43255: connect: connection refused". Reconnecting...

I1011 10:13:27.978864 1219802 clientconn.go:897] blockingPicker: the picked transport is not ready, loop back to repick

I1011 10:13:27.978953 1219802 clientconn.go:897] blockingPicker: the picked transport is not ready, loop back to repick

I1011 10:13:27.979142 1219802 clientconn.go:897] blockingPicker: the picked transport is not ready, loop back to repick

I1011 10:13:27.979158 1219802 clientconn.go:897] blockingPicker: the picked transport is not ready, loop back to repick

W1011 10:13:27.979338 1219802 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {http://127.0.0.1:43255   0 }. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:43255: connect: connection refused". Reconnecting...

W1011 10:13:27.979364 1219802 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {http://127.0.0.1:43255   0 }. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:43255: connect: connection refused". Reconnecting...

W1011 10:13:27.979415 1219802 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {http://127.0.0.1:43255   0 }. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:43255: connect: connection refused". Reconnecting...

I1011 10:13:27.979425 1219802 clientconn.go:897] blockingPicker: the picked transport is not ready, loop back to repick

I1011 10:13:27.979435 1219802 clientconn.go:897] blockingPicker: the picked transport is not ready, loop back to repick

I1011 10:13:27.979445 1219802 clientconn.go:897] blockingPicker: the picked transport is not ready, loop back to repick

W1011 10:13:27.979463 1219802 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {http://127.0.0.1:43255   0 }. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:43255: connect: connection refused". Reconnecting...

W1011 10:13:27.979505 1219802 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {http://127.0.0.1:43255   0 }. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:43255: connect: connection refused". Reconnecting...

W1011 10:13:27.979539 1219802 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {http://127.0.0.1:43255   0 }. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:43255: connect: connection refused". Reconnecting...

I1011 10:13:27.979541 1219802 clientconn.go:897] blockingPicker: the picked transport is not ready, loop back to repick

I1011 10:13:27.979545 1219802 clientconn.go:897] blockingPicker: the picked transport is not ready, loop back to repick

W1011 10:13:27.979566 1219802 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {http://127.0.0.1:43255   0 }. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:43255: connect: connection refused". Reconnecting...

I1011 10:13:27.979571 1219802 clientconn.go:897] blockingPicker: the picked transport is not ready, loop back to repick

W1011 10:13:27.979582 1219802 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {http://127.0.0.1:43255   0 }. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:43255: connect: connection refused". Reconnecting...

I1011 10:13:27.979637 1219802 clientconn.go:897] blockingPicker: the picked transport is not ready, loop back to repick

I1011 10:13:27.979657 1219802 clientconn.go:897] blockingPicker: the picked transport is not ready, loop back to repick

I1011 10:13:27.979667 1219802 clientconn.go:897] blockingPicker: the picked transport is not ready, loop back to repick

W1011 10:13:27.979702 1219802 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {http://127.0.0.1:43255   0 }. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:43255: connect: connection refused". Reconnecting...

I1011 10:13:27.979722 1219802 clientconn.go:897] blockingPicker: the picked transport is not ready, loop back to repick

I1011 10:13:27.979741 1219802 clientconn.go:897] blockingPicker: the picked transport is not ready, loop back to repick

I1011 10:13:27.979810 1219802 clientconn.go:897] blockingPicker: the picked transport is not ready, loop back to repick

I1011 10:13:27.979826 1219802 clientconn.go:897] blockingPicker: the picked transport is not ready, loop back to repick

I1011 10:13:27.979827 1219802 clientconn.go:897] blockingPicker: the picked transport is not ready, loop back to repick

I1011 10:13:27.979828 1219802 clientconn.go:897] blockingPicker: the picked transport is not ready, loop back to repick

I1011 10:13:27.979886 1219802 clientconn.go:897] blockingPicker: the picked transport is not ready, loop back to repick

I1011 10:13:27.979908 1219802 clientconn.go:897] blockingPicker: the picked transport is not ready, loop back to repick

I1011 10:13:27.979916 1219802 clientconn.go:897] blockingPicker: the picked transport is not ready, loop back to repick

W1011 10:13:27.979918 1219802 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {http://127.0.0.1:43255   0 }. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:43255: connect: connection refused". Reconnecting...

W1011 10:13:27.979962 1219802 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {http://127.0.0.1:43255   0 }. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:43255: connect: connection refused". Reconnecting...

I1011 10:13:27.979987 1219802 clientconn.go:897] blockingPicker: the picked transport is not ready, loop back to repick

I1011 10:13:27.979991 1219802 clientconn.go:897] blockingPicker: the picked transport is not ready, loop back to repick

I1011 10:13:27.980057 1219802 clientconn.go:897] blockingPicker: the picked transport is not ready, loop back to repick

I1011 10:13:27.980092 1219802 clientconn.go:897] blockingPicker: the picked transport is not ready, loop back to repick

I1011 10:13:27.980130 1219802 clientconn.go:897] blockingPicker: the picked transport is not ready, loop back to repick

W1011 10:13:27.980160 1219802 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {http://127.0.0.1:43255   0 }. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:43255: connect: connection refused". Reconnecting...

I1011 10:13:27.980174 1219802 clientconn.go:897] blockingPicker: the picked transport is not ready, loop back to repick

W1011 10:13:27.980201 1219802 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {http://127.0.0.1:43255   0 }. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:43255: connect: connection refused". Reconnecting...

I1011 10:13:27.980247 1219802 clientconn.go:897] blockingPicker: the picked transport is not ready, loop back to repick

W1011 10:13:27.980250 1219802 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {http://127.0.0.1:43255   0 }. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:43255: connect: connection refused". Reconnecting...

I1011 10:13:27.980255 1219802 clientconn.go:897] blockingPicker: the picked transport is not ready, loop back to repick

W1011 10:13:27.980289 1219802 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {http://127.0.0.1:43255   0 }. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:43255: connect: connection refused". Reconnecting...

W1011 10:13:27.980295 1219802 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {http://127.0.0.1:43255   0 }. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:43255: connect: connection refused". Reconnecting...

W1011 10:13:27.980334 1219802 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {http://127.0.0.1:43255   0 }. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:43255: connect: connection refused". Reconnecting...

I1011 10:13:27.980343 1219802 clientconn.go:897] blockingPicker: the picked transport is not ready, loop back to repick

W1011 10:13:27.980371 1219802 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {http://127.0.0.1:43255   0 }. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:43255: connect: connection refused". Reconnecting...

I1011 10:13:27.980386 1219802 clientconn.go:897] blockingPicker: the picked transport is not ready, loop back to repick

W1011 10:13:27.980411 1219802 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {http://127.0.0.1:43255   0 }. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:43255: connect: connection refused". Reconnecting...

I1011 10:13:27.980428 1219802 clientconn.go:897] blockingPicker: the picked transport is not ready, loop back to repick

W1011 10:13:27.980446 1219802 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {http://127.0.0.1:43255   0 }. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:43255: connect: connection refused". Reconnecting...

W1011 10:13:27.980456 1219802 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {http://127.0.0.1:43255   0 }. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:43255: connect: connection refused". Reconnecting...

W1011 10:13:27.980482 1219802 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {http://127.0.0.1:43255   0 }. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:43255: connect: connection refused". Reconnecting...

I1011 10:13:27.980507 1219802 clientconn.go:897] blockingPicker: the picked transport is not ready, loop back to repick

W1011 10:13:27.980537 1219802 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {http://127.0.0.1:43255   0 }. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:43255: connect: connection refused". Reconnecting...

W1011 10:13:27.980600 1219802 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {http://127.0.0.1:43255   0 }. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:43255: connect: connection refused". Reconnecting...

I1011 10:13:27.980601 1219802 clientconn.go:897] blockingPicker: the picked transport is not ready, loop back to repick

W1011 10:13:27.980617 1219802 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {http://127.0.0.1:43255   0 }. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:43255: connect: connection refused". Reconnecting...

I1011 10:13:27.980669 1219802 clientconn.go:897] blockingPicker: the picked transport is not ready, loop back to repick

I1011 10:13:27.980725 1219802 clientconn.go:897] blockingPicker: the picked transport is not ready, loop back to repick

I1011 10:13:27.980763 1219802 clientconn.go:897] blockingPicker: the picked transport is not ready, loop back to repick

I1011 10:13:27.980880 1219802 clientconn.go:897] blockingPicker: the picked transport is not ready, loop back to repick

I1011 10:13:27.980971 1219802 clientconn.go:897] blockingPicker: the picked transport is not ready, loop back to repick

I1011 10:13:27.981070 1219802 clientconn.go:897] blockingPicker: the picked transport is not ready, loop back to repick

W1011 10:13:27.981106 1219802 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {http://127.0.0.1:43255   0 }. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:43255: connect: connection refused". Reconnecting...

W1011 10:13:27.981149 1219802 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {http://127.0.0.1:43255   0 }. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:43255: connect: connection refused". Reconnecting...

I1011 10:13:27.981161 1219802 clientconn.go:897] blockingPicker: the picked transport is not ready, loop back to repick

W1011 10:13:27.981186 1219802 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {http://127.0.0.1:43255   0 }. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:43255: connect: connection refused". Reconnecting...

W1011 10:13:27.981209 1219802 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {http://127.0.0.1:43255   0 }. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:43255: connect: connection refused". Reconnecting...

W1011 10:13:27.981220 1219802 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {http://127.0.0.1:43255   0 }. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:43255: connect: connection refused". Reconnecting...

I1011 10:13:27.981250 1219802 clientconn.go:897] blockingPicker: the picked transport is not ready, loop back to repick

W1011 10:13:27.981256 1219802 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {http://127.0.0.1:43255   0 }. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:43255: connect: connection refused". Reconnecting...

W1011 10:13:27.981257 1219802 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {http://127.0.0.1:43255   0 }. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:43255: connect: connection refused". Reconnecting...

W1011 10:13:27.981255 1219802 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {http://127.0.0.1:43255   0 }. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:43255: connect: connection refused". Reconnecting...

W1011 10:13:27.981292 1219802 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {http://127.0.0.1:43255   0 }. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:43255: connect: connection refused". Reconnecting...

W1011 10:13:27.981302 1219802 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {http://127.0.0.1:43255   0 }. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:43255: connect: connection refused". Reconnecting...

W1011 10:13:27.981338 1219802 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {http://127.0.0.1:43255   0 }. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:43255: connect: connection refused". Reconnecting...

W1011 10:13:27.981341 1219802 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {http://127.0.0.1:43255   0 }. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:43255: connect: connection refused". Reconnecting...

W1011 10:13:27.981349 1219802 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {http://127.0.0.1:43255   0 }. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:43255: connect: connection refused". Reconnecting...

I1011 10:13:27.981358 1219802 clientconn.go:897] blockingPicker: the picked transport is not ready, loop back to repick

W1011 10:13:27.981399 1219802 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {http://127.0.0.1:43255   0 }. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:43255: connect: connection refused". Reconnecting...

W1011 10:13:27.981421 1219802 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {http://127.0.0.1:43255   0 }. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:43255: connect: connection refused". Reconnecting...

W1011 10:13:27.981438 1219802 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {http://127.0.0.1:43255   0 }. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:43255: connect: connection refused". Reconnecting...

W1011 10:13:27.981400 1219802 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {http://127.0.0.1:43255   0 }. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:43255: connect: connection refused". Reconnecting...

I1011 10:13:27.981469 1219802 clientconn.go:897] blockingPicker: the picked transport is not ready, loop back to repick

W1011 10:13:27.981491 1219802 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {

[bobbygryzynger]

I'm thinking this may be a firewall issue. Is there any configuration to specify which port is used?

[bobbygryzynger]

I'm thinking this may be a firewall issue. Is there any configuration to specify which port is used?

It appears this isn't a firewall issue. Stopping firewalld and running the tests with sudo both result in the same errors.

[bobbygryzynger]

Another theory I tested was that SE Linux was blocking this (I'm attempting to run the tests on Fedora 34). I ran this to allow the port ranges that envtest seems to use: sudo semanage port -a -t http_port_t -p tcp 30000-49999, but I ended up with the same errors.

[bobbygryzynger]

I was eventually able to get tests running by setting ENVTEST_K8S_VERSION = 1.19.2 in the Makefile. Originally I had this set to 1.21+. If I set this to 1.21.4 I get the same connection refused errors.

[roivaz]

Hi @bobbygryzynger, I am running into the same problem, it fails if I try to run tests using ENVTEST_K8S_VERSION 1.20 or 1.21. Running the tests with AttachControlPlaneOutput: true in suite_test.go shows what I think is the problem:

Flag --insecure-port has been deprecated, This flag has no effect now and will be removed in v1.24.
Flag --insecure-bind-address has been deprecated, This flag has no effect now and will be removed in v1.24.
Error: invalid port value 34969: only zero is allowed

This is related with the deprecation of these flags (see kubernetes/kubeadm#2156).

I think in my case the problem is that I'm using controller-runtime v0.8.3. I cannot yet upgrade as the project relies on a dependency that still uses v0.8.3 so I'll have to use ENVTEST_K8S_VERSION=1.19 for the moment.

Hope it helps!

Edit: confirmed with the v0.9.0 release notes (https://github.com/kubernetes-sigs/controller-runtime/releases/tag/v0.9.0), v0.8 won't work with envtest clusters 1.20+

[k8s-triage-robot]

The Kubernetes project currently lacks enough contributors to adequately respond to all issues and PRs.

This bot triages issues and PRs according to the following rules:

• After 90d of inactivity, lifecycle/stale is applied
• After 30d of inactivity since lifecycle/stale was applied, lifecycle/rotten is applied
• After 30d of inactivity since lifecycle/rotten was applied, the issue is closed

You can:

• Mark this issue or PR as fresh with /remove-lifecycle stale
• Mark this issue or PR as rotten with /lifecycle rotten
• Close this issue or PR with /close
• Offer to help out with Issue Triage

Please send feedback to sig-contributor-experience at kubernetes/community.

/lifecycle stale

[k8s-triage-robot]

The Kubernetes project currently lacks enough active contributors to adequately respond to all issues and PRs.

This bot triages issues and PRs according to the following rules:

• After 90d of inactivity, lifecycle/stale is applied
• After 30d of inactivity since lifecycle/stale was applied, lifecycle/rotten is applied
• After 30d of inactivity since lifecycle/rotten was applied, the issue is closed

You can:

• Mark this issue or PR as fresh with /remove-lifecycle rotten
• Close this issue or PR with /close
• Offer to help out with Issue Triage

Please send feedback to sig-contributor-experience at kubernetes/community.

/lifecycle rotten

[k8s-triage-robot]

The Kubernetes project currently lacks enough active contributors to adequately respond to all issues and PRs.

This bot triages issues and PRs according to the following rules:

• After 90d of inactivity, lifecycle/stale is applied
• After 30d of inactivity since lifecycle/stale was applied, lifecycle/rotten is applied
• After 30d of inactivity since lifecycle/rotten was applied, the issue is closed

You can:

• Reopen this issue or PR with /reopen
• Mark this issue or PR as fresh with /remove-lifecycle rotten
• Offer to help out with Issue Triage

Please send feedback to sig-contributor-experience at kubernetes/community.

/close

[k8s-ci-robot]

@k8s-triage-robot: Closing this issue.

In response to this:

The Kubernetes project currently lacks enough active contributors to adequately respond to all issues and PRs.

This bot triages issues and PRs according to the following rules:

• After 90d of inactivity, lifecycle/stale is applied
• After 30d of inactivity since lifecycle/stale was applied, lifecycle/rotten is applied
• After 30d of inactivity since lifecycle/rotten was applied, the issue is closed

You can:

• Reopen this issue or PR with /reopen
• Mark this issue or PR as fresh with /remove-lifecycle rotten
• Offer to help out with Issue Triage

Please send feedback to sig-contributor-experience at kubernetes/community.

/close

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.