Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Kubelet fails to start with 6443: connection refused, kubeadm 1.16, Ubuntu 18.04. #82988

Closed
nitkon opened this issue Sep 22, 2019 · 10 comments
Closed

Kubelet fails to start with 6443: connection refused, kubeadm 1.16, Ubuntu 18.04. #82988

nitkon opened this issue Sep 22, 2019 · 10 comments
Labels
kind/bug Categorizes issue or PR as related to a bug. lifecycle/rotten Denotes an issue or PR that has aged beyond stale and will be auto-closed. sig/node Categorizes an issue or PR as relevant to SIG Node.

Comments

@nitkon
Copy link
Contributor

nitkon commented Sep 22, 2019

What happened:

root@soe13:~# kubeadm init --pod-network-cidr=10.244.0.0/16 --cri-socket=/var/run/crio/crio.sock
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/etc/kubernetes/pki"
[certs] Generating "ca" certificate and key
[certs] Generating "apiserver" certificate and key
[certs] apiserver serving cert is signed for DNS names [soe13 kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.local] and IPs [10.96.0.1 9.3.126.147]
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [soe13 localhost] and IPs [9.3.126.147 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [soe13 localhost] and IPs [9.3.126.147 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp [::1]:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp [::1]:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp [::1]:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp [::1]:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp [::1]:10248: connect: connection refused.

Unfortunately, an error has occurred:
	timed out waiting for the condition

This error is likely caused by:
	- The kubelet is not running
	- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)

If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
	- 'systemctl status kubelet'
	- 'journalctl -xeu kubelet'

Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
	- 'docker ps -a | grep kube | grep -v pause'
	Once you have found the failing container, you can inspect its logs with:
	- 'docker logs CONTAINERID'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher

What you expected to happen:
kubernetes installs successfully.

How to reproduce it (as minimally and precisely as possible):
Use the above kubeadm command on Ubuntu 1804 with crio as the CRI

Anything else we need to know?:

  • Kubernetes version (use kubectl version):
root@soe13:~# kubectl version
Client Version: version.Info{Major:"1", Minor:"16", GitVersion:"v1.16.0", GitCommit:"2bd9643cee5b3b3a5ecbd3af49d09018f0773c77", GitTreeState:"clean", BuildDate:"2019-09-18T14:36:53Z", GoVersion:"go1.12.9", Compiler:"gc", Platform:"linux/ppc64le"}
  • Cloud provider or hardware configuration:
    BareMetal Server.
  • OS (e.g: cat /etc/os-release):
root@soe13:~# cat /etc/os-release 
NAME="Ubuntu"
VERSION="18.04.2 LTS (Bionic Beaver)"
ID=ubuntu
ID_LIKE=debian
PRETTY_NAME="Ubuntu 18.04.2 LTS"
VERSION_ID="18.04"
HOME_URL="https://www.ubuntu.com/"
SUPPORT_URL="https://help.ubuntu.com/"
BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
VERSION_CODENAME=bionic
UBUNTU_CODENAME=bionic
  • Kernel (e.g. uname -a):
Linux soe13 5.0.0-20-generic #21~18.04.1-Ubuntu SMP Thu Jun 27 04:04:19 UTC 2019 ppc64le ppc64le ppc64le GNU/Linux
  • Install tools:
    kubeadm
  • Network plugin and version (if this is a network-related bug):
    CNI: calico 1.15
  • Others:
root@soe13:~# kubeadm version
kubeadm version: &version.Info{Major:"1", Minor:"16", GitVersion:"v1.16.0", GitCommit:"2bd9643cee5b3b3a5ecbd3af49d09018f0773c77", GitTreeState:"clean", BuildDate:"2019-09-18T14:34:01Z", GoVersion:"go1.12.9", Compiler:"gc", Platform:"linux/ppc64le"}
root@soe13:~# kubelet --version
Kubernetes v1.16.0
root@soe13:~# crio --version
crio version 1.15.3-dev
commit: unknown

Kubelet logs:

-- Logs begin at Tue 2019-08-20 16:32:16 IST. --
Sep 22 19:28:51 soe13 kubelet[139119]: W0922 19:28:51.258887  139119 clientconn.go:1120] grpc: addrConn.createTransport failed to connect to {/var/run/crio/crio.sock 0  <nil>}: didn't receive server preface in time. Reconnecting...
Sep 22 19:28:51 soe13 kubelet[139119]: W0922 19:28:51.258994  139119 clientconn.go:1120] grpc: addrConn.createTransport failed to connect to {/var/run/crio/crio.sock 0  <nil>}: didn't receive server preface in time. Reconnecting...
Sep 22 19:28:51 soe13 kubelet[139119]: E0922 19:28:51.266124  139119 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:459: Failed to list *v1.Node: Get https://9.3.126.147:6443/api/v1/nodes?fieldSelector=metadata.name%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:28:51 soe13 kubelet[139119]: E0922 19:28:51.266257  139119 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:450: Failed to list *v1.Service: Get https://9.3.126.147:6443/api/v1/services?limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:28:51 soe13 kubelet[139119]: E0922 19:28:51.266581  139119 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:46: Failed to list *v1.Pod: Get https://9.3.126.147:6443/api/v1/pods?fieldSelector=spec.nodeName%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:28:51 soe13 kubelet[139119]: E0922 19:28:51.535233  139119 aws_credentials.go:77] while getting AWS credentials NoCredentialProviders: no valid providers in chain. Deprecated.
Sep 22 19:28:51 soe13 kubelet[139119]:         For verbose messaging see aws.Config.CredentialsChainVerboseErrors
Sep 22 19:28:51 soe13 kubelet[139119]: E0922 19:28:51.535472  139119 remote_runtime.go:81] Version from runtime service failed: rpc error: code = Unavailable desc = all SubConns are in TransientFailure, latest connection error: timed out waiting for server handshake
Sep 22 19:28:51 soe13 kubelet[139119]: E0922 19:28:51.535511  139119 kuberuntime_manager.go:193] Get runtime version failed: rpc error: code = Unavailable desc = all SubConns are in TransientFailure, latest connection error: timed out waiting for server handshake
Sep 22 19:28:51 soe13 kubelet[139119]: F0922 19:28:51.535595  139119 server.go:271] failed to run Kubelet: failed to create kubelet: rpc error: code = Unavailable desc = all SubConns are in TransientFailure, latest connection error: timed out waiting for server handshake
Sep 22 19:29:17 soe13 kubelet[139406]: Flag --resolv-conf has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 22 19:29:17 soe13 kubelet[139406]: Flag --resolv-conf has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 22 19:29:17 soe13 kubelet[139406]: F0922 19:29:17.893151  139406 server.go:251] unable to load client CA file /etc/kubernetes/pki/ca.crt: open /etc/kubernetes/pki/ca.crt: no such file or directory




































Sep 22 19:29:28 soe13 kubelet[139467]: Flag --resolv-conf has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 22 19:29:28 soe13 kubelet[139467]: Flag --resolv-conf has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 22 19:29:28 soe13 kubelet[139467]: I0922 19:29:28.193375  139467 server.go:410] Version: v1.16.0
Sep 22 19:29:28 soe13 kubelet[139467]: I0922 19:29:28.193761  139467 plugins.go:100] No cloud provider specified.
Sep 22 19:29:28 soe13 kubelet[139467]: I0922 19:29:28.193788  139467 server.go:773] Client rotation is on, will bootstrap in background
Sep 22 19:29:28 soe13 kubelet[139467]: E0922 19:29:28.207007  139467 certificate_manager.go:400] Failed while requesting a signed certificate from the master: cannot create certificate signing request: Post https://9.3.126.147:6443/apis/certificates.k8s.io/v1beta1/certificatesigningrequests: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:29:28 soe13 kubelet[139467]: I0922 19:29:28.248977  139467 server.go:644] --cgroups-per-qos enabled, but --cgroup-root was not specified.  defaulting to /
Sep 22 19:29:28 soe13 kubelet[139467]: I0922 19:29:28.250213  139467 container_manager_linux.go:265] container manager verified user specified cgroup-root exists: []
Sep 22 19:29:28 soe13 kubelet[139467]: I0922 19:29:28.250238  139467 container_manager_linux.go:270] Creating Container Manager object based on Node Config: {RuntimeCgroupsName: SystemCgroupsName: KubeletCgroupsName: ContainerRuntime:remote CgroupsPerQOS:true CgroupRoot:/ CgroupDriver:cgroupfs KubeletRootDir:/var/lib/kubelet ProtectKernelDefaults:false NodeAllocatableConfig:{KubeReservedCgroupName: SystemReservedCgroupName: EnforceNodeAllocatable:map[pods:{}] KubeReserved:map[] SystemReserved:map[] HardEvictionThresholds:[{Signal:imagefs.available Operator:LessThan Value:{Quantity:<nil> Percentage:0.15} GracePeriod:0s MinReclaim:<nil>} {Signal:memory.available Operator:LessThan Value:{Quantity:100Mi Percentage:0} GracePeriod:0s MinReclaim:<nil>} {Signal:nodefs.available Operator:LessThan Value:{Quantity:<nil> Percentage:0.1} GracePeriod:0s MinReclaim:<nil>} {Signal:nodefs.inodesFree Operator:LessThan Value:{Quantity:<nil> Percentage:0.05} GracePeriod:0s MinReclaim:<nil>}]} QOSReserved:map[] ExperimentalCPUManagerPolicy:none ExperimentalCPUManagerReconcilePeriod:10s ExperimentalPodPidsLimit:-1 EnforceCPULimits:true CPUCFSQuotaPeriod:100ms ExperimentalTopologyManagerPolicy:none}
Sep 22 19:29:28 soe13 kubelet[139467]: I0922 19:29:28.250793  139467 fake_topology_manager.go:29] [fake topologymanager] NewFakeManager
Sep 22 19:29:28 soe13 kubelet[139467]: I0922 19:29:28.250812  139467 container_manager_linux.go:305] Creating device plugin manager: true
Sep 22 19:29:28 soe13 kubelet[139467]: I0922 19:29:28.250955  139467 fake_topology_manager.go:39] [fake topologymanager] AddHintProvider HintProvider:  &{kubelet.sock /var/lib/kubelet/device-plugins/ map[] {0 0} <nil> {{} [0 0 0]} 0x115d7b80 0x17203918 0x115d8550 map[] map[] map[] map[] map[] 0xc000840de0 [0 1 16 17] 0x17203918}
Sep 22 19:29:28 soe13 kubelet[139467]: I0922 19:29:28.251015  139467 state_mem.go:36] [cpumanager] initializing new in-memory state store
Sep 22 19:29:28 soe13 kubelet[139467]: I0922 19:29:28.252300  139467 fake_topology_manager.go:39] [fake topologymanager] AddHintProvider HintProvider:  &{{0 0} 0x17203918 10000000000 0xc0001013e0 <nil> <nil> <nil> <nil> map[memory:{{104857600 0} {<nil>}  BinarySI}]}
Sep 22 19:29:28 soe13 kubelet[139467]: I0922 19:29:28.252638  139467 kubelet.go:287] Adding pod path: /etc/kubernetes/manifests
Sep 22 19:29:28 soe13 kubelet[139467]: I0922 19:29:28.252671  139467 kubelet.go:312] Watching apiserver
Sep 22 19:29:28 soe13 kubelet[139467]: E0922 19:29:28.254160  139467 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:450: Failed to list *v1.Service: Get https://9.3.126.147:6443/api/v1/services?limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:29:28 soe13 kubelet[139467]: E0922 19:29:28.254218  139467 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:459: Failed to list *v1.Node: Get https://9.3.126.147:6443/api/v1/nodes?fieldSelector=metadata.name%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:29:28 soe13 kubelet[139467]: E0922 19:29:28.254224  139467 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:46: Failed to list *v1.Pod: Get https://9.3.126.147:6443/api/v1/pods?fieldSelector=spec.nodeName%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:29:28 soe13 kubelet[139467]: W0922 19:29:28.257190  139467 util_unix.go:103] Using "/var/run/crio/crio.sock" as endpoint is deprecated, please consider using full url format "unix:///var/run/crio/crio.sock".
Sep 22 19:29:28 soe13 kubelet[139467]: I0922 19:29:28.257254  139467 remote_runtime.go:59] parsed scheme: ""
Sep 22 19:29:28 soe13 kubelet[139467]: I0922 19:29:28.257267  139467 remote_runtime.go:59] scheme "" not registered, fallback to default scheme
Sep 22 19:29:28 soe13 kubelet[139467]: I0922 19:29:28.257310  139467 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{/var/run/crio/crio.sock 0  <nil>}] <nil>}
Sep 22 19:29:28 soe13 kubelet[139467]: I0922 19:29:28.257323  139467 clientconn.go:577] ClientConn switching balancer to "pick_first"
Sep 22 19:29:28 soe13 kubelet[139467]: W0922 19:29:28.257352  139467 util_unix.go:103] Using "/var/run/crio/crio.sock" as endpoint is deprecated, please consider using full url format "unix:///var/run/crio/crio.sock".
Sep 22 19:29:28 soe13 kubelet[139467]: I0922 19:29:28.257371  139467 remote_image.go:50] parsed scheme: ""
Sep 22 19:29:28 soe13 kubelet[139467]: I0922 19:29:28.257382  139467 remote_image.go:50] scheme "" not registered, fallback to default scheme
Sep 22 19:29:28 soe13 kubelet[139467]: I0922 19:29:28.257398  139467 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{/var/run/crio/crio.sock 0  <nil>}] <nil>}
Sep 22 19:29:28 soe13 kubelet[139467]: I0922 19:29:28.257408  139467 clientconn.go:577] ClientConn switching balancer to "pick_first"
Sep 22 19:29:29 soe13 kubelet[139467]: E0922 19:29:29.255041  139467 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:450: Failed to list *v1.Service: Get https://9.3.126.147:6443/api/v1/services?limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:29:29 soe13 kubelet[139467]: E0922 19:29:29.255922  139467 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:459: Failed to list *v1.Node: Get https://9.3.126.147:6443/api/v1/nodes?fieldSelector=metadata.name%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:29:29 soe13 kubelet[139467]: E0922 19:29:29.256918  139467 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:46: Failed to list *v1.Pod: Get https://9.3.126.147:6443/api/v1/pods?fieldSelector=spec.nodeName%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:29:30 soe13 kubelet[139467]: E0922 19:29:30.255550  139467 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:450: Failed to list *v1.Service: Get https://9.3.126.147:6443/api/v1/services?limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:29:30 soe13 kubelet[139467]: E0922 19:29:30.256610  139467 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:459: Failed to list *v1.Node: Get https://9.3.126.147:6443/api/v1/nodes?fieldSelector=metadata.name%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:29:30 soe13 kubelet[139467]: E0922 19:29:30.257635  139467 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:46: Failed to list *v1.Pod: Get https://9.3.126.147:6443/api/v1/pods?fieldSelector=spec.nodeName%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:29:30 soe13 kubelet[139467]: E0922 19:29:30.367760  139467 certificate_manager.go:400] Failed while requesting a signed certificate from the master: cannot create certificate signing request: Post https://9.3.126.147:6443/apis/certificates.k8s.io/v1beta1/certificatesigningrequests: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:29:31 soe13 kubelet[139467]: E0922 19:29:31.256113  139467 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:450: Failed to list *v1.Service: Get https://9.3.126.147:6443/api/v1/services?limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:29:31 soe13 kubelet[139467]: E0922 19:29:31.257043  139467 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:459: Failed to list *v1.Node: Get https://9.3.126.147:6443/api/v1/nodes?fieldSelector=metadata.name%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:29:31 soe13 kubelet[139467]: E0922 19:29:31.258007  139467 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:46: Failed to list *v1.Pod: Get https://9.3.126.147:6443/api/v1/pods?fieldSelector=spec.nodeName%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:29:32 soe13 kubelet[139467]: E0922 19:29:32.256578  139467 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:450: Failed to list *v1.Service: Get https://9.3.126.147:6443/api/v1/services?limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:29:32 soe13 kubelet[139467]: E0922 19:29:32.257699  139467 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:459: Failed to list *v1.Node: Get https://9.3.126.147:6443/api/v1/nodes?fieldSelector=metadata.name%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:29:32 soe13 kubelet[139467]: E0922 19:29:32.258728  139467 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:46: Failed to list *v1.Pod: Get https://9.3.126.147:6443/api/v1/pods?fieldSelector=spec.nodeName%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:29:33 soe13 kubelet[139467]: E0922 19:29:33.257229  139467 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:450: Failed to list *v1.Service: Get https://9.3.126.147:6443/api/v1/services?limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:29:33 soe13 kubelet[139467]: E0922 19:29:33.258114  139467 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:459: Failed to list *v1.Node: Get https://9.3.126.147:6443/api/v1/nodes?fieldSelector=metadata.name%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:29:33 soe13 kubelet[139467]: E0922 19:29:33.259189  139467 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:46: Failed to list *v1.Pod: Get https://9.3.126.147:6443/api/v1/pods?fieldSelector=spec.nodeName%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:29:34 soe13 kubelet[139467]: E0922 19:29:34.257695  139467 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:450: Failed to list *v1.Service: Get https://9.3.126.147:6443/api/v1/services?limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:29:34 soe13 kubelet[139467]: E0922 19:29:34.258808  139467 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:459: Failed to list *v1.Node: Get https://9.3.126.147:6443/api/v1/nodes?fieldSelector=metadata.name%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:29:34 soe13 kubelet[139467]: E0922 19:29:34.259805  139467 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:46: Failed to list *v1.Pod: Get https://9.3.126.147:6443/api/v1/pods?fieldSelector=spec.nodeName%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:29:34 soe13 kubelet[139467]: E0922 19:29:34.428594  139467 certificate_manager.go:400] Failed while requesting a signed certificate from the master: cannot create certificate signing request: Post https://9.3.126.147:6443/apis/certificates.k8s.io/v1beta1/certificatesigningrequests: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:29:35 soe13 kubelet[139467]: E0922 19:29:35.258428  139467 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:450: Failed to list *v1.Service: Get https://9.3.126.147:6443/api/v1/services?limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:29:35 soe13 kubelet[139467]: E0922 19:29:35.259143  139467 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:459: Failed to list *v1.Node: Get https://9.3.126.147:6443/api/v1/nodes?fieldSelector=metadata.name%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:29:35 soe13 kubelet[139467]: E0922 19:29:35.260111  139467 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:46: Failed to list *v1.Pod: Get https://9.3.126.147:6443/api/v1/pods?fieldSelector=spec.nodeName%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:29:36 soe13 kubelet[139467]: E0922 19:29:36.258911  139467 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:450: Failed to list *v1.Service: Get https://9.3.126.147:6443/api/v1/services?limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:29:36 soe13 kubelet[139467]: E0922 19:29:36.260197  139467 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:459: Failed to list *v1.Node: Get https://9.3.126.147:6443/api/v1/nodes?fieldSelector=metadata.name%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:29:36 soe13 kubelet[139467]: E0922 19:29:36.261035  139467 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:46: Failed to list *v1.Pod: Get https://9.3.126.147:6443/api/v1/pods?fieldSelector=spec.nodeName%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:29:37 soe13 kubelet[139467]: E0922 19:29:37.259346  139467 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:450: Failed to list *v1.Service: Get https://9.3.126.147:6443/api/v1/services?limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:29:37 soe13 kubelet[139467]: E0922 19:29:37.260651  139467 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:459: Failed to list *v1.Node: Get https://9.3.126.147:6443/api/v1/nodes?fieldSelector=metadata.name%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:29:37 soe13 kubelet[139467]: E0922 19:29:37.261678  139467 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:46: Failed to list *v1.Pod: Get https://9.3.126.147:6443/api/v1/pods?fieldSelector=spec.nodeName%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:29:38 soe13 kubelet[139467]: E0922 19:29:38.259886  139467 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:450: Failed to list *v1.Service: Get https://9.3.126.147:6443/api/v1/services?limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:29:38 soe13 kubelet[139467]: E0922 19:29:38.261104  139467 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:459: Failed to list *v1.Node: Get https://9.3.126.147:6443/api/v1/nodes?fieldSelector=metadata.name%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:29:38 soe13 kubelet[139467]: E0922 19:29:38.262137  139467 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:46: Failed to list *v1.Pod: Get https://9.3.126.147:6443/api/v1/pods?fieldSelector=spec.nodeName%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:29:39 soe13 kubelet[139467]: E0922 19:29:39.260408  139467 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:450: Failed to list *v1.Service: Get https://9.3.126.147:6443/api/v1/services?limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:29:39 soe13 kubelet[139467]: E0922 19:29:39.261552  139467 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:459: Failed to list *v1.Node: Get https://9.3.126.147:6443/api/v1/nodes?fieldSelector=metadata.name%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:29:39 soe13 kubelet[139467]: E0922 19:29:39.262550  139467 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:46: Failed to list *v1.Pod: Get https://9.3.126.147:6443/api/v1/pods?fieldSelector=spec.nodeName%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:29:40 soe13 kubelet[139467]: E0922 19:29:40.260882  139467 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:450: Failed to list *v1.Service: Get https://9.3.126.147:6443/api/v1/services?limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:29:40 soe13 kubelet[139467]: E0922 19:29:40.262058  139467 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:459: Failed to list *v1.Node: Get https://9.3.126.147:6443/api/v1/nodes?fieldSelector=metadata.name%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:29:40 soe13 kubelet[139467]: E0922 19:29:40.263052  139467 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:46: Failed to list *v1.Pod: Get https://9.3.126.147:6443/api/v1/pods?fieldSelector=spec.nodeName%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:29:41 soe13 kubelet[139467]: E0922 19:29:41.261515  139467 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:450: Failed to list *v1.Service: Get https://9.3.126.147:6443/api/v1/services?limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:29:41 soe13 kubelet[139467]: E0922 19:29:41.262526  139467 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:459: Failed to list *v1.Node: Get https://9.3.126.147:6443/api/v1/nodes?fieldSelector=metadata.name%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:29:41 soe13 kubelet[139467]: E0922 19:29:41.263476  139467 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:46: Failed to list *v1.Pod: Get https://9.3.126.147:6443/api/v1/pods?fieldSelector=spec.nodeName%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:29:42 soe13 kubelet[139467]: E0922 19:29:42.261959  139467 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:450: Failed to list *v1.Service: Get https://9.3.126.147:6443/api/v1/services?limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:29:42 soe13 kubelet[139467]: E0922 19:29:42.262916  139467 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:459: Failed to list *v1.Node: Get https://9.3.126.147:6443/api/v1/nodes?fieldSelector=metadata.name%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:29:42 soe13 kubelet[139467]: E0922 19:29:42.263919  139467 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:46: Failed to list *v1.Pod: Get https://9.3.126.147:6443/api/v1/pods?fieldSelector=spec.nodeName%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:29:43 soe13 kubelet[139467]: E0922 19:29:43.048901  139467 certificate_manager.go:400] Failed while requesting a signed certificate from the master: cannot create certificate signing request: Post https://9.3.126.147:6443/apis/certificates.k8s.io/v1beta1/certificatesigningrequests: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:29:43 soe13 kubelet[139467]: E0922 19:29:43.262394  139467 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:450: Failed to list *v1.Service: Get https://9.3.126.147:6443/api/v1/services?limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:29:43 soe13 kubelet[139467]: E0922 19:29:43.263550  139467 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:459: Failed to list *v1.Node: Get https://9.3.126.147:6443/api/v1/nodes?fieldSelector=metadata.name%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:29:43 soe13 kubelet[139467]: E0922 19:29:43.264504  139467 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:46: Failed to list *v1.Pod: Get https://9.3.126.147:6443/api/v1/pods?fieldSelector=spec.nodeName%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:29:44 soe13 kubelet[139467]: E0922 19:29:44.262907  139467 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:450: Failed to list *v1.Service: Get https://9.3.126.147:6443/api/v1/services?limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:29:44 soe13 kubelet[139467]: E0922 19:29:44.263983  139467 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:459: Failed to list *v1.Node: Get https://9.3.126.147:6443/api/v1/nodes?fieldSelector=metadata.name%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:29:44 soe13 kubelet[139467]: E0922 19:29:44.265128  139467 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:46: Failed to list *v1.Pod: Get https://9.3.126.147:6443/api/v1/pods?fieldSelector=spec.nodeName%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:29:45 soe13 kubelet[139467]: E0922 19:29:45.263590  139467 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:450: Failed to list *v1.Service: Get https://9.3.126.147:6443/api/v1/services?limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:29:45 soe13 kubelet[139467]: E0922 19:29:45.264497  139467 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:459: Failed to list *v1.Node: Get https://9.3.126.147:6443/api/v1/nodes?fieldSelector=metadata.name%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:29:45 soe13 kubelet[139467]: E0922 19:29:45.265516  139467 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:46: Failed to list *v1.Pod: Get https://9.3.126.147:6443/api/v1/pods?fieldSelector=spec.nodeName%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:29:46 soe13 kubelet[139467]: E0922 19:29:46.263997  139467 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:450: Failed to list *v1.Service: Get https://9.3.126.147:6443/api/v1/services?limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:29:46 soe13 kubelet[139467]: E0922 19:29:46.265133  139467 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:459: Failed to list *v1.Node: Get https://9.3.126.147:6443/api/v1/nodes?fieldSelector=metadata.name%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:29:46 soe13 kubelet[139467]: E0922 19:29:46.266136  139467 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:46: Failed to list *v1.Pod: Get https://9.3.126.147:6443/api/v1/pods?fieldSelector=spec.nodeName%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:29:47 soe13 kubelet[139467]: E0922 19:29:47.264549  139467 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:450: Failed to list *v1.Service: Get https://9.3.126.147:6443/api/v1/services?limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:29:47 soe13 kubelet[139467]: E0922 19:29:47.265613  139467 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:459: Failed to list *v1.Node: Get https://9.3.126.147:6443/api/v1/nodes?fieldSelector=metadata.name%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:29:47 soe13 kubelet[139467]: E0922 19:29:47.266741  139467 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:46: Failed to list *v1.Pod: Get https://9.3.126.147:6443/api/v1/pods?fieldSelector=spec.nodeName%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:29:48 soe13 kubelet[139467]: W0922 19:29:48.257734  139467 clientconn.go:1120] grpc: addrConn.createTransport failed to connect to {/var/run/crio/crio.sock 0  <nil>}: didn't receive server preface in time. Reconnecting...
Sep 22 19:29:48 soe13 kubelet[139467]: W0922 19:29:48.257787  139467 clientconn.go:1120] grpc: addrConn.createTransport failed to connect to {/var/run/crio/crio.sock 0  <nil>}: didn't receive server preface in time. Reconnecting...
Sep 22 19:29:48 soe13 kubelet[139467]: E0922 19:29:48.267543  139467 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:450: Failed to list *v1.Service: Get https://9.3.126.147:6443/api/v1/services?limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:29:48 soe13 kubelet[139467]: E0922 19:29:48.267736  139467 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:46: Failed to list *v1.Pod: Get https://9.3.126.147:6443/api/v1/pods?fieldSelector=spec.nodeName%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:29:48 soe13 kubelet[139467]: E0922 19:29:48.268832  139467 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:459: Failed to list *v1.Node: Get https://9.3.126.147:6443/api/v1/nodes?fieldSelector=metadata.name%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:29:48 soe13 kubelet[139467]: E0922 19:29:48.561226  139467 aws_credentials.go:77] while getting AWS credentials NoCredentialProviders: no valid providers in chain. Deprecated.
Sep 22 19:29:48 soe13 kubelet[139467]:         For verbose messaging see aws.Config.CredentialsChainVerboseErrors
Sep 22 19:29:48 soe13 kubelet[139467]: E0922 19:29:48.561397  139467 remote_runtime.go:81] Version from runtime service failed: rpc error: code = Unavailable desc = all SubConns are in TransientFailure, latest connection error: timed out waiting for server handshake
Sep 22 19:29:48 soe13 kubelet[139467]: E0922 19:29:48.561434  139467 kuberuntime_manager.go:193] Get runtime version failed: rpc error: code = Unavailable desc = all SubConns are in TransientFailure, latest connection error: timed out waiting for server handshake
Sep 22 19:29:48 soe13 kubelet[139467]: F0922 19:29:48.561466  139467 server.go:271] failed to run Kubelet: failed to create kubelet: rpc error: code = Unavailable desc = all SubConns are in TransientFailure, latest connection error: timed out waiting for server handshake
Sep 22 19:29:58 soe13 kubelet[139595]: Flag --resolv-conf has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 22 19:29:58 soe13 kubelet[139595]: Flag --resolv-conf has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 22 19:29:58 soe13 kubelet[139595]: I0922 19:29:58.695941  139595 server.go:410] Version: v1.16.0
Sep 22 19:29:58 soe13 kubelet[139595]: I0922 19:29:58.696269  139595 plugins.go:100] No cloud provider specified.
Sep 22 19:29:58 soe13 kubelet[139595]: I0922 19:29:58.696286  139595 server.go:773] Client rotation is on, will bootstrap in background
Sep 22 19:29:58 soe13 kubelet[139595]: I0922 19:29:58.699451  139595 certificate_store.go:129] Loading cert/key pair from "/var/lib/kubelet/pki/kubelet-client-current.pem".
Sep 22 19:29:58 soe13 kubelet[139595]: I0922 19:29:58.740776  139595 server.go:644] --cgroups-per-qos enabled, but --cgroup-root was not specified.  defaulting to /
Sep 22 19:29:58 soe13 kubelet[139595]: I0922 19:29:58.742124  139595 container_manager_linux.go:265] container manager verified user specified cgroup-root exists: []
Sep 22 19:29:58 soe13 kubelet[139595]: I0922 19:29:58.742151  139595 container_manager_linux.go:270] Creating Container Manager object based on Node Config: {RuntimeCgroupsName: SystemCgroupsName: KubeletCgroupsName: ContainerRuntime:remote CgroupsPerQOS:true CgroupRoot:/ CgroupDriver:cgroupfs KubeletRootDir:/var/lib/kubelet ProtectKernelDefaults:false NodeAllocatableConfig:{KubeReservedCgroupName: SystemReservedCgroupName: EnforceNodeAllocatable:map[pods:{}] KubeReserved:map[] SystemReserved:map[] HardEvictionThresholds:[{Signal:memory.available Operator:LessThan Value:{Quantity:100Mi Percentage:0} GracePeriod:0s MinReclaim:<nil>} {Signal:nodefs.available Operator:LessThan Value:{Quantity:<nil> Percentage:0.1} GracePeriod:0s MinReclaim:<nil>} {Signal:nodefs.inodesFree Operator:LessThan Value:{Quantity:<nil> Percentage:0.05} GracePeriod:0s MinReclaim:<nil>} {Signal:imagefs.available Operator:LessThan Value:{Quantity:<nil> Percentage:0.15} GracePeriod:0s MinReclaim:<nil>}]} QOSReserved:map[] ExperimentalCPUManagerPolicy:none ExperimentalCPUManagerReconcilePeriod:10s ExperimentalPodPidsLimit:-1 EnforceCPULimits:true CPUCFSQuotaPeriod:100ms ExperimentalTopologyManagerPolicy:none}
Sep 22 19:29:58 soe13 kubelet[139595]: I0922 19:29:58.742792  139595 fake_topology_manager.go:29] [fake topologymanager] NewFakeManager
Sep 22 19:29:58 soe13 kubelet[139595]: I0922 19:29:58.742813  139595 container_manager_linux.go:305] Creating device plugin manager: true
Sep 22 19:29:58 soe13 kubelet[139595]: I0922 19:29:58.742849  139595 fake_topology_manager.go:39] [fake topologymanager] AddHintProvider HintProvider:  &{kubelet.sock /var/lib/kubelet/device-plugins/ map[] {0 0} <nil> {{} [0 0 0]} 0x115d7b80 0x17203918 0x115d8550 map[] map[] map[] map[] map[] 0xc0008e54d0 [1 16 17 0] 0x17203918}
Sep 22 19:29:58 soe13 kubelet[139595]: I0922 19:29:58.742909  139595 state_mem.go:36] [cpumanager] initializing new in-memory state store
Sep 22 19:29:58 soe13 kubelet[139595]: I0922 19:29:58.743099  139595 state_mem.go:84] [cpumanager] updated default cpuset: ""
Sep 22 19:29:58 soe13 kubelet[139595]: I0922 19:29:58.743117  139595 state_mem.go:92] [cpumanager] updated cpuset assignments: "map[]"
Sep 22 19:29:58 soe13 kubelet[139595]: I0922 19:29:58.743135  139595 fake_topology_manager.go:39] [fake topologymanager] AddHintProvider HintProvider:  &{{0 0} 0x17203918 10000000000 0xc000587560 <nil> <nil> <nil> <nil> map[memory:{{104857600 0} {<nil>}  BinarySI}]}
Sep 22 19:29:58 soe13 kubelet[139595]: I0922 19:29:58.743542  139595 kubelet.go:287] Adding pod path: /etc/kubernetes/manifests
Sep 22 19:29:58 soe13 kubelet[139595]: I0922 19:29:58.743585  139595 kubelet.go:312] Watching apiserver
Sep 22 19:29:58 soe13 kubelet[139595]: E0922 19:29:58.745207  139595 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:46: Failed to list *v1.Pod: Get https://9.3.126.147:6443/api/v1/pods?fieldSelector=spec.nodeName%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:29:58 soe13 kubelet[139595]: E0922 19:29:58.745413  139595 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:450: Failed to list *v1.Service: Get https://9.3.126.147:6443/api/v1/services?limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:29:58 soe13 kubelet[139595]: E0922 19:29:58.745542  139595 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:459: Failed to list *v1.Node: Get https://9.3.126.147:6443/api/v1/nodes?fieldSelector=metadata.name%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:29:58 soe13 kubelet[139595]: W0922 19:29:58.748056  139595 util_unix.go:103] Using "/var/run/crio/crio.sock" as endpoint is deprecated, please consider using full url format "unix:///var/run/crio/crio.sock".
Sep 22 19:29:58 soe13 kubelet[139595]: I0922 19:29:58.748127  139595 remote_runtime.go:59] parsed scheme: ""
Sep 22 19:29:58 soe13 kubelet[139595]: I0922 19:29:58.748143  139595 remote_runtime.go:59] scheme "" not registered, fallback to default scheme
Sep 22 19:29:58 soe13 kubelet[139595]: I0922 19:29:58.748183  139595 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{/var/run/crio/crio.sock 0  <nil>}] <nil>}
Sep 22 19:29:58 soe13 kubelet[139595]: I0922 19:29:58.748195  139595 clientconn.go:577] ClientConn switching balancer to "pick_first"
Sep 22 19:29:58 soe13 kubelet[139595]: W0922 19:29:58.748223  139595 util_unix.go:103] Using "/var/run/crio/crio.sock" as endpoint is deprecated, please consider using full url format "unix:///var/run/crio/crio.sock".
Sep 22 19:29:58 soe13 kubelet[139595]: I0922 19:29:58.748242  139595 remote_image.go:50] parsed scheme: ""
Sep 22 19:29:58 soe13 kubelet[139595]: I0922 19:29:58.748252  139595 remote_image.go:50] scheme "" not registered, fallback to default scheme
Sep 22 19:29:58 soe13 kubelet[139595]: I0922 19:29:58.748270  139595 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{/var/run/crio/crio.sock 0  <nil>}] <nil>}
Sep 22 19:29:58 soe13 kubelet[139595]: I0922 19:29:58.748284  139595 clientconn.go:577] ClientConn switching balancer to "pick_first"
Sep 22 19:29:59 soe13 kubelet[139595]: E0922 19:29:59.746013  139595 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:46: Failed to list *v1.Pod: Get https://9.3.126.147:6443/api/v1/pods?fieldSelector=spec.nodeName%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:29:59 soe13 kubelet[139595]: E0922 19:29:59.746834  139595 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:450: Failed to list *v1.Service: Get https://9.3.126.147:6443/api/v1/services?limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:29:59 soe13 kubelet[139595]: E0922 19:29:59.747786  139595 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:459: Failed to list *v1.Node: Get https://9.3.126.147:6443/api/v1/nodes?fieldSelector=metadata.name%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:30:00 soe13 kubelet[139595]: E0922 19:30:00.746528  139595 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:46: Failed to list *v1.Pod: Get https://9.3.126.147:6443/api/v1/pods?fieldSelector=spec.nodeName%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:30:00 soe13 kubelet[139595]: E0922 19:30:00.747678  139595 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:450: Failed to list *v1.Service: Get https://9.3.126.147:6443/api/v1/services?limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:30:00 soe13 kubelet[139595]: E0922 19:30:00.748739  139595 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:459: Failed to list *v1.Node: Get https://9.3.126.147:6443/api/v1/nodes?fieldSelector=metadata.name%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:30:01 soe13 kubelet[139595]: E0922 19:30:01.747233  139595 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:46: Failed to list *v1.Pod: Get https://9.3.126.147:6443/api/v1/pods?fieldSelector=spec.nodeName%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:30:01 soe13 kubelet[139595]: E0922 19:30:01.748138  139595 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:450: Failed to list *v1.Service: Get https://9.3.126.147:6443/api/v1/services?limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:30:01 soe13 kubelet[139595]: E0922 19:30:01.749179  139595 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:459: Failed to list *v1.Node: Get https://9.3.126.147:6443/api/v1/nodes?fieldSelector=metadata.name%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:30:02 soe13 kubelet[139595]: E0922 19:30:02.747889  139595 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:46: Failed to list *v1.Pod: Get https://9.3.126.147:6443/api/v1/pods?fieldSelector=spec.nodeName%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:30:02 soe13 kubelet[139595]: E0922 19:30:02.748715  139595 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:450: Failed to list *v1.Service: Get https://9.3.126.147:6443/api/v1/services?limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:30:02 soe13 kubelet[139595]: E0922 19:30:02.749814  139595 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:459: Failed to list *v1.Node: Get https://9.3.126.147:6443/api/v1/nodes?fieldSelector=metadata.name%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:30:03 soe13 kubelet[139595]: E0922 19:30:03.748360  139595 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:46: Failed to list *v1.Pod: Get https://9.3.126.147:6443/api/v1/pods?fieldSelector=spec.nodeName%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:30:03 soe13 kubelet[139595]: E0922 19:30:03.749473  139595 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:450: Failed to list *v1.Service: Get https://9.3.126.147:6443/api/v1/services?limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:30:03 soe13 kubelet[139595]: E0922 19:30:03.750498  139595 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:459: Failed to list *v1.Node: Get https://9.3.126.147:6443/api/v1/nodes?fieldSelector=metadata.name%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:30:04 soe13 kubelet[139595]: E0922 19:30:04.748816  139595 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:46: Failed to list *v1.Pod: Get https://9.3.126.147:6443/api/v1/pods?fieldSelector=spec.nodeName%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:30:04 soe13 kubelet[139595]: E0922 19:30:04.749879  139595 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:450: Failed to list *v1.Service: Get https://9.3.126.147:6443/api/v1/services?limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:30:04 soe13 kubelet[139595]: E0922 19:30:04.750960  139595 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:459: Failed to list *v1.Node: Get https://9.3.126.147:6443/api/v1/nodes?fieldSelector=metadata.name%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:30:05 soe13 kubelet[139595]: E0922 19:30:05.749484  139595 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:46: Failed to list *v1.Pod: Get https://9.3.126.147:6443/api/v1/pods?fieldSelector=spec.nodeName%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:30:05 soe13 kubelet[139595]: E0922 19:30:05.750296  139595 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:450: Failed to list *v1.Service: Get https://9.3.126.147:6443/api/v1/services?limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:30:05 soe13 kubelet[139595]: E0922 19:30:05.751371  139595 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:459: Failed to list *v1.Node: Get https://9.3.126.147:6443/api/v1/nodes?fieldSelector=metadata.name%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:30:06 soe13 kubelet[139595]: E0922 19:30:06.749999  139595 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:46: Failed to list *v1.Pod: Get https://9.3.126.147:6443/api/v1/pods?fieldSelector=spec.nodeName%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:30:06 soe13 kubelet[139595]: E0922 19:30:06.751321  139595 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:450: Failed to list *v1.Service: Get https://9.3.126.147:6443/api/v1/services?limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:30:06 soe13 kubelet[139595]: E0922 19:30:06.752083  139595 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:459: Failed to list *v1.Node: Get https://9.3.126.147:6443/api/v1/nodes?fieldSelector=metadata.name%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:30:07 soe13 kubelet[139595]: E0922 19:30:07.750471  139595 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:46: Failed to list *v1.Pod: Get https://9.3.126.147:6443/api/v1/pods?fieldSelector=spec.nodeName%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:30:07 soe13 kubelet[139595]: E0922 19:30:07.751762  139595 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:450: Failed to list *v1.Service: Get https://9.3.126.147:6443/api/v1/services?limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:30:07 soe13 kubelet[139595]: E0922 19:30:07.752825  139595 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:459: Failed to list *v1.Node: Get https://9.3.126.147:6443/api/v1/nodes?fieldSelector=metadata.name%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:30:08 soe13 kubelet[139595]: E0922 19:30:08.750910  139595 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:46: Failed to list *v1.Pod: Get https://9.3.126.147:6443/api/v1/pods?fieldSelector=spec.nodeName%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:30:08 soe13 kubelet[139595]: E0922 19:30:08.752173  139595 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:450: Failed to list *v1.Service: Get https://9.3.126.147:6443/api/v1/services?limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:30:08 soe13 kubelet[139595]: E0922 19:30:08.753261  139595 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:459: Failed to list *v1.Node: Get https://9.3.126.147:6443/api/v1/nodes?fieldSelector=metadata.name%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:30:09 soe13 kubelet[139595]: E0922 19:30:09.751362  139595 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:46: Failed to list *v1.Pod: Get https://9.3.126.147:6443/api/v1/pods?fieldSelector=spec.nodeName%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:30:09 soe13 kubelet[139595]: E0922 19:30:09.752684  139595 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:450: Failed to list *v1.Service: Get https://9.3.126.147:6443/api/v1/services?limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:30:09 soe13 kubelet[139595]: E0922 19:30:09.753676  139595 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:459: Failed to list *v1.Node: Get https://9.3.126.147:6443/api/v1/nodes?fieldSelector=metadata.name%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:30:10 soe13 kubelet[139595]: E0922 19:30:10.751828  139595 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:46: Failed to list *v1.Pod: Get https://9.3.126.147:6443/api/v1/pods?fieldSelector=spec.nodeName%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:30:10 soe13 kubelet[139595]: E0922 19:30:10.753087  139595 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:450: Failed to list *v1.Service: Get https://9.3.126.147:6443/api/v1/services?limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:30:10 soe13 kubelet[139595]: E0922 19:30:10.754166  139595 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:459: Failed to list *v1.Node: Get https://9.3.126.147:6443/api/v1/nodes?fieldSelector=metadata.name%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:30:11 soe13 kubelet[139595]: E0922 19:30:11.752228  139595 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:46: Failed to list *v1.Pod: Get https://9.3.126.147:6443/api/v1/pods?fieldSelector=spec.nodeName%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:30:11 soe13 kubelet[139595]: E0922 19:30:11.753482  139595 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:450: Failed to list *v1.Service: Get https://9.3.126.147:6443/api/v1/services?limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:30:11 soe13 kubelet[139595]: E0922 19:30:11.754653  139595 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:459: Failed to list *v1.Node: Get https://9.3.126.147:6443/api/v1/nodes?fieldSelector=metadata.name%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:30:12 soe13 kubelet[139595]: E0922 19:30:12.752663  139595 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:46: Failed to list *v1.Pod: Get https://9.3.126.147:6443/api/v1/pods?fieldSelector=spec.nodeName%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:30:12 soe13 kubelet[139595]: E0922 19:30:12.753911  139595 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:450: Failed to list *v1.Service: Get https://9.3.126.147:6443/api/v1/services?limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:30:12 soe13 kubelet[139595]: E0922 19:30:12.755084  139595 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:459: Failed to list *v1.Node: Get https://9.3.126.147:6443/api/v1/nodes?fieldSelector=metadata.name%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:30:13 soe13 kubelet[139595]: E0922 19:30:13.753245  139595 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:46: Failed to list *v1.Pod: Get https://9.3.126.147:6443/api/v1/pods?fieldSelector=spec.nodeName%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:30:13 soe13 kubelet[139595]: E0922 19:30:13.754303  139595 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:450: Failed to list *v1.Service: Get https://9.3.126.147:6443/api/v1/services?limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:30:13 soe13 kubelet[139595]: E0922 19:30:13.756375  139595 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:459: Failed to list *v1.Node: Get https://9.3.126.147:6443/api/v1/nodes?fieldSelector=metadata.name%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:30:14 soe13 kubelet[139595]: E0922 19:30:14.753843  139595 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:46: Failed to list *v1.Pod: Get https://9.3.126.147:6443/api/v1/pods?fieldSelector=spec.nodeName%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:30:14 soe13 kubelet[139595]: E0922 19:30:14.754838  139595 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:450: Failed to list *v1.Service: Get https://9.3.126.147:6443/api/v1/services?limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:30:14 soe13 kubelet[139595]: E0922 19:30:14.756932  139595 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:459: Failed to list *v1.Node: Get https://9.3.126.147:6443/api/v1/nodes?fieldSelector=metadata.name%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:30:15 soe13 kubelet[139595]: E0922 19:30:15.754782  139595 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:46: Failed to list *v1.Pod: Get https://9.3.126.147:6443/api/v1/pods?fieldSelector=spec.nodeName%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:30:15 soe13 kubelet[139595]: E0922 19:30:15.755714  139595 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:450: Failed to list *v1.Service: Get https://9.3.126.147:6443/api/v1/services?limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:30:15 soe13 kubelet[139595]: E0922 19:30:15.757346  139595 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:459: Failed to list *v1.Node: Get https://9.3.126.147:6443/api/v1/nodes?fieldSelector=metadata.name%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:30:16 soe13 kubelet[139595]: E0922 19:30:16.755413  139595 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:46: Failed to list *v1.Pod: Get https://9.3.126.147:6443/api/v1/pods?fieldSelector=spec.nodeName%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:30:16 soe13 kubelet[139595]: E0922 19:30:16.756551  139595 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:450: Failed to list *v1.Service: Get https://9.3.126.147:6443/api/v1/services?limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:30:16 soe13 kubelet[139595]: E0922 19:30:16.757899  139595 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:459: Failed to list *v1.Node: Get https://9.3.126.147:6443/api/v1/nodes?fieldSelector=metadata.name%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:30:17 soe13 kubelet[139595]: E0922 19:30:17.755964  139595 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:46: Failed to list *v1.Pod: Get https://9.3.126.147:6443/api/v1/pods?fieldSelector=spec.nodeName%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:30:17 soe13 kubelet[139595]: E0922 19:30:17.757151  139595 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:450: Failed to list *v1.Service: Get https://9.3.126.147:6443/api/v1/services?limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:30:17 soe13 kubelet[139595]: E0922 19:30:17.758370  139595 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:459: Failed to list *v1.Node: Get https://9.3.126.147:6443/api/v1/nodes?fieldSelector=metadata.name%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:30:18 soe13 kubelet[139595]: W0922 19:30:18.748576  139595 clientconn.go:1120] grpc: addrConn.createTransport failed to connect to {/var/run/crio/crio.sock 0  <nil>}: didn't receive server preface in time. Reconnecting...
Sep 22 19:30:18 soe13 kubelet[139595]: W0922 19:30:18.748812  139595 clientconn.go:1120] grpc: addrConn.createTransport failed to connect to {/var/run/crio/crio.sock 0  <nil>}: didn't receive server preface in time. Reconnecting...
Sep 22 19:30:18 soe13 kubelet[139595]: E0922 19:30:18.756624  139595 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:46: Failed to list *v1.Pod: Get https://9.3.126.147:6443/api/v1/pods?fieldSelector=spec.nodeName%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:30:18 soe13 kubelet[139595]: E0922 19:30:18.757571  139595 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:450: Failed to list *v1.Service: Get https://9.3.126.147:6443/api/v1/services?limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:30:18 soe13 kubelet[139595]: E0922 19:30:18.758777  139595 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:459: Failed to list *v1.Node: Get https://9.3.126.147:6443/api/v1/nodes?fieldSelector=metadata.name%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:30:19 soe13 kubelet[139595]: E0922 19:30:19.146655  139595 aws_credentials.go:77] while getting AWS credentials NoCredentialProviders: no valid providers in chain. Deprecated.
Sep 22 19:30:19 soe13 kubelet[139595]:         For verbose messaging see aws.Config.CredentialsChainVerboseErrors
Sep 22 19:30:19 soe13 kubelet[139595]: E0922 19:30:19.146785  139595 remote_runtime.go:81] Version from runtime service failed: rpc error: code = Unavailable desc = all SubConns are in TransientFailure, latest connection error: timed out waiting for server handshake
Sep 22 19:30:19 soe13 kubelet[139595]: E0922 19:30:19.146822  139595 kuberuntime_manager.go:193] Get runtime version failed: rpc error: code = Unavailable desc = all SubConns are in TransientFailure, latest connection error: timed out waiting for server handshake
Sep 22 19:30:19 soe13 kubelet[139595]: F0922 19:30:19.146858  139595 server.go:271] failed to run Kubelet: failed to create kubelet: rpc error: code = Unavailable desc = all SubConns are in TransientFailure, latest connection error: timed out waiting for server handshake
Sep 22 19:30:29 soe13 kubelet[139715]: Flag --resolv-conf has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 22 19:30:29 soe13 kubelet[139715]: Flag --resolv-conf has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 22 19:30:29 soe13 kubelet[139715]: I0922 19:30:29.445647  139715 server.go:410] Version: v1.16.0
Sep 22 19:30:29 soe13 kubelet[139715]: I0922 19:30:29.446132  139715 plugins.go:100] No cloud provider specified.
Sep 22 19:30:29 soe13 kubelet[139715]: I0922 19:30:29.446160  139715 server.go:773] Client rotation is on, will bootstrap in background
Sep 22 19:30:29 soe13 kubelet[139715]: I0922 19:30:29.452589  139715 certificate_store.go:129] Loading cert/key pair from "/var/lib/kubelet/pki/kubelet-client-current.pem".
Sep 22 19:30:29 soe13 kubelet[139715]: I0922 19:30:29.496076  139715 server.go:644] --cgroups-per-qos enabled, but --cgroup-root was not specified.  defaulting to /
Sep 22 19:30:29 soe13 kubelet[139715]: I0922 19:30:29.497247  139715 container_manager_linux.go:265] container manager verified user specified cgroup-root exists: []
Sep 22 19:30:29 soe13 kubelet[139715]: I0922 19:30:29.497285  139715 container_manager_linux.go:270] Creating Container Manager object based on Node Config: {RuntimeCgroupsName: SystemCgroupsName: KubeletCgroupsName: ContainerRuntime:remote CgroupsPerQOS:true CgroupRoot:/ CgroupDriver:cgroupfs KubeletRootDir:/var/lib/kubelet ProtectKernelDefaults:false NodeAllocatableConfig:{KubeReservedCgroupName: SystemReservedCgroupName: EnforceNodeAllocatable:map[pods:{}] KubeReserved:map[] SystemReserved:map[] HardEvictionThresholds:[{Signal:imagefs.available Operator:LessThan Value:{Quantity:<nil> Percentage:0.15} GracePeriod:0s MinReclaim:<nil>} {Signal:memory.available Operator:LessThan Value:{Quantity:100Mi Percentage:0} GracePeriod:0s MinReclaim:<nil>} {Signal:nodefs.available Operator:LessThan Value:{Quantity:<nil> Percentage:0.1} GracePeriod:0s MinReclaim:<nil>} {Signal:nodefs.inodesFree Operator:LessThan Value:{Quantity:<nil> Percentage:0.05} GracePeriod:0s MinReclaim:<nil>}]} QOSReserved:map[] ExperimentalCPUManagerPolicy:none ExperimentalCPUManagerReconcilePeriod:10s ExperimentalPodPidsLimit:-1 EnforceCPULimits:true CPUCFSQuotaPeriod:100ms ExperimentalTopologyManagerPolicy:none}
Sep 22 19:30:29 soe13 kubelet[139715]: I0922 19:30:29.497807  139715 fake_topology_manager.go:29] [fake topologymanager] NewFakeManager
Sep 22 19:30:29 soe13 kubelet[139715]: I0922 19:30:29.497825  139715 container_manager_linux.go:305] Creating device plugin manager: true
Sep 22 19:30:29 soe13 kubelet[139715]: I0922 19:30:29.497858  139715 fake_topology_manager.go:39] [fake topologymanager] AddHintProvider HintProvider:  &{kubelet.sock /var/lib/kubelet/device-plugins/ map[] {0 0} <nil> {{} [0 0 0]} 0x115d7b80 0x17203918 0x115d8550 map[] map[] map[] map[] map[] 0xc0008a2240 [0 1 16 17] 0x17203918}
Sep 22 19:30:29 soe13 kubelet[139715]: I0922 19:30:29.497913  139715 state_mem.go:36] [cpumanager] initializing new in-memory state store
Sep 22 19:30:29 soe13 kubelet[139715]: I0922 19:30:29.498060  139715 state_mem.go:84] [cpumanager] updated default cpuset: ""
Sep 22 19:30:29 soe13 kubelet[139715]: I0922 19:30:29.498076  139715 state_mem.go:92] [cpumanager] updated cpuset assignments: "map[]"
Sep 22 19:30:29 soe13 kubelet[139715]: I0922 19:30:29.498090  139715 fake_topology_manager.go:39] [fake topologymanager] AddHintProvider HintProvider:  &{{0 0} 0x17203918 10000000000 0xc000139380 <nil> <nil> <nil> <nil> map[memory:{{104857600 0} {<nil>}  BinarySI}]}
Sep 22 19:30:29 soe13 kubelet[139715]: I0922 19:30:29.498466  139715 kubelet.go:287] Adding pod path: /etc/kubernetes/manifests
Sep 22 19:30:29 soe13 kubelet[139715]: I0922 19:30:29.498507  139715 kubelet.go:312] Watching apiserver
Sep 22 19:30:29 soe13 kubelet[139715]: E0922 19:30:29.500281  139715 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:459: Failed to list *v1.Node: Get https://9.3.126.147:6443/api/v1/nodes?fieldSelector=metadata.name%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:30:29 soe13 kubelet[139715]: E0922 19:30:29.500366  139715 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:450: Failed to list *v1.Service: Get https://9.3.126.147:6443/api/v1/services?limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:30:29 soe13 kubelet[139715]: E0922 19:30:29.500403  139715 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:46: Failed to list *v1.Pod: Get https://9.3.126.147:6443/api/v1/pods?fieldSelector=spec.nodeName%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:30:29 soe13 kubelet[139715]: W0922 19:30:29.502944  139715 util_unix.go:103] Using "/var/run/crio/crio.sock" as endpoint is deprecated, please consider using full url format "unix:///var/run/crio/crio.sock".
Sep 22 19:30:29 soe13 kubelet[139715]: I0922 19:30:29.503020  139715 remote_runtime.go:59] parsed scheme: ""
Sep 22 19:30:29 soe13 kubelet[139715]: I0922 19:30:29.503035  139715 remote_runtime.go:59] scheme "" not registered, fallback to default scheme
Sep 22 19:30:29 soe13 kubelet[139715]: I0922 19:30:29.503075  139715 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{/var/run/crio/crio.sock 0  <nil>}] <nil>}
Sep 22 19:30:29 soe13 kubelet[139715]: I0922 19:30:29.503087  139715 clientconn.go:577] ClientConn switching balancer to "pick_first"
Sep 22 19:30:29 soe13 kubelet[139715]: W0922 19:30:29.503115  139715 util_unix.go:103] Using "/var/run/crio/crio.sock" as endpoint is deprecated, please consider using full url format "unix:///var/run/crio/crio.sock".
Sep 22 19:30:29 soe13 kubelet[139715]: I0922 19:30:29.503133  139715 remote_image.go:50] parsed scheme: ""
Sep 22 19:30:29 soe13 kubelet[139715]: I0922 19:30:29.503144  139715 remote_image.go:50] scheme "" not registered, fallback to default scheme
Sep 22 19:30:29 soe13 kubelet[139715]: I0922 19:30:29.503158  139715 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{/var/run/crio/crio.sock 0  <nil>}] <nil>}
Sep 22 19:30:29 soe13 kubelet[139715]: I0922 19:30:29.503181  139715 clientconn.go:577] ClientConn switching balancer to "pick_first"
Sep 22 19:30:30 soe13 kubelet[139715]: E0922 19:30:30.501156  139715 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:459: Failed to list *v1.Node: Get https://9.3.126.147:6443/api/v1/nodes?fieldSelector=metadata.name%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:30:30 soe13 kubelet[139715]: E0922 19:30:30.502277  139715 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:450: Failed to list *v1.Service: Get https://9.3.126.147:6443/api/v1/services?limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:30:30 soe13 kubelet[139715]: E0922 19:30:30.503232  139715 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:46: Failed to list *v1.Pod: Get https://9.3.126.147:6443/api/v1/pods?fieldSelector=spec.nodeName%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:30:31 soe13 kubelet[139715]: E0922 19:30:31.501694  139715 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:459: Failed to list *v1.Node: Get https://9.3.126.147:6443/api/v1/nodes?fieldSelector=metadata.name%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:30:31 soe13 kubelet[139715]: E0922 19:30:31.502769  139715 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:450: Failed to list *v1.Service: Get https://9.3.126.147:6443/api/v1/services?limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:30:31 soe13 kubelet[139715]: E0922 19:30:31.503798  139715 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:46: Failed to list *v1.Pod: Get https://9.3.126.147:6443/api/v1/pods?fieldSelector=spec.nodeName%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:30:32 soe13 kubelet[139715]: E0922 19:30:32.502452  139715 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:459: Failed to list *v1.Node: Get https://9.3.126.147:6443/api/v1/nodes?fieldSelector=metadata.name%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:30:32 soe13 kubelet[139715]: E0922 19:30:32.503304  139715 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:450: Failed to list *v1.Service: Get https://9.3.126.147:6443/api/v1/services?limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:30:32 soe13 kubelet[139715]: E0922 19:30:32.504228  139715 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:46: Failed to list *v1.Pod: Get https://9.3.126.147:6443/api/v1/pods?fieldSelector=spec.nodeName%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:30:33 soe13 kubelet[139715]: E0922 19:30:33.502958  139715 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:459: Failed to list *v1.Node: Get https://9.3.126.147:6443/api/v1/nodes?fieldSelector=metadata.name%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:30:33 soe13 kubelet[139715]: E0922 19:30:33.503993  139715 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:450: Failed to list *v1.Service: Get https://9.3.126.147:6443/api/v1/services?limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:30:33 soe13 kubelet[139715]: E0922 19:30:33.505084  139715 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:46: Failed to list *v1.Pod: Get https://9.3.126.147:6443/api/v1/pods?fieldSelector=spec.nodeName%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:30:34 soe13 kubelet[139715]: E0922 19:30:34.503400  139715 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:459: Failed to list *v1.Node: Get https://9.3.126.147:6443/api/v1/nodes?fieldSelector=metadata.name%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:30:34 soe13 kubelet[139715]: E0922 19:30:34.504556  139715 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:450: Failed to list *v1.Service: Get https://9.3.126.147:6443/api/v1/services?limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:30:34 soe13 kubelet[139715]: E0922 19:30:34.505505  139715 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:46: Failed to list *v1.Pod: Get https://9.3.126.147:6443/api/v1/pods?fieldSelector=spec.nodeName%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:30:35 soe13 kubelet[139715]: E0922 19:30:35.503852  139715 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:459: Failed to list *v1.Node: Get https://9.3.126.147:6443/api/v1/nodes?fieldSelector=metadata.name%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:30:35 soe13 kubelet[139715]: E0922 19:30:35.504958  139715 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:450: Failed to list *v1.Service: Get https://9.3.126.147:6443/api/v1/services?limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:30:35 soe13 kubelet[139715]: E0922 19:30:35.506061  139715 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:46: Failed to list *v1.Pod: Get https://9.3.126.147:6443/api/v1/pods?fieldSelector=spec.nodeName%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:30:36 soe13 kubelet[139715]: E0922 19:30:36.504624  139715 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:459: Failed to list *v1.Node: Get https://9.3.126.147:6443/api/v1/nodes?fieldSelector=metadata.name%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:30:36 soe13 kubelet[139715]: E0922 19:30:36.505606  139715 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:450: Failed to list *v1.Service: Get https://9.3.126.147:6443/api/v1/services?limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:30:36 soe13 kubelet[139715]: E0922 19:30:36.506887  139715 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:46: Failed to list *v1.Pod: Get https://9.3.126.147:6443/api/v1/pods?fieldSelector=spec.nodeName%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:30:37 soe13 kubelet[139715]: E0922 19:30:37.505179  139715 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:459: Failed to list *v1.Node: Get https://9.3.126.147:6443/api/v1/nodes?fieldSelector=metadata.name%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:30:37 soe13 kubelet[139715]: E0922 19:30:37.506072  139715 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:450: Failed to list *v1.Service: Get https://9.3.126.147:6443/api/v1/services?limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:30:37 soe13 kubelet[139715]: E0922 19:30:37.507339  139715 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:46: Failed to list *v1.Pod: Get https://9.3.126.147:6443/api/v1/pods?fieldSelector=spec.nodeName%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:30:38 soe13 kubelet[139715]: E0922 19:30:38.505665  139715 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:459: Failed to list *v1.Node: Get https://9.3.126.147:6443/api/v1/nodes?fieldSelector=metadata.name%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:30:38 soe13 kubelet[139715]: E0922 19:30:38.506682  139715 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:450: Failed to list *v1.Service: Get https://9.3.126.147:6443/api/v1/services?limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:30:38 soe13 kubelet[139715]: E0922 19:30:38.507727  139715 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:46: Failed to list *v1.Pod: Get https://9.3.126.147:6443/api/v1/pods?fieldSelector=spec.nodeName%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:30:39 soe13 kubelet[139715]: E0922 19:30:39.506331  139715 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:459: Failed to list *v1.Node: Get https://9.3.126.147:6443/api/v1/nodes?fieldSelector=metadata.name%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:30:39 soe13 kubelet[139715]: E0922 19:30:39.507104  139715 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:450: Failed to list *v1.Service: Get https://9.3.126.147:6443/api/v1/services?limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:30:39 soe13 kubelet[139715]: E0922 19:30:39.508175  139715 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:46: Failed to list *v1.Pod: Get https://9.3.126.147:6443/api/v1/pods?fieldSelector=spec.nodeName%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:30:40 soe13 kubelet[139715]: E0922 19:30:40.506831  139715 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:459: Failed to list *v1.Node: Get https://9.3.126.147:6443/api/v1/nodes?fieldSelector=metadata.name%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:30:40 soe13 kubelet[139715]: E0922 19:30:40.508239  139715 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:450: Failed to list *v1.Service: Get https://9.3.126.147:6443/api/v1/services?limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:30:40 soe13 kubelet[139715]: E0922 19:30:40.508896  139715 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:46: Failed to list *v1.Pod: Get https://9.3.126.147:6443/api/v1/pods?fieldSelector=spec.nodeName%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:30:41 soe13 kubelet[139715]: E0922 19:30:41.507292  139715 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:459: Failed to list *v1.Node: Get https://9.3.126.147:6443/api/v1/nodes?fieldSelector=metadata.name%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:30:41 soe13 kubelet[139715]: E0922 19:30:41.508713  139715 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:450: Failed to list *v1.Service: Get https://9.3.126.147:6443/api/v1/services?limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:30:41 soe13 kubelet[139715]: E0922 19:30:41.509761  139715 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:46: Failed to list *v1.Pod: Get https://9.3.126.147:6443/api/v1/pods?fieldSelector=spec.nodeName%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:30:42 soe13 kubelet[139715]: E0922 19:30:42.507736  139715 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:459: Failed to list *v1.Node: Get https://9.3.126.147:6443/api/v1/nodes?fieldSelector=metadata.name%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:30:42 soe13 kubelet[139715]: E0922 19:30:42.509164  139715 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:450: Failed to list *v1.Service: Get https://9.3.126.147:6443/api/v1/services?limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:30:42 soe13 kubelet[139715]: E0922 19:30:42.510234  139715 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:46: Failed to list *v1.Pod: Get https://9.3.126.147:6443/api/v1/pods?fieldSelector=spec.nodeName%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:30:43 soe13 kubelet[139715]: E0922 19:30:43.508227  139715 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:459: Failed to list *v1.Node: Get https://9.3.126.147:6443/api/v1/nodes?fieldSelector=metadata.name%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:30:43 soe13 kubelet[139715]: E0922 19:30:43.509598  139715 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:450: Failed to list *v1.Service: Get https://9.3.126.147:6443/api/v1/services?limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:30:43 soe13 kubelet[139715]: E0922 19:30:43.510668  139715 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:46: Failed to list *v1.Pod: Get https://9.3.126.147:6443/api/v1/pods?fieldSelector=spec.nodeName%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:30:44 soe13 kubelet[139715]: E0922 19:30:44.508711  139715 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:459: Failed to list *v1.Node: Get https://9.3.126.147:6443/api/v1/nodes?fieldSelector=metadata.name%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:30:44 soe13 kubelet[139715]: E0922 19:30:44.510011  139715 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:450: Failed to list *v1.Service: Get https://9.3.126.147:6443/api/v1/services?limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:30:44 soe13 kubelet[139715]: E0922 19:30:44.511129  139715 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:46: Failed to list *v1.Pod: Get https://9.3.126.147:6443/api/v1/pods?fieldSelector=spec.nodeName%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:30:45 soe13 kubelet[139715]: E0922 19:30:45.509208  139715 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:459: Failed to list *v1.Node: Get https://9.3.126.147:6443/api/v1/nodes?fieldSelector=metadata.name%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:30:45 soe13 kubelet[139715]: E0922 19:30:45.510463  139715 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:450: Failed to list *v1.Service: Get https://9.3.126.147:6443/api/v1/services?limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:30:45 soe13 kubelet[139715]: E0922 19:30:45.511547  139715 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:46: Failed to list *v1.Pod: Get https://9.3.126.147:6443/api/v1/pods?fieldSelector=spec.nodeName%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:30:46 soe13 kubelet[139715]: E0922 19:30:46.510074  139715 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:459: Failed to list *v1.Node: Get https://9.3.126.147:6443/api/v1/nodes?fieldSelector=metadata.name%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:30:46 soe13 kubelet[139715]: E0922 19:30:46.511244  139715 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:450: Failed to list *v1.Service: Get https://9.3.126.147:6443/api/v1/services?limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:30:46 soe13 kubelet[139715]: E0922 19:30:46.511956  139715 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:46: Failed to list *v1.Pod: Get https://9.3.126.147:6443/api/v1/pods?fieldSelector=spec.nodeName%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:30:47 soe13 kubelet[139715]: E0922 19:30:47.510535  139715 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:459: Failed to list *v1.Node: Get https://9.3.126.147:6443/api/v1/nodes?fieldSelector=metadata.name%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:30:47 soe13 kubelet[139715]: E0922 19:30:47.511704  139715 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:450: Failed to list *v1.Service: Get https://9.3.126.147:6443/api/v1/services?limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:30:47 soe13 kubelet[139715]: E0922 19:30:47.512755  139715 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:46: Failed to list *v1.Pod: Get https://9.3.126.147:6443/api/v1/pods?fieldSelector=spec.nodeName%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:30:48 soe13 kubelet[139715]: E0922 19:30:48.510995  139715 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:459: Failed to list *v1.Node: Get https://9.3.126.147:6443/api/v1/nodes?fieldSelector=metadata.name%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:30:48 soe13 kubelet[139715]: E0922 19:30:48.512149  139715 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:450: Failed to list *v1.Service: Get https://9.3.126.147:6443/api/v1/services?limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:30:48 soe13 kubelet[139715]: E0922 19:30:48.513140  139715 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:46: Failed to list *v1.Pod: Get https://9.3.126.147:6443/api/v1/pods?fieldSelector=spec.nodeName%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:30:49 soe13 kubelet[139715]: W0922 19:30:49.503443  139715 clientconn.go:1120] grpc: addrConn.createTransport failed to connect to {/var/run/crio/crio.sock 0  <nil>}: didn't receive server preface in time. Reconnecting...
Sep 22 19:30:49 soe13 kubelet[139715]: W0922 19:30:49.503591  139715 clientconn.go:1120] grpc: addrConn.createTransport failed to connect to {/var/run/crio/crio.sock 0  <nil>}: didn't receive server preface in time. Reconnecting...
Sep 22 19:30:49 soe13 kubelet[139715]: E0922 19:30:49.511602  139715 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:459: Failed to list *v1.Node: Get https://9.3.126.147:6443/api/v1/nodes?fieldSelector=metadata.name%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:30:49 soe13 kubelet[139715]: E0922 19:30:49.512579  139715 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:450: Failed to list *v1.Service: Get https://9.3.126.147:6443/api/v1/services?limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:30:49 soe13 kubelet[139715]: E0922 19:30:49.513636  139715 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:46: Failed to list *v1.Pod: Get https://9.3.126.147:6443/api/v1/pods?fieldSelector=spec.nodeName%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:30:49 soe13 kubelet[139715]: E0922 19:30:49.826578  139715 aws_credentials.go:77] while getting AWS credentials NoCredentialProviders: no valid providers in chain. Deprecated.
Sep 22 19:30:49 soe13 kubelet[139715]:         For verbose messaging see aws.Config.CredentialsChainVerboseErrors
Sep 22 19:30:49 soe13 kubelet[139715]: E0922 19:30:49.826684  139715 remote_runtime.go:81] Version from runtime service failed: rpc error: code = Unavailable desc = all SubConns are in TransientFailure, latest connection error: timed out waiting for server handshake
Sep 22 19:30:49 soe13 kubelet[139715]: E0922 19:30:49.826718  139715 kuberuntime_manager.go:193] Get runtime version failed: rpc error: code = Unavailable desc = all SubConns are in TransientFailure, latest connection error: timed out waiting for server handshake
Sep 22 19:30:49 soe13 kubelet[139715]: F0922 19:30:49.826752  139715 server.go:271] failed to run Kubelet: failed to create kubelet: rpc error: code = Unavailable desc = all SubConns are in TransientFailure, latest connection error: timed out waiting for server handshake
Sep 22 19:31:00 soe13 kubelet[139822]: Flag --resolv-conf has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 22 19:31:00 soe13 kubelet[139822]: Flag --resolv-conf has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 22 19:31:00 soe13 kubelet[139822]: I0922 19:31:00.197198  139822 server.go:410] Version: v1.16.0
Sep 22 19:31:00 soe13 kubelet[139822]: I0922 19:31:00.197629  139822 plugins.go:100] No cloud provider specified.
Sep 22 19:31:00 soe13 kubelet[139822]: I0922 19:31:00.197656  139822 server.go:773] Client rotation is on, will bootstrap in background
Sep 22 19:31:00 soe13 kubelet[139822]: I0922 19:31:00.202576  139822 certificate_store.go:129] Loading cert/key pair from "/var/lib/kubelet/pki/kubelet-client-current.pem".
Sep 22 19:31:00 soe13 kubelet[139822]: I0922 19:31:00.247402  139822 server.go:644] --cgroups-per-qos enabled, but --cgroup-root was not specified.  defaulting to /
Sep 22 19:31:00 soe13 kubelet[139822]: I0922 19:31:00.248649  139822 container_manager_linux.go:265] container manager verified user specified cgroup-root exists: []
Sep 22 19:31:00 soe13 kubelet[139822]: I0922 19:31:00.248675  139822 container_manager_linux.go:270] Creating Container Manager object based on Node Config: {RuntimeCgroupsName: SystemCgroupsName: KubeletCgroupsName: ContainerRuntime:remote CgroupsPerQOS:true CgroupRoot:/ CgroupDriver:cgroupfs KubeletRootDir:/var/lib/kubelet ProtectKernelDefaults:false NodeAllocatableConfig:{KubeReservedCgroupName: SystemReservedCgroupName: EnforceNodeAllocatable:map[pods:{}] KubeReserved:map[] SystemReserved:map[] HardEvictionThresholds:[{Signal:imagefs.available Operator:LessThan Value:{Quantity:<nil> Percentage:0.15} GracePeriod:0s MinReclaim:<nil>} {Signal:memory.available Operator:LessThan Value:{Quantity:100Mi Percentage:0} GracePeriod:0s MinReclaim:<nil>} {Signal:nodefs.available Operator:LessThan Value:{Quantity:<nil> Percentage:0.1} GracePeriod:0s MinReclaim:<nil>} {Signal:nodefs.inodesFree Operator:LessThan Value:{Quantity:<nil> Percentage:0.05} GracePeriod:0s MinReclaim:<nil>}]} QOSReserved:map[] ExperimentalCPUManagerPolicy:none ExperimentalCPUManagerReconcilePeriod:10s ExperimentalPodPidsLimit:-1 EnforceCPULimits:true CPUCFSQuotaPeriod:100ms ExperimentalTopologyManagerPolicy:none}
Sep 22 19:31:00 soe13 kubelet[139822]: I0922 19:31:00.249343  139822 fake_topology_manager.go:29] [fake topologymanager] NewFakeManager
Sep 22 19:31:00 soe13 kubelet[139822]: I0922 19:31:00.249363  139822 container_manager_linux.go:305] Creating device plugin manager: true
Sep 22 19:31:00 soe13 kubelet[139822]: I0922 19:31:00.249439  139822 fake_topology_manager.go:39] [fake topologymanager] AddHintProvider HintProvider:  &{kubelet.sock /var/lib/kubelet/device-plugins/ map[] {0 0} <nil> {{} [0 0 0]} 0x115d7b80 0x17203918 0x115d8550 map[] map[] map[] map[] map[] 0xc0008222d0 [17 0 1 16] 0x17203918}
Sep 22 19:31:00 soe13 kubelet[139822]: I0922 19:31:00.249550  139822 state_mem.go:36] [cpumanager] initializing new in-memory state store
Sep 22 19:31:00 soe13 kubelet[139822]: I0922 19:31:00.249781  139822 state_mem.go:84] [cpumanager] updated default cpuset: ""
Sep 22 19:31:00 soe13 kubelet[139822]: I0922 19:31:00.249800  139822 state_mem.go:92] [cpumanager] updated cpuset assignments: "map[]"
Sep 22 19:31:00 soe13 kubelet[139822]: I0922 19:31:00.249816  139822 fake_topology_manager.go:39] [fake topologymanager] AddHintProvider HintProvider:  &{{0 0} 0x17203918 10000000000 0xc0000d6e40 <nil> <nil> <nil> <nil> map[memory:{{104857600 0} {<nil>}  BinarySI}]}
Sep 22 19:31:00 soe13 kubelet[139822]: I0922 19:31:00.250339  139822 kubelet.go:287] Adding pod path: /etc/kubernetes/manifests
Sep 22 19:31:00 soe13 kubelet[139822]: I0922 19:31:00.250378  139822 kubelet.go:312] Watching apiserver
Sep 22 19:31:00 soe13 kubelet[139822]: E0922 19:31:00.252426  139822 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:450: Failed to list *v1.Service: Get https://9.3.126.147:6443/api/v1/services?limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:31:00 soe13 kubelet[139822]: E0922 19:31:00.253354  139822 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:46: Failed to list *v1.Pod: Get https://9.3.126.147:6443/api/v1/pods?fieldSelector=spec.nodeName%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:31:00 soe13 kubelet[139822]: E0922 19:31:00.253559  139822 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:459: Failed to list *v1.Node: Get https://9.3.126.147:6443/api/v1/nodes?fieldSelector=metadata.name%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:31:00 soe13 kubelet[139822]: W0922 19:31:00.255862  139822 util_unix.go:103] Using "/var/run/crio/crio.sock" as endpoint is deprecated, please consider using full url format "unix:///var/run/crio/crio.sock".
Sep 22 19:31:00 soe13 kubelet[139822]: I0922 19:31:00.255944  139822 remote_runtime.go:59] parsed scheme: ""
Sep 22 19:31:00 soe13 kubelet[139822]: I0922 19:31:00.255966  139822 remote_runtime.go:59] scheme "" not registered, fallback to default scheme
Sep 22 19:31:00 soe13 kubelet[139822]: I0922 19:31:00.256017  139822 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{/var/run/crio/crio.sock 0  <nil>}] <nil>}
Sep 22 19:31:00 soe13 kubelet[139822]: I0922 19:31:00.256032  139822 clientconn.go:577] ClientConn switching balancer to "pick_first"
Sep 22 19:31:00 soe13 kubelet[139822]: W0922 19:31:00.256068  139822 util_unix.go:103] Using "/var/run/crio/crio.sock" as endpoint is deprecated, please consider using full url format "unix:///var/run/crio/crio.sock".
Sep 22 19:31:00 soe13 kubelet[139822]: I0922 19:31:00.256091  139822 remote_image.go:50] parsed scheme: ""
Sep 22 19:31:00 soe13 kubelet[139822]: I0922 19:31:00.256105  139822 remote_image.go:50] scheme "" not registered, fallback to default scheme
Sep 22 19:31:00 soe13 kubelet[139822]: I0922 19:31:00.256131  139822 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{/var/run/crio/crio.sock 0  <nil>}] <nil>}
Sep 22 19:31:00 soe13 kubelet[139822]: I0922 19:31:00.256144  139822 clientconn.go:577] ClientConn switching balancer to "pick_first"
Sep 22 19:31:01 soe13 kubelet[139822]: E0922 19:31:01.253114  139822 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:450: Failed to list *v1.Service: Get https://9.3.126.147:6443/api/v1/services?limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:31:01 soe13 kubelet[139822]: E0922 19:31:01.254003  139822 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:46: Failed to list *v1.Pod: Get https://9.3.126.147:6443/api/v1/pods?fieldSelector=spec.nodeName%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:31:01 soe13 kubelet[139822]: E0922 19:31:01.257253  139822 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:459: Failed to list *v1.Node: Get https://9.3.126.147:6443/api/v1/nodes?fieldSelector=metadata.name%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:31:02 soe13 kubelet[139822]: E0922 19:31:02.253955  139822 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:450: Failed to list *v1.Service: Get https://9.3.126.147:6443/api/v1/services?limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:31:02 soe13 kubelet[139822]: E0922 19:31:02.254849  139822 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:46: Failed to list *v1.Pod: Get https://9.3.126.147:6443/api/v1/pods?fieldSelector=spec.nodeName%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:31:02 soe13 kubelet[139822]: E0922 19:31:02.257885  139822 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:459: Failed to list *v1.Node: Get https://9.3.126.147:6443/api/v1/nodes?fieldSelector=metadata.name%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:31:03 soe13 kubelet[139822]: E0922 19:31:03.254491  139822 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:450: Failed to list *v1.Service: Get https://9.3.126.147:6443/api/v1/services?limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:31:03 soe13 kubelet[139822]: E0922 19:31:03.255572  139822 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:46: Failed to list *v1.Pod: Get https://9.3.126.147:6443/api/v1/pods?fieldSelector=spec.nodeName%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:31:03 soe13 kubelet[139822]: E0922 19:31:03.258512  139822 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:459: Failed to list *v1.Node: Get https://9.3.126.147:6443/api/v1/nodes?fieldSelector=metadata.name%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:31:04 soe13 kubelet[139822]: E0922 19:31:04.254990  139822 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:450: Failed to list *v1.Service: Get https://9.3.126.147:6443/api/v1/services?limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:31:04 soe13 kubelet[139822]: E0922 19:31:04.256118  139822 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:46: Failed to list *v1.Pod: Get https://9.3.126.147:6443/api/v1/pods?fieldSelector=spec.nodeName%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:31:04 soe13 kubelet[139822]: E0922 19:31:04.258985  139822 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:459: Failed to list *v1.Node: Get https://9.3.126.147:6443/api/v1/nodes?fieldSelector=metadata.name%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:31:05 soe13 kubelet[139822]: E0922 19:31:05.255418  139822 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:450: Failed to list *v1.Service: Get https://9.3.126.147:6443/api/v1/services?limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:31:05 soe13 kubelet[139822]: E0922 19:31:05.256534  139822 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:46: Failed to list *v1.Pod: Get https://9.3.126.147:6443/api/v1/pods?fieldSelector=spec.nodeName%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:31:05 soe13 kubelet[139822]: E0922 19:31:05.259455  139822 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:459: Failed to list *v1.Node: Get https://9.3.126.147:6443/api/v1/nodes?fieldSelector=metadata.name%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:31:06 soe13 kubelet[139822]: E0922 19:31:06.255897  139822 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:450: Failed to list *v1.Service: Get https://9.3.126.147:6443/api/v1/services?limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:31:06 soe13 kubelet[139822]: E0922 19:31:06.257415  139822 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:46: Failed to list *v1.Pod: Get https://9.3.126.147:6443/api/v1/pods?fieldSelector=spec.nodeName%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:31:06 soe13 kubelet[139822]: E0922 19:31:06.259905  139822 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:459: Failed to list *v1.Node: Get https://9.3.126.147:6443/api/v1/nodes?fieldSelector=metadata.name%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:31:07 soe13 kubelet[139822]: E0922 19:31:07.256577  139822 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:450: Failed to list *v1.Service: Get https://9.3.126.147:6443/api/v1/services?limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:31:07 soe13 kubelet[139822]: E0922 19:31:07.257959  139822 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:46: Failed to list *v1.Pod: Get https://9.3.126.147:6443/api/v1/pods?fieldSelector=spec.nodeName%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:31:07 soe13 kubelet[139822]: E0922 19:31:07.260519  139822 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:459: Failed to list *v1.Node: Get https://9.3.126.147:6443/api/v1/nodes?fieldSelector=metadata.name%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:31:08 soe13 kubelet[139822]: E0922 19:31:08.257442  139822 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:450: Failed to list *v1.Service: Get https://9.3.126.147:6443/api/v1/services?limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:31:08 soe13 kubelet[139822]: E0922 19:31:08.258447  139822 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:46: Failed to list *v1.Pod: Get https://9.3.126.147:6443/api/v1/pods?fieldSelector=spec.nodeName%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:31:08 soe13 kubelet[139822]: E0922 19:31:08.260973  139822 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:459: Failed to list *v1.Node: Get https://9.3.126.147:6443/api/v1/nodes?fieldSelector=metadata.name%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:31:09 soe13 kubelet[139822]: E0922 19:31:09.257962  139822 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:450: Failed to list *v1.Service: Get https://9.3.126.147:6443/api/v1/services?limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:31:09 soe13 kubelet[139822]: E0922 19:31:09.259216  139822 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:46: Failed to list *v1.Pod: Get https://9.3.126.147:6443/api/v1/pods?fieldSelector=spec.nodeName%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:31:09 soe13 kubelet[139822]: E0922 19:31:09.261663  139822 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:459: Failed to list *v1.Node: Get https://9.3.126.147:6443/api/v1/nodes?fieldSelector=metadata.name%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:31:10 soe13 kubelet[139822]: E0922 19:31:10.258499  139822 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:450: Failed to list *v1.Service: Get https://9.3.126.147:6443/api/v1/services?limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:31:10 soe13 kubelet[139822]: E0922 19:31:10.259737  139822 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:46: Failed to list *v1.Pod: Get https://9.3.126.147:6443/api/v1/pods?fieldSelector=spec.nodeName%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:31:10 soe13 kubelet[139822]: E0922 19:31:10.262095  139822 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:459: Failed to list *v1.Node: Get https://9.3.126.147:6443/api/v1/nodes?fieldSelector=metadata.name%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:31:11 soe13 kubelet[139822]: E0922 19:31:11.258959  139822 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:450: Failed to list *v1.Service: Get https://9.3.126.147:6443/api/v1/services?limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:31:11 soe13 kubelet[139822]: E0922 19:31:11.260188  139822 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:46: Failed to list *v1.Pod: Get https://9.3.126.147:6443/api/v1/pods?fieldSelector=spec.nodeName%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:31:11 soe13 kubelet[139822]: E0922 19:31:11.262576  139822 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:459: Failed to list *v1.Node: Get https://9.3.126.147:6443/api/v1/nodes?fieldSelector=metadata.name%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:31:12 soe13 kubelet[139822]: E0922 19:31:12.259446  139822 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:450: Failed to list *v1.Service: Get https://9.3.126.147:6443/api/v1/services?limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:31:12 soe13 kubelet[139822]: E0922 19:31:12.260645  139822 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:46: Failed to list *v1.Pod: Get https://9.3.126.147:6443/api/v1/pods?fieldSelector=spec.nodeName%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:31:12 soe13 kubelet[139822]: E0922 19:31:12.262969  139822 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:459: Failed to list *v1.Node: Get https://9.3.126.147:6443/api/v1/nodes?fieldSelector=metadata.name%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:31:13 soe13 kubelet[139822]: E0922 19:31:13.259899  139822 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:450: Failed to list *v1.Service: Get https://9.3.126.147:6443/api/v1/services?limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:31:13 soe13 kubelet[139822]: E0922 19:31:13.261096  139822 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:46: Failed to list *v1.Pod: Get https://9.3.126.147:6443/api/v1/pods?fieldSelector=spec.nodeName%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:31:13 soe13 kubelet[139822]: E0922 19:31:13.263379  139822 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:459: Failed to list *v1.Node: Get https://9.3.126.147:6443/api/v1/nodes?fieldSelector=metadata.name%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:31:14 soe13 kubelet[139822]: E0922 19:31:14.260361  139822 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:450: Failed to list *v1.Service: Get https://9.3.126.147:6443/api/v1/services?limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:31:14 soe13 kubelet[139822]: E0922 19:31:14.261503  139822 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:46: Failed to list *v1.Pod: Get https://9.3.126.147:6443/api/v1/pods?fieldSelector=spec.nodeName%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:31:14 soe13 kubelet[139822]: E0922 19:31:14.263827  139822 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:459: Failed to list *v1.Node: Get https://9.3.126.147:6443/api/v1/nodes?fieldSelector=metadata.name%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:31:15 soe13 kubelet[139822]: E0922 19:31:15.260826  139822 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:450: Failed to list *v1.Service: Get https://9.3.126.147:6443/api/v1/services?limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:31:15 soe13 kubelet[139822]: E0922 19:31:15.261937  139822 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:46: Failed to list *v1.Pod: Get https://9.3.126.147:6443/api/v1/pods?fieldSelector=spec.nodeName%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:31:15 soe13 kubelet[139822]: E0922 19:31:15.264240  139822 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:459: Failed to list *v1.Node: Get https://9.3.126.147:6443/api/v1/nodes?fieldSelector=metadata.name%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:31:16 soe13 kubelet[139822]: E0922 19:31:16.261276  139822 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:450: Failed to list *v1.Service: Get https://9.3.126.147:6443/api/v1/services?limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:31:16 soe13 kubelet[139822]: E0922 19:31:16.262478  139822 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:46: Failed to list *v1.Pod: Get https://9.3.126.147:6443/api/v1/pods?fieldSelector=spec.nodeName%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:31:16 soe13 kubelet[139822]: E0922 19:31:16.264703  139822 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:459: Failed to list *v1.Node: Get https://9.3.126.147:6443/api/v1/nodes?fieldSelector=metadata.name%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:31:17 soe13 kubelet[139822]: E0922 19:31:17.262177  139822 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:450: Failed to list *v1.Service: Get https://9.3.126.147:6443/api/v1/services?limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:31:17 soe13 kubelet[139822]: E0922 19:31:17.262934  139822 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:46: Failed to list *v1.Pod: Get https://9.3.126.147:6443/api/v1/pods?fieldSelector=spec.nodeName%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:31:17 soe13 kubelet[139822]: E0922 19:31:17.265157  139822 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:459: Failed to list *v1.Node: Get https://9.3.126.147:6443/api/v1/nodes?fieldSelector=metadata.name%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:31:18 soe13 kubelet[139822]: E0922 19:31:18.262660  139822 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:450: Failed to list *v1.Service: Get https://9.3.126.147:6443/api/v1/services?limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:31:18 soe13 kubelet[139822]: E0922 19:31:18.263720  139822 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:46: Failed to list *v1.Pod: Get https://9.3.126.147:6443/api/v1/pods?fieldSelector=spec.nodeName%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:31:18 soe13 kubelet[139822]: E0922 19:31:18.265564  139822 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:459: Failed to list *v1.Node: Get https://9.3.126.147:6443/api/v1/nodes?fieldSelector=metadata.name%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:31:19 soe13 kubelet[139822]: E0922 19:31:19.263093  139822 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:450: Failed to list *v1.Service: Get https://9.3.126.147:6443/api/v1/services?limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:31:19 soe13 kubelet[139822]: E0922 19:31:19.264121  139822 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:46: Failed to list *v1.Pod: Get https://9.3.126.147:6443/api/v1/pods?fieldSelector=spec.nodeName%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:31:19 soe13 kubelet[139822]: E0922 19:31:19.265986  139822 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:459: Failed to list *v1.Node: Get https://9.3.126.147:6443/api/v1/nodes?fieldSelector=metadata.name%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:31:20 soe13 kubelet[139822]: W0922 19:31:20.256435  139822 clientconn.go:1120] grpc: addrConn.createTransport failed to connect to {/var/run/crio/crio.sock 0  <nil>}: didn't receive server preface in time. Reconnecting...
Sep 22 19:31:20 soe13 kubelet[139822]: W0922 19:31:20.256442  139822 clientconn.go:1120] grpc: addrConn.createTransport failed to connect to {/var/run/crio/crio.sock 0  <nil>}: didn't receive server preface in time. Reconnecting...
Sep 22 19:31:20 soe13 kubelet[139822]: E0922 19:31:20.263545  139822 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:450: Failed to list *v1.Service: Get https://9.3.126.147:6443/api/v1/services?limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:31:20 soe13 kubelet[139822]: E0922 19:31:20.264661  139822 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:46: Failed to list *v1.Pod: Get https://9.3.126.147:6443/api/v1/pods?fieldSelector=spec.nodeName%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:31:20 soe13 kubelet[139822]: E0922 19:31:20.266396  139822 reflector.go:123] k8s.io/kubernetes/pkg/kubelet/kubelet.go:459: Failed to list *v1.Node: Get https://9.3.126.147:6443/api/v1/nodes?fieldSelector=metadata.name%3Dsoe13&limit=500&resourceVersion=0: dial tcp 9.3.126.147:6443: connect: connection refused
Sep 22 19:31:20 soe13 kubelet[139822]: E0922 19:31:20.561281  139822 aws_credentials.go:77] while getting AWS credentials NoCredentialProviders: no valid providers in chain. Deprecated.
Sep 22 19:31:20 soe13 kubelet[139822]:         For verbose messaging see aws.Config.CredentialsChainVerboseErrors
Sep 22 19:31:20 soe13 kubelet[139822]: E0922 19:31:20.561412  139822 remote_runtime.go:81] Version from runtime service failed: rpc error: code = Unavailable desc = all SubConns are in TransientFailure, latest connection error: timed out waiting for server handshake
Sep 22 19:31:20 soe13 kubelet[139822]: E0922 19:31:20.561450  139822 kuberuntime_manager.go:193] Get runtime version failed: rpc error: code = Unavailable desc = all SubConns are in TransientFailure, latest connection error: timed out waiting for server handshake
Sep 22 19:31:20 soe13 kubelet[139822]: F0922 19:31:20.561491  139822 server.go:271] failed to run Kubelet: failed to create kubelet: rpc error: code = Unavailable desc = all SubConns are in TransientFailure, latest connection error: timed out waiting for server handshake
@nitkon nitkon added the kind/bug Categorizes issue or PR as related to a bug. label Sep 22, 2019
@k8s-ci-robot k8s-ci-robot added the needs-sig Indicates an issue or PR lacks a `sig/foo` label and requires one. label Sep 22, 2019
@tedyu
Copy link
Contributor

tedyu commented Sep 22, 2019 

Sep 22 19:31:20 soe13 kubelet[139822]: E0922 19:31:20.561281  139822 aws_credentials.go:77] while getting AWS credentials NoCredentialProviders: no valid providers in chain. Deprecated.
Sep 22 19:31:20 soe13 kubelet[139822]:         For verbose messaging see aws.Config.CredentialsChainVerboseErrors
Sep 22 19:31:20 soe13 kubelet[139822]: E0922 19:31:20.561412  139822 remote_runtime.go:81] Version from runtime service failed: rpc error: code = Unavailable desc = all SubConns are in TransientFailure, latest connection error: timed out waiting for server handshake

@zouyee
Copy link
Member

zouyee commented Sep 23, 2019 

 Sep 22 19:29:17 soe13 kubelet[139406]: F0922 19:29:17.893151  139406 server.go:251] unable to load client CA file /etc/kubernetes/pki/ca.crt: open /etc/kubernetes/pki/ca.crt: no such file or directory

@zouyee
Copy link
Member

zouyee commented Sep 23, 2019

/sig node

@k8s-ci-robot k8s-ci-robot added sig/node Categorizes an issue or PR as relevant to SIG Node. and removed needs-sig Indicates an issue or PR lacks a `sig/foo` label and requires one. labels Sep 23, 2019
@notpad
Copy link
Contributor

notpad commented Sep 24, 2019

@nitkon , you can try this:

  1. Run crictl info and check RuntimeReady is true
  2. Add --cgroup-driver=systemd to the kubelet start command (For example, in /etc/systemd/system/kubelet.service.d/10-kubeadm.conf)

@jobin-AT
Copy link

jobin-AT commented Nov 5, 2019

if you are running on openstack or any cloud please make sure to allow the ports in security groups
TCP | Inbound | 6443* | Kubernetes API server

in my case this was the error

@b23prodtm
Copy link

I also added cgroup_enable=cpuset cgroup_enable=memory cgroup_memory=1 to kernel parameters (ubuntu 19.10)

 sudo sed -i.bak -E "$ s/$/ cgroup_enable=cpuset cgroup_enable=memory cgroup_memory=1/" /boot/firmware/nobtcmd.txt    reboot

@fejta-bot
Copy link

Issues go stale after 90d of inactivity.
Mark the issue as fresh with /remove-lifecycle stale.
Stale issues rot after an additional 30d of inactivity and eventually close.

If this issue is safe to close now please do so with /close.

Send feedback to sig-testing, kubernetes/test-infra and/or fejta.
/lifecycle stale

@k8s-ci-robot k8s-ci-robot added the lifecycle/stale Denotes an issue or PR has remained open with no activity and has become stale. label Feb 27, 2020
@fejta-bot
Copy link

Stale issues rot after 30d of inactivity.
Mark the issue as fresh with /remove-lifecycle rotten.
Rotten issues close after an additional 30d of inactivity.

If this issue is safe to close now please do so with /close.

Send feedback to sig-testing, kubernetes/test-infra and/or fejta.
/lifecycle rotten

@k8s-ci-robot k8s-ci-robot added lifecycle/rotten Denotes an issue or PR that has aged beyond stale and will be auto-closed. and removed lifecycle/stale Denotes an issue or PR has remained open with no activity and has become stale. labels Mar 28, 2020
@fejta-bot
Copy link

Rotten issues close after 30d of inactivity.
Reopen the issue with /reopen.
Mark the issue as fresh with /remove-lifecycle rotten.

Send feedback to sig-testing, kubernetes/test-infra and/or fejta.
/close

@k8s-ci-robot
Copy link
Contributor

@fejta-bot: Closing this issue.

In response to this:

Rotten issues close after 30d of inactivity.
Reopen the issue with /reopen.
Mark the issue as fresh with /remove-lifecycle rotten.

Send feedback to sig-testing, kubernetes/test-infra and/or fejta.
/close

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
kind/bug Categorizes issue or PR as related to a bug. lifecycle/rotten Denotes an issue or PR that has aged beyond stale and will be auto-closed. sig/node Categorizes an issue or PR as relevant to SIG Node.
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
8 participants
@tedyu @notpad @b23prodtm @zouyee @k8s-ci-robot @fejta-bot @nitkon @jobin-AT