[microk8s 1.21 - Raspberry Pi 4] snap.microk8s.daemon-kubelite service continually restarts non-stop

[kevin-leong]

I am using microk8s 1.21 (with Ubuntu 21.04) on my Raspberry Pi 4 cluster never seems to want to come up....

Looking at "journalctl -u snap.microk8s.daemon-kubelite.service", I am notice that this service is just continuing to restart non-stop for "Waiting for containerd socket /var/snap/microk8s/common/run/containerd.sock to appear".

Looking "journalctl -u snap.microk8s.daemon-containerd.service", it looks like it is trying to "cleaning up dead shim".

I am not sure what is going wrong here. I didn't have this issue with 1.20.6. Looking at the git commit log for master, I notice this commit: 25fb636. Does this commit have something to do with this?

I appreciate if someone can please take a look at this issue, as this pretty much makes my cluster unusable and pretty much broken.....

Thank you.

Version:

$ snap info microk8s | egrep -i "latest/stable|installed"
tracking: latest/stable
latest/stable: v1.21.0 2021-04-21 (2129) 165MB classic
installed: v1.21.0 (2129) 165MB classic

snap.microk8s.daemon-kubelite.service show the below:

Apr 27 22:02:21 kube1.OMIT.lan systemd[1]: Started Service for snap application microk8s.daemon-kubelite.
Apr 27 22:02:21 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: + export PATH=/snap/microk8s/2129/usr/sbin:/snap/microk8s/2129/usr/bin:/snap/microk8s/2129/sbin:/snap/microk8s/2129/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin
Apr 27 22:02:21 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: + PATH=/snap/microk8s/2129/usr/sbin:/snap/microk8s/2129/usr/bin:/snap/microk8s/2129/sbin:/snap/microk8s/2129/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin
Apr 27 22:02:21 kube1.OMIT.lan microk8s.daemon-kubelite[8720]: ++ /snap/microk8s/2129/bin/uname -m
Apr 27 22:02:21 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: + ARCH=aarch64
Apr 27 22:02:21 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: + export LD_LIBRARY_PATH=:/snap/microk8s/2129/lib:/snap/microk8s/2129/usr/lib:/snap/microk8s/2129/lib/aarch64-linux-gnu:/snap/microk8s/2129/usr/lib/aarch64-linux-gnu
Apr 27 22:02:21 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: + LD_LIBRARY_PATH=:/snap/microk8s/2129/lib:/snap/microk8s/2129/usr/lib:/snap/microk8s/2129/lib/aarch64-linux-gnu:/snap/microk8s/2129/usr/lib/aarch64-linux-gnu
Apr 27 22:02:21 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: + export LD_LIBRARY_PATH=/var/lib/snapd/lib/gl:/var/lib/snapd/lib/gl32:/var/lib/snapd/void::/snap/microk8s/2129/lib:/snap/microk8s/2129/usr/lib:/snap/microk8s/2129/lib/aarch64-linux-gnu:/snap/microk8s/2129/usr/lib/aarch64-linux-gnu
Apr 27 22:02:21 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: + LD_LIBRARY_PATH=/var/lib/snapd/lib/gl:/var/lib/snapd/lib/gl32:/var/lib/snapd/void::/snap/microk8s/2129/lib:/snap/microk8s/2129/usr/lib:/snap/microk8s/2129/lib/aarch64-linux-gnu:/snap/microk8s/2129/usr/lib/aarch64-linux-gnu
Apr 27 22:02:21 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: + export XDG_RUNTIME_DIR=/var/snap/microk8s/common/run
Apr 27 22:02:21 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: + XDG_RUNTIME_DIR=/var/snap/microk8s/common/run
Apr 27 22:02:21 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: + mkdir -p /var/snap/microk8s/common/run
Apr 27 22:02:22 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: + source /snap/microk8s/2129/actions/common/utils.sh
Apr 27 22:02:22 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: + app=kubelite
Apr 27 22:02:22 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: + '[' -e /var/snap/microk8s/2129/var/lock/lite.lock ']'
Apr 27 22:02:22 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: + '[' -e /var/snap/microk8s/2129/var/lock/clustered.lock ']'
Apr 27 22:02:22 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: + refresh_opt_in_local_config start-control-plane true kubelite
Apr 27 22:02:22 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: + local opt=--start-control-plane
Apr 27 22:02:22 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: + local value=true
Apr 27 22:02:22 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: + local config_file=/var/snap/microk8s/2129/args/kubelite
Apr 27 22:02:22 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: + local replace_line=--start-control-plane=true
Apr 27 22:02:22 kube1.OMIT.lan microk8s.daemon-kubelite[8722]: ++ grep -qE '^--start-control-plane=' /var/snap/microk8s/2129/args/kubelite
Apr 27 22:02:22 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: + run_with_sudo /snap/microk8s/2129/bin/sed -i 's;^--start-control-plane=.;--start-control-plane=true;' /var/snap/microk8s/2129/args/kubelite
Apr 27 22:02:22 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: + '[' -n /var/lib/snapd/lib/gl:/var/lib/snapd/lib/gl32:/var/lib/snapd/void::/snap/microk8s/2129/lib:/snap/microk8s/2129/usr/lib:/snap/microk8s/2129/lib/aarch64-linux-gnu:/snap/microk8s/2129/usr/lib/aarch64-linux-gnu ']'
Apr 27 22:02:22 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: + GLOBAL_LD_LIBRARY_PATH=/var/lib/snapd/lib/gl:/var/lib/snapd/lib/gl32:/var/lib/snapd/void::/snap/microk8s/2129/lib:/snap/microk8s/2129/usr/lib:/snap/microk8s/2129/lib/aarch64-linux-gnu:/snap/microk8s/2129/usr/lib/aarch64-linux-gnu
Apr 27 22:02:22 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: + local LD_LIBRARY_PATH=
Apr 27 22:02:22 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: + '[' /snap/microk8s/2129/bin/sed == preserve_env ']'
Apr 27 22:02:22 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: + sudo LD_LIBRARY_PATH=/var/lib/snapd/lib/gl:/var/lib/snapd/lib/gl32:/var/lib/snapd/void::/snap/microk8s/2129/lib:/snap/microk8s/2129/usr/lib:/snap/microk8s/2129/lib/aarch64-linux-gnu:/snap/microk8s/2129/usr/lib/aarch64-linux-gnu /snap/microk8s/2129/bin/sed -i 's;^--start-control-plane=.;--start-control-plane=true;' /var/snap/microk8s/2129/args/kubelite
Apr 27 22:02:22 kube1.OMIT.lan sudo[8723]: root : PWD=/var/snap/microk8s/2129 ; USER=root ; ENV=LD_LIBRARY_PATH=/var/lib/snapd/lib/gl:/var/lib/snapd/lib/gl32:/var/lib/snapd/void::/snap/microk8s/2129/lib:/snap/microk8s/2129/usr/lib:/snap/microk8s/2129/lib/aarch64-linux-gnu:/snap/microk8s/2129/usr/lib/aarch64-linux-gnu ; COMMAND=/snap/microk8s/2129/bin/sed -i s;^--start-control-plane=.*;--start-control-plane=true; /var/snap/microk8s/2129/args/kubelite
Apr 27 22:02:22 kube1.OMIT.lan sudo[8723]: pam_unix(sudo:session): session opened for user root by (uid=0)
Apr 27 22:02:22 kube1.OMIT.lan sudo[8723]: pam_unix(sudo:session): session closed for user root
Apr 27 22:02:22 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: + '[' -e /var/snap/microk8s/2129/var/lock/stopped.lock ']'
Apr 27 22:02:22 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: + n=0
Apr 27 22:02:22 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: + '[' 0 -ge 20 ']'
Apr 27 22:02:22 kube1.OMIT.lan microk8s.daemon-kubelite[8725]: + ip route
Apr 27 22:02:22 kube1.OMIT.lan microk8s.daemon-kubelite[8726]: + grep default
Apr 27 22:02:22 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: + break
Apr 27 22:02:22 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: + '[' -e /var/snap/microk8s/2129/args/ha-conf ']'
Apr 27 22:02:22 kube1.OMIT.lan microk8s.daemon-kubelite[8727]: ++ get_opt_in_config --storage-dir kube-apiserver
Apr 27 22:02:22 kube1.OMIT.lan microk8s.daemon-kubelite[8727]: ++ local opt=--storage-dir
Apr 27 22:02:22 kube1.OMIT.lan microk8s.daemon-kubelite[8727]: ++ local config_file=/var/snap/microk8s/2129/args/kube-apiserver
Apr 27 22:02:22 kube1.OMIT.lan microk8s.daemon-kubelite[8727]: ++ val=
Apr 27 22:02:22 kube1.OMIT.lan microk8s.daemon-kubelite[8728]: +++ grep -qE '^--storage-dir=' /var/snap/microk8s/2129/args/kube-apiserver
Apr 27 22:02:22 kube1.OMIT.lan microk8s.daemon-kubelite[8730]: +++ grep -E '^--storage-dir' /var/snap/microk8s/2129/args/kube-apiserver
Apr 27 22:02:22 kube1.OMIT.lan microk8s.daemon-kubelite[8731]: +++ cut -d= -f2
Apr 27 22:02:22 kube1.OMIT.lan microk8s.daemon-kubelite[8727]: ++ val='${SNAP_DATA}/var/kubernetes/backend/'
Apr 27 22:02:22 kube1.OMIT.lan microk8s.daemon-kubelite[8727]: ++ echo '${SNAP_DATA}/var/kubernetes/backend/'
Apr 27 22:02:22 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: + storage_param='${SNAP_DATA}/var/kubernetes/backend/'
Apr 27 22:02:22 kube1.OMIT.lan microk8s.daemon-kubelite[8732]: ++ eval echo '${SNAP_DATA}/var/kubernetes/backend/'
Apr 27 22:02:22 kube1.OMIT.lan microk8s.daemon-kubelite[8732]: +++ echo /var/snap/microk8s/2129/var/kubernetes/backend/
Apr 27 22:02:22 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: + storage_dir=/var/snap/microk8s/2129/var/kubernetes/backend/
Apr 27 22:02:22 kube1.OMIT.lan microk8s.daemon-kubelite[8733]: ++ grep -qE '^failure-domain' /var/snap/microk8s/2129/args/ha-conf
Apr 27 22:02:22 kube1.OMIT.lan microk8s.daemon-kubelite[8734]: ++ get_opt_in_config failure-domain ha-conf
Apr 27 22:02:22 kube1.OMIT.lan microk8s.daemon-kubelite[8734]: ++ local opt=failure-domain
Apr 27 22:02:22 kube1.OMIT.lan microk8s.daemon-kubelite[8734]: ++ local config_file=/var/snap/microk8s/2129/args/ha-conf
Apr 27 22:02:22 kube1.OMIT.lan microk8s.daemon-kubelite[8734]: ++ val=
Apr 27 22:02:22 kube1.OMIT.lan microk8s.daemon-kubelite[8735]: +++ grep -qE '^failure-domain=' /var/snap/microk8s/2129/args/ha-conf
Apr 27 22:02:22 kube1.OMIT.lan microk8s.daemon-kubelite[8737]: +++ grep -E '^failure-domain' /var/snap/microk8s/2129/args/ha-conf
Apr 27 22:02:22 kube1.OMIT.lan microk8s.daemon-kubelite[8738]: +++ cut -d= -f2
Apr 27 22:02:22 kube1.OMIT.lan microk8s.daemon-kubelite[8734]: ++ val=1
Apr 27 22:02:22 kube1.OMIT.lan microk8s.daemon-kubelite[8734]: ++ echo 1
Apr 27 22:02:22 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: + val=1
Apr 27 22:02:22 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: + echo 1
Apr 27 22:02:22 kube1.OMIT.lan microk8s.daemon-kubelite[8740]: ++ cat /var/snap/microk8s/2129/args/kubelet
Apr 27 22:02:22 kube1.OMIT.lan microk8s.daemon-kubelite[8741]: ++ grep pod-cidr
Apr 27 22:02:22 kube1.OMIT.lan microk8s.daemon-kubelite[8743]: ++ gawk '{print $2}'
Apr 27 22:02:22 kube1.OMIT.lan microk8s.daemon-kubelite[8742]: ++ tr = ' '
Apr 27 22:02:22 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: + pod_cidr=
Apr 27 22:02:22 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: + '[' -z '' ']'
Apr 27 22:02:22 kube1.OMIT.lan microk8s.daemon-kubelite[8745]: ++ jq .Network /var/snap/microk8s/2129/args/flannel-network-mgr-config
Apr 27 22:02:22 kube1.OMIT.lan microk8s.daemon-kubelite[8746]: ++ tr -d '"'
Apr 27 22:02:22 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: + pod_cidr=10.1.0.0/16
Apr 27 22:02:22 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: + '[' -z 10.1.0.0/16 ']'
Apr 27 22:02:22 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: + iptables -C FORWARD -s 10.1.0.0/16 -m comment --comment 'generated for MicroK8s pods' -j ACCEPT
Apr 27 22:02:22 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: + grep -e '--address ' /var/snap/microk8s/2129/args/containerd
Apr 27 22:02:22 kube1.OMIT.lan microk8s.daemon-kubelite[8750]: ++ grep -e '--address ' /var/snap/microk8s/2129/args/containerd
Apr 27 22:02:22 kube1.OMIT.lan microk8s.daemon-kubelite[8751]: ++ gawk '{print $2}'
Apr 27 22:02:22 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: + socket='${SNAP_COMMON}/run/containerd.sock'
Apr 27 22:02:22 kube1.OMIT.lan microk8s.daemon-kubelite[8752]: ++ eval echo '${SNAP_COMMON}/run/containerd.sock'
Apr 27 22:02:22 kube1.OMIT.lan microk8s.daemon-kubelite[8752]: +++ echo /var/snap/microk8s/common/run/containerd.sock
Apr 27 22:02:22 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: + socket_file_expand=/var/snap/microk8s/common/run/containerd.sock
Apr 27 22:02:22 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: + n=0
Apr 27 22:02:22 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: + '[' 0 -ge 10 ']'
Apr 27 22:02:22 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: + test -S /var/snap/microk8s/common/run/containerd.sock
Apr 27 22:02:22 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: + echo 'Waiting for containerd socket /var/snap/microk8s/common/run/containerd.sock to appear. (attempt 0)'
Apr 27 22:02:22 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: Waiting for containerd socket /var/snap/microk8s/common/run/containerd.sock to appear. (attempt 0)
Apr 27 22:02:22 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: + n=1
Apr 27 22:02:22 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: + sleep 2
Apr 27 22:02:24 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: + '[' 1 -ge 10 ']'
Apr 27 22:02:24 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: + test -S /var/snap/microk8s/common/run/containerd.sock
Apr 27 22:02:24 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: + echo 'Waiting for containerd socket /var/snap/microk8s/common/run/containerd.sock to appear. (attempt 1)'
Apr 27 22:02:24 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: Waiting for containerd socket /var/snap/microk8s/common/run/containerd.sock to appear. (attempt 1)
Apr 27 22:02:24 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: + n=2
Apr 27 22:02:24 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: + sleep 2
Apr 27 22:02:26 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: + '[' 2 -ge 10 ']'
Apr 27 22:02:26 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: + test -S /var/snap/microk8s/common/run/containerd.sock
Apr 27 22:02:26 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: + echo 'Waiting for containerd socket /var/snap/microk8s/common/run/containerd.sock to appear. (attempt 2)'
Apr 27 22:02:26 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: Waiting for containerd socket /var/snap/microk8s/common/run/containerd.sock to appear. (attempt 2)
Apr 27 22:02:26 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: + n=3
Apr 27 22:02:26 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: + sleep 2
Apr 27 22:02:28 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: + '[' 3 -ge 10 ']'
Apr 27 22:02:28 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: + test -S /var/snap/microk8s/common/run/containerd.sock
Apr 27 22:02:28 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: + echo 'Waiting for containerd socket /var/snap/microk8s/common/run/containerd.sock to appear. (attempt 3)'
Apr 27 22:02:28 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: Waiting for containerd socket /var/snap/microk8s/common/run/containerd.sock to appear. (attempt 3)
Apr 27 22:02:28 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: + n=4
Apr 27 22:02:28 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: + sleep 2
Apr 27 22:02:30 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: + '[' 4 -ge 10 ']'
Apr 27 22:02:30 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: + test -S /var/snap/microk8s/common/run/containerd.sock
Apr 27 22:02:30 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: + echo 'Waiting for containerd socket /var/snap/microk8s/common/run/containerd.sock to appear. (attempt 4)'
Apr 27 22:02:30 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: Waiting for containerd socket /var/snap/microk8s/common/run/containerd.sock to appear. (attempt 4)
Apr 27 22:02:30 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: + n=5
Apr 27 22:02:30 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: + sleep 2
Apr 27 22:02:32 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: + '[' 5 -ge 10 ']'
Apr 27 22:02:32 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: + test -S /var/snap/microk8s/common/run/containerd.sock
Apr 27 22:02:32 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: + echo 'Waiting for containerd socket /var/snap/microk8s/common/run/containerd.sock to appear. (attempt 5)'
Apr 27 22:02:32 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: Waiting for containerd socket /var/snap/microk8s/common/run/containerd.sock to appear. (attempt 5)
Apr 27 22:02:32 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: + n=6
Apr 27 22:02:32 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: + sleep 2
Apr 27 22:02:34 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: + '[' 6 -ge 10 ']'
Apr 27 22:02:34 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: + test -S /var/snap/microk8s/common/run/containerd.sock
Apr 27 22:02:34 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: + echo 'Waiting for containerd socket /var/snap/microk8s/common/run/containerd.sock to appear. (attempt 6)'
Apr 27 22:02:34 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: Waiting for containerd socket /var/snap/microk8s/common/run/containerd.sock to appear. (attempt 6)
Apr 27 22:02:34 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: + n=7
Apr 27 22:02:34 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: + sleep 2
Apr 27 22:02:36 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: + '[' 7 -ge 10 ']'
Apr 27 22:02:36 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: + test -S /var/snap/microk8s/common/run/containerd.sock
Apr 27 22:02:36 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: + echo 'Waiting for containerd socket /var/snap/microk8s/common/run/containerd.sock to appear. (attempt 7)'
Apr 27 22:02:36 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: Waiting for containerd socket /var/snap/microk8s/common/run/containerd.sock to appear. (attempt 7)
Apr 27 22:02:36 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: + n=8
Apr 27 22:02:36 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: + sleep 2
Apr 27 22:02:38 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: + '[' 8 -ge 10 ']'
Apr 27 22:02:38 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: + test -S /var/snap/microk8s/common/run/containerd.sock
Apr 27 22:02:38 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: + echo 'Waiting for containerd socket /var/snap/microk8s/common/run/containerd.sock to appear. (attempt 8)'
Apr 27 22:02:38 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: Waiting for containerd socket /var/snap/microk8s/common/run/containerd.sock to appear. (attempt 8)
Apr 27 22:02:38 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: + n=9
Apr 27 22:02:38 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: + sleep 2
Apr 27 22:02:40 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: + '[' 9 -ge 10 ']'
Apr 27 22:02:40 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: + test -S /var/snap/microk8s/common/run/containerd.sock
Apr 27 22:02:40 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: + echo 'Waiting for containerd socket /var/snap/microk8s/common/run/containerd.sock to appear. (attempt 9)'
Apr 27 22:02:40 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: Waiting for containerd socket /var/snap/microk8s/common/run/containerd.sock to appear. (attempt 9)
Apr 27 22:02:40 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: + n=10
Apr 27 22:02:40 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: + sleep 2
Apr 27 22:02:42 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: + '[' 10 -ge 10 ']'
Apr 27 22:02:42 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: + '[' -e /proc/8704/cgroup ']'
Apr 27 22:02:42 kube1.OMIT.lan microk8s.daemon-kubelite[9008]: ++ gawk -F '[:]' '(/cpu/ && !/cpuset/) || /memory/ {print $3}' /proc/8704/cgroup
Apr 27 22:02:42 kube1.OMIT.lan microk8s.daemon-kubelite[9009]: ++ uniq
Apr 27 22:02:42 kube1.OMIT.lan microk8s.daemon-kubelite[9010]: ++ wc -l
Apr 27 22:02:42 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: + [[ 1 -eq 2 ]]
Apr 27 22:02:42 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: + '[' -L /var/lib/kubelet ']'
Apr 27 22:02:42 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: + echo '/var/lib/kubelet already exists. CSI add-ons have to point to /var/snap/microk8s/common for kubelet.'
Apr 27 22:02:42 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: /var/lib/kubelet already exists. CSI add-ons have to point to /var/snap/microk8s/common for kubelet.
Apr 27 22:02:42 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: + grep -E '(--advertise-address|--bind-address)' /var/snap/microk8s/2129/args/kube-apiserver
Apr 27 22:02:42 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: + rm -f /var/snap/microk8s/2129/external_ip.txt
Apr 27 22:02:42 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: + n=0
Apr 27 22:02:42 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: + '[' 0 -ge 20 ']'
Apr 27 22:02:42 kube1.OMIT.lan microk8s.daemon-kubelite[9013]: + ip route
Apr 27 22:02:42 kube1.OMIT.lan microk8s.daemon-kubelite[9014]: + grep default
Apr 27 22:02:42 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: + break
Apr 27 22:02:42 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: + '[' -e /var/snap/microk8s/2129/args/cni-network/cni.yaml ']'
Apr 27 22:02:42 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: + ipvs='ipv4 ipv6'
Apr 27 22:02:42 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: + for ipv in $ipvs
Apr 27 22:02:42 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: + '[' -e /proc/sys/net/ipv4/conf/all/forwarding ']'
Apr 27 22:02:42 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: + grep -e 1 /proc/sys/net/ipv4/conf/all/forwarding
Apr 27 22:02:42 kube1.OMIT.lan microk8s.daemon-kubelite[9015]: 1
Apr 27 22:02:42 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: + for ipv in $ipvs
Apr 27 22:02:42 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: + '[' -e /proc/sys/net/ipv6/conf/all/forwarding ']'
Apr 27 22:02:42 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: + grep -e 1 /proc/sys/net/ipv6/conf/all/forwarding
Apr 27 22:02:42 kube1.OMIT.lan microk8s.daemon-kubelite[9016]: 1
Apr 27 22:02:42 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: + '[' -f /var/snap/microk8s/2129/var/lock/host-access-enabled ']'
Apr 27 22:02:42 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: + '[' -f /proc/sys/net/bridge/bridge-nf-call-iptables ']'
Apr 27 22:02:42 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: + '[' -f /proc/sys/net/bridge/bridge-nf-call-iptables ']'
Apr 27 22:02:42 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: + grep 0 /proc/sys/net/bridge/bridge-nf-call-iptables
Apr 27 22:02:42 kube1.OMIT.lan microk8s.daemon-kubelite[9018]: ++ cat /var/snap/microk8s/2129/args/kubelite
Apr 27 22:02:42 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: + declare -a 'args=(--scheduler-args-file=$SNAP_DATA/args/kube-scheduler
Apr 27 22:02:42 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: --controller-manager-args-file=$SNAP_DATA/args/kube-controller-manager
Apr 27 22:02:42 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: --proxy-args-file=$SNAP_DATA/args/kube-proxy
Apr 27 22:02:42 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: --kubelet-args-file=$SNAP_DATA/args/kubelet
Apr 27 22:02:42 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: --apiserver-args-file=$SNAP_DATA/args/kube-apiserver
Apr 27 22:02:42 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: --kubeconfig-file=$SNAP_DATA/credentials/client.config
Apr 27 22:02:42 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: --start-control-plane=true)'
Apr 27 22:02:42 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: + exec /snap/microk8s/2129/kubelite --scheduler-args-file=/var/snap/microk8s/2129/args/kube-scheduler --controller-manager-args-file=/var/snap/microk8s/2129/args/kube-controller-manager --proxy-args-file=/var/snap/microk8s/2129/args/kube-proxy --kubelet-args-file=/var/snap/microk8s/2129/args/kubelet --apiserver-args-file=/var/snap/microk8s/2129/args/kube-apiserver --kubeconfig-file=/var/snap/microk8s/2129/credentials/client.config --start-control-plane=true
Apr 27 22:02:42 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: Starting kubelite
Apr 27 22:02:42 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:42.601960 8704 daemon.go:73] Waiting for the API server
Apr 27 22:02:42 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:42.606546 8704 daemon.go:65] Starting API Server
Apr 27 22:02:42 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: Flag --insecure-port has been deprecated, This flag has no effect now and will be removed in v1.24.
Apr 27 22:02:42 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:42.608795 8704 server.go:654] external host was not specified, using 10.0.10.11
Apr 27 22:02:42 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: W0427 22:02:42.608864 8704 authentication.go:507] AnonymousAuth is not allowed with the AlwaysAllow authorizer. Resetting AnonymousAuth to false. You should use a different authorizer
Apr 27 22:02:47 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: time="2021-04-27T22:02:47+09:00" level=info msg="Kine listening on unix:///var/snap/microk8s/2129/var/kubernetes/backend/kine.sock"
Apr 27 22:02:47 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:47.163544 8704 server.go:199] Version: v1.21.0-3+baf04bca88ce98
Apr 27 22:02:48 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:48.785612 8704 plugins.go:158] Loaded 11 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,ServiceAccount,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,StorageObjectInUseProtection,RuntimeClass,DefaultIngressClass,MutatingAdmissionWebhook.
Apr 27 22:02:48 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:48.785709 8704 plugins.go:161] Loaded 10 validating admission controller(s) successfully in the following order: LimitRanger,ServiceAccount,Priority,PersistentVolumeClaimResize,RuntimeClass,CertificateApproval,CertificateSigning,CertificateSubjectRestriction,ValidatingAdmissionWebhook,ResourceQuota.
Apr 27 22:02:48 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:48.789776 8704 plugins.go:158] Loaded 11 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,ServiceAccount,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,StorageObjectInUseProtection,RuntimeClass,DefaultIngressClass,MutatingAdmissionWebhook.
Apr 27 22:02:48 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:48.789852 8704 plugins.go:161] Loaded 10 validating admission controller(s) successfully in the following order: LimitRanger,ServiceAccount,Priority,PersistentVolumeClaimResize,RuntimeClass,CertificateApproval,CertificateSigning,CertificateSubjectRestriction,ValidatingAdmissionWebhook,ResourceQuota.
Apr 27 22:02:48 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:48.796637 8704 client.go:360] parsed scheme: "endpoint"
Apr 27 22:02:48 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:48.796761 8704 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{unix:///var/snap/microk8s/2129/var/kubernetes/backend//kine.sock 0 }]
Apr 27 22:02:48 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:48.798571 8704 client.go:360] parsed scheme: "endpoint"
Apr 27 22:02:48 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:48.798662 8704 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{unix:///var/snap/microk8s/2129/var/kubernetes/backend//kine.sock 0 }]
Apr 27 22:02:48 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:48.799749 8704 client.go:360] parsed scheme: "passthrough"
Apr 27 22:02:48 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:48.799864 8704 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{unix:///var/snap/microk8s/2129/var/kubernetes/backend//kine.sock 0 }] }
Apr 27 22:02:48 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:48.799900 8704 clientconn.go:948] ClientConn switching balancer to "pick_first"
Apr 27 22:02:48 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:48.801617 8704 client.go:360] parsed scheme: "endpoint"
Apr 27 22:02:48 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:48.801732 8704 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{unix:///var/snap/microk8s/2129/var/kubernetes/backend//kine.sock 0 }]
Apr 27 22:02:48 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:48.914934 8704 instance.go:283] Using reconciler: lease
Apr 27 22:02:48 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:48.923983 8704 client.go:360] parsed scheme: "endpoint"
Apr 27 22:02:48 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:48.924146 8704 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{unix:///var/snap/microk8s/2129/var/kubernetes/backend//kine.sock 0 }]
Apr 27 22:02:48 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:48.947784 8704 client.go:360] parsed scheme: "endpoint"
Apr 27 22:02:48 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:48.947972 8704 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{unix:///var/snap/microk8s/2129/var/kubernetes/backend//kine.sock 0 }]
Apr 27 22:02:48 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:48.951405 8704 client.go:360] parsed scheme: "endpoint"
Apr 27 22:02:48 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:48.951609 8704 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{unix:///var/snap/microk8s/2129/var/kubernetes/backend//kine.sock 0 }]
Apr 27 22:02:48 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:48.972946 8704 client.go:360] parsed scheme: "endpoint"
Apr 27 22:02:48 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:48.973057 8704 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{unix:///var/snap/microk8s/2129/var/kubernetes/backend//kine.sock 0 }]
Apr 27 22:02:48 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:48.998012 8704 client.go:360] parsed scheme: "endpoint"
Apr 27 22:02:48 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:48.998164 8704 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{unix:///var/snap/microk8s/2129/var/kubernetes/backend//kine.sock 0 }]
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.010979 8704 client.go:360] parsed scheme: "endpoint"
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.011128 8704 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{unix:///var/snap/microk8s/2129/var/kubernetes/backend//kine.sock 0 }]
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.016269 8704 client.go:360] parsed scheme: "endpoint"
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.016410 8704 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{unix:///var/snap/microk8s/2129/var/kubernetes/backend//kine.sock 0 }]
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.027598 8704 client.go:360] parsed scheme: "endpoint"
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.028311 8704 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{unix:///var/snap/microk8s/2129/var/kubernetes/backend//kine.sock 0 }]
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.034897 8704 client.go:360] parsed scheme: "endpoint"
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.035087 8704 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{unix:///var/snap/microk8s/2129/var/kubernetes/backend//kine.sock 0 }]
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.051598 8704 client.go:360] parsed scheme: "endpoint"
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.051761 8704 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{unix:///var/snap/microk8s/2129/var/kubernetes/backend//kine.sock 0 }]
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.073986 8704 client.go:360] parsed scheme: "endpoint"
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.074908 8704 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{unix:///var/snap/microk8s/2129/var/kubernetes/backend//kine.sock 0 }]
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.087203 8704 client.go:360] parsed scheme: "endpoint"
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.088113 8704 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{unix:///var/snap/microk8s/2129/var/kubernetes/backend//kine.sock 0 }]
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.097501 8704 client.go:360] parsed scheme: "endpoint"
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.098334 8704 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{unix:///var/snap/microk8s/2129/var/kubernetes/backend//kine.sock 0 }]
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.102919 8704 client.go:360] parsed scheme: "endpoint"
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.103740 8704 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{unix:///var/snap/microk8s/2129/var/kubernetes/backend//kine.sock 0 }]
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.108658 8704 client.go:360] parsed scheme: "endpoint"
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.109402 8704 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{unix:///var/snap/microk8s/2129/var/kubernetes/backend//kine.sock 0 }]
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.112027 8704 client.go:360] parsed scheme: "endpoint"
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.112742 8704 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{unix:///var/snap/microk8s/2129/var/kubernetes/backend//kine.sock 0 }]
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.127993 8704 client.go:360] parsed scheme: "endpoint"
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.128109 8704 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{unix:///var/snap/microk8s/2129/var/kubernetes/backend//kine.sock 0 }]
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.134022 8704 client.go:360] parsed scheme: "endpoint"
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.134178 8704 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{unix:///var/snap/microk8s/2129/var/kubernetes/backend//kine.sock 0 }]
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.136403 8704 rest.go:130] the default service ipfamily for this cluster is: IPv4
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.452269 8704 client.go:360] parsed scheme: "endpoint"
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.452411 8704 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{unix:///var/snap/microk8s/2129/var/kubernetes/backend//kine.sock 0 }]
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.454659 8704 client.go:360] parsed scheme: "endpoint"
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.454773 8704 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{unix:///var/snap/microk8s/2129/var/kubernetes/backend//kine.sock 0 }]
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.457460 8704 client.go:360] parsed scheme: "endpoint"
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.457575 8704 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{unix:///var/snap/microk8s/2129/var/kubernetes/backend//kine.sock 0 }]
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.459948 8704 client.go:360] parsed scheme: "endpoint"
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.460058 8704 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{unix:///var/snap/microk8s/2129/var/kubernetes/backend//kine.sock 0 }]
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.463298 8704 client.go:360] parsed scheme: "endpoint"
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.463398 8704 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{unix:///var/snap/microk8s/2129/var/kubernetes/backend//kine.sock 0 }]
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.466575 8704 client.go:360] parsed scheme: "endpoint"
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.466699 8704 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{unix:///var/snap/microk8s/2129/var/kubernetes/backend//kine.sock 0 }]
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.469719 8704 client.go:360] parsed scheme: "endpoint"
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.469830 8704 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{unix:///var/snap/microk8s/2129/var/kubernetes/backend//kine.sock 0 }]
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.471694 8704 client.go:360] parsed scheme: "endpoint"
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.471796 8704 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{unix:///var/snap/microk8s/2129/var/kubernetes/backend//kine.sock 0 }]
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.473879 8704 client.go:360] parsed scheme: "endpoint"
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.473991 8704 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{unix:///var/snap/microk8s/2129/var/kubernetes/backend//kine.sock 0 }]
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.475842 8704 client.go:360] parsed scheme: "endpoint"
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.475934 8704 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{unix:///var/snap/microk8s/2129/var/kubernetes/backend//kine.sock 0 }]
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.477802 8704 client.go:360] parsed scheme: "endpoint"
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.478467 8704 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{unix:///var/snap/microk8s/2129/var/kubernetes/backend//kine.sock 0 }]
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.480900 8704 client.go:360] parsed scheme: "endpoint"
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.480993 8704 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{unix:///var/snap/microk8s/2129/var/kubernetes/backend//kine.sock 0 }]
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.482914 8704 client.go:360] parsed scheme: "endpoint"
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.483017 8704 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{unix:///var/snap/microk8s/2129/var/kubernetes/backend//kine.sock 0 }]
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.485069 8704 client.go:360] parsed scheme: "endpoint"
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.485160 8704 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{unix:///var/snap/microk8s/2129/var/kubernetes/backend//kine.sock 0 }]
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.487712 8704 client.go:360] parsed scheme: "endpoint"
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.487801 8704 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{unix:///var/snap/microk8s/2129/var/kubernetes/backend//kine.sock 0 }]
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.490022 8704 client.go:360] parsed scheme: "endpoint"
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.490117 8704 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{unix:///var/snap/microk8s/2129/var/kubernetes/backend//kine.sock 0 }]
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.492195 8704 client.go:360] parsed scheme: "endpoint"
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.492282 8704 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{unix:///var/snap/microk8s/2129/var/kubernetes/backend//kine.sock 0 }]
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.494702 8704 client.go:360] parsed scheme: "endpoint"
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.494795 8704 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{unix:///var/snap/microk8s/2129/var/kubernetes/backend//kine.sock 0 }]
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.496397 8704 client.go:360] parsed scheme: "endpoint"
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.496493 8704 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{unix:///var/snap/microk8s/2129/var/kubernetes/backend//kine.sock 0 }]
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.498355 8704 client.go:360] parsed scheme: "endpoint"
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.498544 8704 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{unix:///var/snap/microk8s/2129/var/kubernetes/backend//kine.sock 0 }]
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.500417 8704 client.go:360] parsed scheme: "endpoint"
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.500554 8704 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{unix:///var/snap/microk8s/2129/var/kubernetes/backend//kine.sock 0 }]
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.502963 8704 client.go:360] parsed scheme: "endpoint"
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.503056 8704 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{unix:///var/snap/microk8s/2129/var/kubernetes/backend//kine.sock 0 }]
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.505296 8704 client.go:360] parsed scheme: "endpoint"
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.505394 8704 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{unix:///var/snap/microk8s/2129/var/kubernetes/backend//kine.sock 0 }]
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.509321 8704 client.go:360] parsed scheme: "endpoint"
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.509513 8704 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{unix:///var/snap/microk8s/2129/var/kubernetes/backend//kine.sock 0 }]
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.516039 8704 client.go:360] parsed scheme: "endpoint"
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.517124 8704 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{unix:///var/snap/microk8s/2129/var/kubernetes/backend//kine.sock 0 }]
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.524032 8704 client.go:360] parsed scheme: "endpoint"
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.524191 8704 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{unix:///var/snap/microk8s/2129/var/kubernetes/backend//kine.sock 0 }]
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.532257 8704 client.go:360] parsed scheme: "endpoint"
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.532398 8704 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{unix:///var/snap/microk8s/2129/var/kubernetes/backend//kine.sock 0 }]
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.536960 8704 client.go:360] parsed scheme: "endpoint"
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.538051 8704 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{unix:///var/snap/microk8s/2129/var/kubernetes/backend//kine.sock 0 }]
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.541750 8704 client.go:360] parsed scheme: "endpoint"
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.541932 8704 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{unix:///var/snap/microk8s/2129/var/kubernetes/backend//kine.sock 0 }]
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.545610 8704 client.go:360] parsed scheme: "endpoint"
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.546640 8704 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{unix:///var/snap/microk8s/2129/var/kubernetes/backend//kine.sock 0 }]
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.550165 8704 client.go:360] parsed scheme: "endpoint"
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.551522 8704 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{unix:///var/snap/microk8s/2129/var/kubernetes/backend//kine.sock 0 }]
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.561565 8704 client.go:360] parsed scheme: "endpoint"
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.561702 8704 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{unix:///var/snap/microk8s/2129/var/kubernetes/backend//kine.sock 0 }]
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.564619 8704 client.go:360] parsed scheme: "endpoint"
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.564730 8704 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{unix:///var/snap/microk8s/2129/var/kubernetes/backend//kine.sock 0 }]
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.567352 8704 client.go:360] parsed scheme: "endpoint"
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.567450 8704 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{unix:///var/snap/microk8s/2129/var/kubernetes/backend//kine.sock 0 }]
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.569382 8704 client.go:360] parsed scheme: "endpoint"
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.569464 8704 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{unix:///var/snap/microk8s/2129/var/kubernetes/backend//kine.sock 0 }]
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.571551 8704 client.go:360] parsed scheme: "endpoint"
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.571637 8704 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{unix:///var/snap/microk8s/2129/var/kubernetes/backend//kine.sock 0 }]
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.573653 8704 client.go:360] parsed scheme: "endpoint"
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.573752 8704 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{unix:///var/snap/microk8s/2129/var/kubernetes/backend//kine.sock 0 }]
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.575709 8704 client.go:360] parsed scheme: "endpoint"
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.575803 8704 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{unix:///var/snap/microk8s/2129/var/kubernetes/backend//kine.sock 0 }]
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.577573 8704 client.go:360] parsed scheme: "endpoint"
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.577660 8704 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{unix:///var/snap/microk8s/2129/var/kubernetes/backend//kine.sock 0 }]
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.579520 8704 client.go:360] parsed scheme: "endpoint"
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.579606 8704 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{unix:///var/snap/microk8s/2129/var/kubernetes/backend//kine.sock 0 }]
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.581325 8704 client.go:360] parsed scheme: "endpoint"
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.581415 8704 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{unix:///var/snap/microk8s/2129/var/kubernetes/backend//kine.sock 0 }]
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.583341 8704 client.go:360] parsed scheme: "endpoint"
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.583439 8704 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{unix:///var/snap/microk8s/2129/var/kubernetes/backend//kine.sock 0 }]
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.585355 8704 client.go:360] parsed scheme: "endpoint"
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.585449 8704 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{unix:///var/snap/microk8s/2129/var/kubernetes/backend//kine.sock 0 }]
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.587431 8704 client.go:360] parsed scheme: "endpoint"
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.587526 8704 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{unix:///var/snap/microk8s/2129/var/kubernetes/backend//kine.sock 0 }]
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.589585 8704 client.go:360] parsed scheme: "endpoint"
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.589678 8704 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{unix:///var/snap/microk8s/2129/var/kubernetes/backend//kine.sock 0 }]
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.592230 8704 client.go:360] parsed scheme: "endpoint"
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.592360 8704 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{unix:///var/snap/microk8s/2129/var/kubernetes/backend//kine.sock 0 }]
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.594575 8704 client.go:360] parsed scheme: "endpoint"
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.594696 8704 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{unix:///var/snap/microk8s/2129/var/kubernetes/backend//kine.sock 0 }]
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.597093 8704 client.go:360] parsed scheme: "endpoint"
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.597191 8704 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{unix:///var/snap/microk8s/2129/var/kubernetes/backend//kine.sock 0 }]
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.599123 8704 client.go:360] parsed scheme: "endpoint"
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.599223 8704 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{unix:///var/snap/microk8s/2129/var/kubernetes/backend//kine.sock 0 }]
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.601627 8704 client.go:360] parsed scheme: "endpoint"
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.601732 8704 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{unix:///var/snap/microk8s/2129/var/kubernetes/backend//kine.sock 0 }]
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.603897 8704 client.go:360] parsed scheme: "endpoint"
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.604002 8704 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{unix:///var/snap/microk8s/2129/var/kubernetes/backend//kine.sock 0 }]
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.605892 8704 client.go:360] parsed scheme: "endpoint"
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.606104 8704 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{unix:///var/snap/microk8s/2129/var/kubernetes/backend//kine.sock 0 }]
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.608347 8704 client.go:360] parsed scheme: "endpoint"
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.608435 8704 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{unix:///var/snap/microk8s/2129/var/kubernetes/backend//kine.sock 0 }]
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.610450 8704 client.go:360] parsed scheme: "endpoint"
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.610536 8704 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{unix:///var/snap/microk8s/2129/var/kubernetes/backend//kine.sock 0 }]
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.611962 8704 client.go:360] parsed scheme: "endpoint"
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.612050 8704 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{unix:///var/snap/microk8s/2129/var/kubernetes/backend//kine.sock 0 }]
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.809172 8704 client.go:360] parsed scheme: "endpoint"
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.809387 8704 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{unix:///var/snap/microk8s/2129/var/kubernetes/backend//kine.sock 0 }]
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:49.897159 8704 trace.go:205] Trace[1786663134]: "List etcd3" key:/apiextensions.k8s.io/customresourcedefinitions,resourceVersion:,resourceVersionMatch:,limit:10000,continue: (27-Apr-2021 22:02:48.804) (total time: 1092ms):
Apr 27 22:02:49 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: Trace[1786663134]: [1.092942678s] [1.092942678s] END
Apr 27 22:02:50 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:50.112938 8704 trace.go:205] Trace[1158332887]: "List etcd3" key:/csinodes,resourceVersion:,resourceVersionMatch:,limit:10000,continue: (27-Apr-2021 22:02:49.582) (total time: 530ms):
Apr 27 22:02:50 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: Trace[1158332887]: [530.006603ms] [530.006603ms] END
Apr 27 22:02:50 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:50.142551 8704 trace.go:205] Trace[678315067]: "List etcd3" key:/roles,resourceVersion:,resourceVersionMatch:,limit:10000,continue: (27-Apr-2021 22:02:49.515) (total time: 626ms):
Apr 27 22:02:50 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: Trace[678315067]: [626.873718ms] [626.873718ms] END
Apr 27 22:02:50 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: W0427 22:02:50.191409 8704 genericapiserver.go:425] Skipping API node.k8s.io/v1alpha1 because it has no resources.
Apr 27 22:02:50 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:50.194078 8704 trace.go:205] Trace[2966718]: "List etcd3" key:/csinodes,resourceVersion:,resourceVersionMatch:,limit:10000,continue: (27-Apr-2021 22:02:49.573) (total time: 620ms):
Apr 27 22:02:50 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: Trace[2966718]: [620.930399ms] [620.930399ms] END
Apr 27 22:02:50 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:50.194521 8704 trace.go:205] Trace[1109451170]: "List etcd3" key:/clusterrolebindings,resourceVersion:,resourceVersionMatch:,limit:10000,continue: (27-Apr-2021 22:02:49.536) (total time: 658ms):
Apr 27 22:02:50 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: Trace[1109451170]: [658.357147ms] [658.357147ms] END
Apr 27 22:02:50 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:50.196340 8704 trace.go:205] Trace[797820568]: "List etcd3" key:/rolebindings,resourceVersion:,resourceVersionMatch:,limit:10000,continue: (27-Apr-2021 22:02:49.545) (total time: 649ms):
Apr 27 22:02:50 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: Trace[797820568]: [649.072004ms] [649.072004ms] END
Apr 27 22:02:50 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:50.200445 8704 trace.go:205] Trace[1882289783]: "List etcd3" key:/csidrivers,resourceVersion:,resourceVersionMatch:,limit:10000,continue: (27-Apr-2021 22:02:49.584) (total time: 615ms):
Apr 27 22:02:50 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: Trace[1882289783]: [615.926941ms] [615.926941ms] END
Apr 27 22:02:50 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:50.240198 8704 trace.go:205] Trace[1495609042]: "List etcd3" key:/csidrivers,resourceVersion:,resourceVersionMatch:,limit:10000,continue: (27-Apr-2021 22:02:49.575) (total time: 664ms):
Apr 27 22:02:50 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: Trace[1495609042]: [664.788317ms] [664.788317ms] END
Apr 27 22:02:50 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: W0427 22:02:50.240706 8704 genericapiserver.go:425] Skipping API rbac.authorization.k8s.io/v1alpha1 because it has no resources.
Apr 27 22:02:50 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: W0427 22:02:50.258210 8704 genericapiserver.go:425] Skipping API scheduling.k8s.io/v1alpha1 because it has no resources.
Apr 27 22:02:50 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: W0427 22:02:50.287969 8704 genericapiserver.go:425] Skipping API storage.k8s.io/v1alpha1 because it has no resources.
Apr 27 22:02:50 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:50.290155 8704 trace.go:205] Trace[34274547]: "List etcd3" key:/clusterroles,resourceVersion:,resourceVersionMatch:,limit:10000,continue: (27-Apr-2021 22:02:49.533) (total time: 756ms):
Apr 27 22:02:50 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: Trace[34274547]: [756.769918ms] [756.769918ms] END
Apr 27 22:02:50 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: W0427 22:02:50.300591 8704 genericapiserver.go:425] Skipping API flowcontrol.apiserver.k8s.io/v1alpha1 because it has no resources.
Apr 27 22:02:50 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: W0427 22:02:50.324993 8704 genericapiserver.go:425] Skipping API apps/v1beta2 because it has no resources.
Apr 27 22:02:50 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: W0427 22:02:50.325084 8704 genericapiserver.go:425] Skipping API apps/v1beta1 because it has no resources.
Apr 27 22:02:50 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:50.339565 8704 trace.go:205] Trace[1425990613]: "List etcd3" key:/volumeattachments,resourceVersion:,resourceVersionMatch:,limit:10000,continue: (27-Apr-2021 22:02:49.570) (total time: 768ms):
Apr 27 22:02:50 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: Trace[1425990613]: [768.584553ms] [768.584553ms] END
Apr 27 22:02:50 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:50.355314 8704 trace.go:205] Trace[1586811594]: "List etcd3" key:/validatingwebhookconfigurations,resourceVersion:,resourceVersionMatch:,limit:10000,continue: (27-Apr-2021 22:02:49.608) (total time: 747ms):
Apr 27 22:02:50 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: Trace[1586811594]: [747.156257ms] [747.156257ms] END
Apr 27 22:02:50 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:50.367530 8704 plugins.go:158] Loaded 11 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,ServiceAccount,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,StorageObjectInUseProtection,RuntimeClass,DefaultIngressClass,MutatingAdmissionWebhook.
Apr 27 22:02:50 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:50.367605 8704 plugins.go:161] Loaded 10 validating admission controller(s) successfully in the following order: LimitRanger,ServiceAccount,Priority,PersistentVolumeClaimResize,RuntimeClass,CertificateApproval,CertificateSigning,CertificateSubjectRestriction,ValidatingAdmissionWebhook,ResourceQuota.
Apr 27 22:02:50 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:50.373469 8704 client.go:360] parsed scheme: "endpoint"
Apr 27 22:02:50 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:50.373594 8704 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{unix:///var/snap/microk8s/2129/var/kubernetes/backend//kine.sock 0 }]
Apr 27 22:02:50 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:50.374913 8704 trace.go:205] Trace[1959154632]: "List etcd3" key:/certificatesigningrequests,resourceVersion:,resourceVersionMatch:,limit:10000,continue: (27-Apr-2021 22:02:49.473) (total time: 901ms):
Apr 27 22:02:50 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: Trace[1959154632]: [901.495165ms] [901.495165ms] END
Apr 27 22:02:50 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:50.376184 8704 client.go:360] parsed scheme: "endpoint"
Apr 27 22:02:50 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:50.376276 8704 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{unix:///var/snap/microk8s/2129/var/kubernetes/backend//kine.sock 0 }]
Apr 27 22:02:50 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:50.376578 8704 trace.go:205] Trace[1760245344]: "List etcd3" key:/podsecuritypolicy,resourceVersion:,resourceVersionMatch:,limit:10000,continue: (27-Apr-2021 22:02:49.504) (total time: 871ms):
Apr 27 22:02:50 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: Trace[1760245344]: [871.610268ms] [871.610268ms] END
Apr 27 22:02:50 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:50.490462 8704 trace.go:205] Trace[1144970372]: "List etcd3" key:/ingress,resourceVersion:,resourceVersionMatch:,limit:10000,continue: (27-Apr-2021 22:02:49.489) (total time: 1001ms):
Apr 27 22:02:50 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: Trace[1144970372]: [1.001015121s] [1.001015121s] END
Apr 27 22:02:50 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:50.498516 8704 trace.go:205] Trace[1102073629]: "List etcd3" key:/certificatesigningrequests,resourceVersion:,resourceVersionMatch:,limit:10000,continue: (27-Apr-2021 22:02:49.471) (total time: 1027ms):
Apr 27 22:02:50 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: Trace[1102073629]: [1.027161849s] [1.027161849s] END
Apr 27 22:02:50 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:50.524716 8704 trace.go:205] Trace[1736924463]: "List etcd3" key:/daemonsets,resourceVersion:,resourceVersionMatch:,limit:10000,continue: (27-Apr-2021 22:02:49.596) (total time: 927ms):
Apr 27 22:02:50 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: Trace[1736924463]: [927.910517ms] [927.910517ms] END
Apr 27 22:02:50 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:50.585711 8704 trace.go:205] Trace[2096855732]: "List etcd3" key:/validatingwebhookconfigurations,resourceVersion:,resourceVersionMatch:,limit:10000,continue: (27-Apr-2021 22:02:49.603) (total time: 982ms):
Apr 27 22:02:50 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: Trace[2096855732]: [982.254658ms] [982.254658ms] END
Apr 27 22:02:50 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:50.594208 8704 trace.go:205] Trace[1900908363]: "List etcd3" key:/clusterroles,resourceVersion:,resourceVersionMatch:,limit:10000,continue: (27-Apr-2021 22:02:49.550) (total time: 1043ms):
Apr 27 22:02:50 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: Trace[1900908363]: [1.043657101s] [1.043657101s] END
Apr 27 22:02:50 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:50.616301 8704 trace.go:205] Trace[433080305]: "List etcd3" key:/horizontalpodautoscalers,resourceVersion:,resourceVersionMatch:,limit:10000,continue: (27-Apr-2021 22:02:49.456) (total time: 1159ms):
Apr 27 22:02:50 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: Trace[433080305]: [1.159474814s] [1.159474814s] END
Apr 27 22:02:50 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:50.628708 8704 trace.go:205] Trace[282785752]: "List etcd3" key:/volumeattachments,resourceVersion:,resourceVersionMatch:,limit:10000,continue: (27-Apr-2021 22:02:49.580) (total time: 1047ms):
Apr 27 22:02:50 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: Trace[282785752]: [1.047925751s] [1.047925751s] END
Apr 27 22:02:50 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:50.651478 8704 trace.go:205] Trace[1157483775]: "List etcd3" key:/ingress,resourceVersion:,resourceVersionMatch:,limit:10000,continue: (27-Apr-2021 22:02:49.494) (total time: 1157ms):
Apr 27 22:02:50 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: Trace[1157483775]: [1.157278197s] [1.157278197s] END
Apr 27 22:02:50 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:50.690713 8704 trace.go:205] Trace[84963465]: "List etcd3" key:/poddisruptionbudgets,resourceVersion:,resourceVersionMatch:,limit:10000,continue: (27-Apr-2021 22:02:49.502) (total time: 1188ms):
Apr 27 22:02:50 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: Trace[84963465]: [1.188189487s] [1.188189487s] END
Apr 27 22:02:50 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:50.694177 8704 trace.go:205] Trace[985352022]: "List etcd3" key:/horizontalpodautoscalers,resourceVersion:,resourceVersionMatch:,limit:10000,continue: (27-Apr-2021 22:02:49.454) (total time: 1239ms):
Apr 27 22:02:50 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: Trace[985352022]: [1.239406723s] [1.239406723s] END
Apr 27 22:02:50 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:50.752859 8704 trace.go:205] Trace[287038275]: "List etcd3" key:/clusterrolebindings,resourceVersion:,resourceVersionMatch:,limit:10000,continue: (27-Apr-2021 22:02:49.555) (total time: 1197ms):
Apr 27 22:02:50 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: Trace[287038275]: [1.197108207s] [1.197108207s] END
Apr 27 22:02:50 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:50.768953 8704 trace.go:205] Trace[751577478]: "List etcd3" key:/horizontalpodautoscalers,resourceVersion:,resourceVersionMatch:,limit:10000,continue: (27-Apr-2021 22:02:49.460) (total time: 1307ms):
Apr 27 22:02:50 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: Trace[751577478]: [1.307910453s] [1.307910453s] END
Apr 27 22:02:50 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:50.859354 8704 trace.go:205] Trace[1172672894]: "List etcd3" key:/jobs,resourceVersion:,resourceVersionMatch:,limit:10000,continue: (27-Apr-2021 22:02:49.462) (total time: 1396ms):
Apr 27 22:02:50 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: Trace[1172672894]: [1.396500777s] [1.396500777s] END
Apr 27 22:02:50 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:50.875667 8704 trace.go:205] Trace[463230451]: "List etcd3" key:/ingressclasses,resourceVersion:,resourceVersionMatch:,limit:10000,continue: (27-Apr-2021 22:02:49.495) (total time: 1379ms):
Apr 27 22:02:50 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: Trace[463230451]: [1.379806063s] [1.379806063s] END
Apr 27 22:02:50 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:50.875763 8704 trace.go:205] Trace[1731689899]: "List etcd3" key:/mutatingwebhookconfigurations,resourceVersion:,resourceVersionMatch:,limit:10000,continue: (27-Apr-2021 22:02:49.609) (total time: 1265ms):
Apr 27 22:02:50 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: Trace[1731689899]: [1.265757973s] [1.265757973s] END
Apr 27 22:02:50 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:50.878622 8704 trace.go:205] Trace[1974951002]: "List etcd3" key:/poddisruptionbudgets,resourceVersion:,resourceVersionMatch:,limit:10000,continue: (27-Apr-2021 22:02:49.507) (total time: 1371ms):
Apr 27 22:02:50 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: Trace[1974951002]: [1.371515993s] [1.371515993s] END
Apr 27 22:02:50 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:50.904754 8704 trace.go:205] Trace[1024708100]: "List etcd3" key:/roles,resourceVersion:,resourceVersionMatch:,limit:10000,continue: (27-Apr-2021 22:02:49.541) (total time: 1363ms):
Apr 27 22:02:50 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: Trace[1024708100]: [1.363362759s] [1.363362759s] END
Apr 27 22:02:50 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:50.910948 8704 trace.go:205] Trace[295317401]: "List etcd3" key:/prioritylevelconfigurations,resourceVersion:,resourceVersionMatch:,limit:10000,continue: (27-Apr-2021 22:02:49.588) (total time: 1322ms):
Apr 27 22:02:50 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: Trace[295317401]: [1.322229595s] [1.322229595s] END
Apr 27 22:02:50 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:50.916495 8704 trace.go:205] Trace[1833952109]: "List etcd3" key:/networkpolicies,resourceVersion:,resourceVersionMatch:,limit:10000,continue: (27-Apr-2021 22:02:49.486) (total time: 1429ms):
Apr 27 22:02:50 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: Trace[1833952109]: [1.429580463s] [1.429580463s] END
Apr 27 22:02:50 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:50.938585 8704 trace.go:205] Trace[721171473]: "List etcd3" key:/deployments,resourceVersion:,resourceVersionMatch:,limit:10000,continue: (27-Apr-2021 22:02:49.591) (total time: 1346ms):
Apr 27 22:02:50 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: Trace[721171473]: [1.346601729s] [1.346601729s] END
Apr 27 22:02:50 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:50.974766 8704 trace.go:205] Trace[1641174931]: "List etcd3" key:/ingressclasses,resourceVersion:,resourceVersionMatch:,limit:10000,continue: (27-Apr-2021 22:02:49.491) (total time: 1483ms):
Apr 27 22:02:50 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: Trace[1641174931]: [1.48302767s] [1.48302767s] END
Apr 27 22:02:50 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:50.998800 8704 trace.go:205] Trace[641953669]: "List etcd3" key:/cronjobs,resourceVersion:,resourceVersionMatch:,limit:10000,continue: (27-Apr-2021 22:02:49.467) (total time: 1530ms):
Apr 27 22:02:50 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: Trace[641953669]: [1.530932183s] [1.530932183s] END
Apr 27 22:02:50 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:50.999606 8704 trace.go:205] Trace[1778201860]: "List etcd3" key:/runtimeclasses,resourceVersion:,resourceVersionMatch:,limit:10000,continue: (27-Apr-2021 22:02:49.497) (total time: 1501ms):
Apr 27 22:02:50 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: Trace[1778201860]: [1.501678538s] [1.501678538s] END
Apr 27 22:02:51 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:51.000862 8704 trace.go:205] Trace[1881040161]: "List etcd3" key:/runtimeclasses,resourceVersion:,resourceVersionMatch:,limit:10000,continue: (27-Apr-2021 22:02:49.499) (total time: 1500ms):
Apr 27 22:02:51 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: Trace[1881040161]: [1.500943794s] [1.500943794s] END
Apr 27 22:02:51 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:51.002753 8704 trace.go:205] Trace[1456341228]: "List etcd3" key:/csistoragecapacities,resourceVersion:,resourceVersionMatch:,limit:10000,continue: (27-Apr-2021 22:02:49.576) (total time: 1425ms):
Apr 27 22:02:51 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: Trace[1456341228]: [1.425659362s] [1.425659362s] END
Apr 27 22:02:51 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:51.007022 8704 trace.go:205] Trace[864568074]: "List etcd3" key:/cronjobs,resourceVersion:,resourceVersionMatch:,limit:10000,continue: (27-Apr-2021 22:02:49.465) (total time: 1541ms):
Apr 27 22:02:51 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: Trace[864568074]: [1.541701618s] [1.541701618s] END
Apr 27 22:02:58 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:58.436515 8704 dynamic_cafile_content.go:167] Starting request-header::/var/snap/microk8s/2129/certs/front-proxy-ca.crt
Apr 27 22:02:58 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:58.436578 8704 dynamic_cafile_content.go:167] Starting client-ca-bundle::/var/snap/microk8s/2129/certs/ca.crt
Apr 27 22:02:58 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:58.437222 8704 dynamic_serving_content.go:130] Starting serving-cert::/var/snap/microk8s/2129/certs/server.crt::/var/snap/microk8s/2129/certs/server.key
Apr 27 22:02:58 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:58.438637 8704 secure_serving.go:197] Serving securely on [::]:16443
Apr 27 22:02:58 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:58.438729 8704 tlsconfig.go:240] Starting DynamicServingCertificateController
Apr 27 22:02:58 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:58.440066 8704 customresource_discovery_controller.go:209] Starting DiscoveryController
Apr 27 22:02:58 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:58.440188 8704 dynamic_serving_content.go:130] Starting aggregator-proxy-cert::/var/snap/microk8s/2129/certs/front-proxy-client.crt::/var/snap/microk8s/2129/certs/front-proxy-client.key
Apr 27 22:02:58 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:58.440494 8704 cluster_authentication_trust_controller.go:440] Starting cluster_authentication_trust_controller controller
Apr 27 22:02:58 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:58.440534 8704 shared_informer.go:240] Waiting for caches to sync for cluster_authentication_trust_controller
Apr 27 22:02:58 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:58.441990 8704 available_controller.go:475] Starting AvailableConditionController
Apr 27 22:02:58 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:58.442057 8704 cache.go:32] Waiting for caches to sync for AvailableConditionController controller
Apr 27 22:02:58 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:58.442139 8704 apf_controller.go:294] Starting API Priority and Fairness config controller
Apr 27 22:02:58 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:58.442232 8704 dynamic_cafile_content.go:167] Starting client-ca-bundle::/var/snap/microk8s/2129/certs/ca.crt
Apr 27 22:02:58 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:58.446446 8704 dynamic_cafile_content.go:167] Starting request-header::/var/snap/microk8s/2129/certs/front-proxy-ca.crt
Apr 27 22:02:58 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:58.449915 8704 autoregister_controller.go:141] Starting autoregister controller
Apr 27 22:02:58 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:58.449981 8704 cache.go:32] Waiting for caches to sync for autoregister controller
Apr 27 22:02:58 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:58.450057 8704 controller.go:83] Starting OpenAPI AggregationController
Apr 27 22:02:58 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:58.456803 8704 controller.go:86] Starting OpenAPI controller
Apr 27 22:02:58 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:58.456918 8704 naming_controller.go:291] Starting NamingConditionController
Apr 27 22:02:58 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:58.456984 8704 establishing_controller.go:76] Starting EstablishingController
Apr 27 22:02:58 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:58.457053 8704 nonstructuralschema_controller.go:192] Starting NonStructuralSchemaConditionController
Apr 27 22:02:58 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:58.457108 8704 apiapproval_controller.go:186] Starting KubernetesAPIApprovalPolicyConformantConditionController
Apr 27 22:02:58 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:58.457154 8704 crd_finalizer.go:266] Starting CRDFinalizer
Apr 27 22:02:58 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:58.470695 8704 apiservice_controller.go:97] Starting APIServiceRegistrationController
Apr 27 22:02:58 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:58.470760 8704 cache.go:32] Waiting for caches to sync for APIServiceRegistrationController controller
Apr 27 22:02:58 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:58.470848 8704 crdregistration_controller.go:111] Starting crd-autoregister controller
Apr 27 22:02:58 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:58.470880 8704 shared_informer.go:240] Waiting for caches to sync for crd-autoregister
Apr 27 22:02:58 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: E0427 22:02:58.523697 8704 controller.go:152] Unable to remove old endpoints from kubernetes service: StorageError: key not found, Code: 1, Key: /registry/masterleases/10.0.10.11, ResourceVersion: 0, AdditionalErrorMsg:
Apr 27 22:02:58 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:58.670865 8704 cache.go:39] Caches are synced for APIServiceRegistrationController controller
Apr 27 22:02:58 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:58.741250 8704 shared_informer.go:247] Caches are synced for cluster_authentication_trust_controller
Apr 27 22:02:58 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:58.745986 8704 cache.go:39] Caches are synced for AvailableConditionController controller
Apr 27 22:02:58 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:58.747450 8704 apf_controller.go:299] Running API Priority and Fairness config worker
Apr 27 22:02:58 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:58.750369 8704 cache.go:39] Caches are synced for autoregister controller
Apr 27 22:02:58 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:58.771335 8704 shared_informer.go:247] Caches are synced for crd-autoregister
Apr 27 22:02:59 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:59.437197 8704 controller.go:132] OpenAPI AggregationController: action for item : Nothing (removed from the queue).
Apr 27 22:02:59 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:59.437297 8704 controller.go:132] OpenAPI AggregationController: action for item k8s_internal_local_delegation_chain_0000000000: Nothing (removed from the queue).
Apr 27 22:02:59 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:59.466767 8704 storage_scheduling.go:148] all system priority classes are created successfully or already exist.
Apr 27 22:02:59 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:59.623717 8704 daemon.go:55] Starting Kubelet
Apr 27 22:02:59 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: Flag --client-ca-file has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Apr 27 22:02:59 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: Flag --anonymous-auth has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Apr 27 22:02:59 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: Flag --network-plugin has been deprecated, will be removed along with dockershim.
Apr 27 22:02:59 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: Flag --fail-swap-on has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Apr 27 22:02:59 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: Flag --cni-conf-dir has been deprecated, will be removed along with dockershim.
Apr 27 22:02:59 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: Flag --cni-bin-dir has been deprecated, will be removed along with dockershim.
Apr 27 22:02:59 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: Flag --feature-gates has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Apr 27 22:02:59 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: Flag --eviction-hard has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Apr 27 22:02:59 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: Flag --containerd has been deprecated, This is a cadvisor flag that was mistakenly registered with the Kubelet. Due to legacy concerns, it will follow the standard CLI deprecation timeline before being removed.
Apr 27 22:02:59 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: Flag --authentication-token-webhook has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Apr 27 22:02:59 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: Flag --cluster-domain has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Apr 27 22:02:59 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: Flag --cluster-dns has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Apr 27 22:02:59 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:59.641819 8704 daemon.go:22] Starting Controller Manager
Apr 27 22:02:59 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: Flag --address has been deprecated, see --bind-address instead.
Apr 27 22:02:59 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:59.664095 8704 daemon.go:33] Starting Scheduler
Apr 27 22:02:59 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:59.685126 8704 server.go:445] "Kubelet version" kubeletVersion="v1.21.0-3+baf04bca88ce98"
Apr 27 22:02:59 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:59.685241 8704 daemon.go:44] Starting Proxy
Apr 27 22:02:59 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: W0427 22:02:59.685418 8704 server.go:220] WARNING: all flags other than --config, --write-config-to, and --cleanup are deprecated. Please begin using a config file ASAP.
Apr 27 22:02:59 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:59.723543 8704 dynamic_cafile_content.go:167] Starting client-ca-bundle::/var/snap/microk8s/2129/certs/ca.crt
Apr 27 22:02:59 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: W0427 22:02:59.833846 8704 lease.go:233] Resetting endpoints for master service "kubernetes" to [10.0.10.12 10.0.10.14 10.0.10.13 10.0.10.11]
Apr 27 22:02:59 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:59.839085 8704 node.go:172] Successfully retrieved node IP: 10.0.10.11
Apr 27 22:02:59 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:59.839730 8704 server_others.go:140] Detected node IP 10.0.10.11
Apr 27 22:02:59 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: W0427 22:02:59.840252 8704 server_others.go:592] Unknown proxy mode "", assuming iptables proxy
Apr 27 22:02:59 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:59.854706 8704 controller.go:611] quota admission added evaluator for: endpoints
Apr 27 22:02:59 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:59.884357 8704 server_others.go:206] kube-proxy running in dual-stack mode, IPv4-primary
Apr 27 22:02:59 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:59.885228 8704 server_others.go:212] Using iptables Proxier.
Apr 27 22:02:59 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:59.885893 8704 server_others.go:219] creating dualStackProxier for iptables.
Apr 27 22:02:59 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: W0427 22:02:59.886586 8704 server_others.go:506] detect-local-mode set to ClusterCIDR, but no IPv6 cluster CIDR defined, , defaulting to no-op detect-local for IPv6
Apr 27 22:02:59 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:59.889431 8704 server.go:643] Version: v1.21.0-3+baf04bca88ce98
Apr 27 22:02:59 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: W0427 22:02:59.897389 8704 sysinfo.go:203] Nodes topology is not available, providing CPU topology
Apr 27 22:02:59 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:59.911888 8704 conntrack.go:52] Setting nf_conntrack_max to 131072
Apr 27 22:02:59 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:59.935390 8704 config.go:315] Starting service config controller
Apr 27 22:02:59 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:59.935451 8704 shared_informer.go:240] Waiting for caches to sync for service config
Apr 27 22:02:59 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:59.935552 8704 config.go:224] Starting endpoint slice config controller
Apr 27 22:02:59 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:02:59.935581 8704 shared_informer.go:240] Waiting for caches to sync for endpoint slice config
Apr 27 22:03:00 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:03:00.150228 8704 controller.go:611] quota admission added evaluator for: endpointslices.discovery.k8s.io
Apr 27 22:03:00 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:03:00.160404 8704 shared_informer.go:247] Caches are synced for service config
Apr 27 22:03:00 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:03:00.160584 8704 shared_informer.go:247] Caches are synced for endpoint slice config
Apr 27 22:03:01 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:03:01.170016 8704 serving.go:347] Generated self-signed cert in-memory
Apr 27 22:03:02 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:03:02.938771 8704 serving.go:347] Generated self-signed cert in-memory
Apr 27 22:03:03 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: W0427 22:03:03.668711 8704 authentication.go:307] No authentication-kubeconfig provided in order to lookup client-ca-file in configmap/extension-apiserver-authentication in kube-system, so client certificate authentication won't work.
Apr 27 22:03:03 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: W0427 22:03:03.668794 8704 authentication.go:331] No authentication-kubeconfig provided in order to lookup requestheader-client-ca-file in configmap/extension-apiserver-authentication in kube-system, so request-header client certificate authentication won't work.
Apr 27 22:03:03 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: W0427 22:03:03.668835 8704 authorization.go:184] No authorization-kubeconfig provided, so SubjectAccessReview of authorization tokens won't work.
Apr 27 22:03:03 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:03:03.668888 8704 controllermanager.go:175] Version: v1.21.0-3+baf04bca88ce98
Apr 27 22:03:03 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:03:03.671809 8704 secure_serving.go:197] Serving securely on [::]:10257
Apr 27 22:03:03 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:03:03.672705 8704 tlsconfig.go:240] Starting DynamicServingCertificateController
Apr 27 22:03:03 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:03:03.673586 8704 deprecated_insecure_serving.go:53] Serving insecurely on 127.0.0.1:10252
Apr 27 22:03:03 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:03:03.674552 8704 leaderelection.go:243] attempting to acquire leader lease kube-system/kube-controller-manager...
Apr 27 22:03:03 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: W0427 22:03:03.989260 8704 authentication.go:307] No authentication-kubeconfig provided in order to lookup client-ca-file in configmap/extension-apiserver-authentication in kube-system, so client certificate authentication won't work.
Apr 27 22:03:03 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: W0427 22:03:03.989335 8704 authentication.go:331] No authentication-kubeconfig provided in order to lookup requestheader-client-ca-file in configmap/extension-apiserver-authentication in kube-system, so request-header client certificate authentication won't work.
Apr 27 22:03:03 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: W0427 22:03:03.989380 8704 authorization.go:184] No authorization-kubeconfig provided, so SubjectAccessReview of authorization tokens won't work.
Apr 27 22:03:04 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: W0427 22:03:04.036737 8704 authorization.go:47] Authorization is disabled
Apr 27 22:03:04 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: W0427 22:03:04.036849 8704 authentication.go:47] Authentication is disabled
Apr 27 22:03:04 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:03:04.036892 8704 deprecated_insecure_serving.go:51] Serving healthz insecurely on 127.0.0.1:10251
Apr 27 22:03:04 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:03:04.041101 8704 secure_serving.go:197] Serving securely on [::]:10259
Apr 27 22:03:04 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:03:04.042154 8704 tlsconfig.go:240] Starting DynamicServingCertificateController
Apr 27 22:03:04 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:03:04.142221 8704 leaderelection.go:243] attempting to acquire leader lease kube-system/kube-scheduler...
Apr 27 22:03:04 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: W0427 22:03:04.757818 8704 sysinfo.go:203] Nodes topology is not available, providing CPU topology
Apr 27 22:03:04 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:03:04.765578 8704 server.go:665] "--cgroups-per-qos enabled, but --cgroup-root was not specified. defaulting to /"
Apr 27 22:03:04 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:03:04.766464 8704 container_manager_linux.go:278] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Apr 27 22:03:04 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:03:04.766698 8704 container_manager_linux.go:283] "Creating Container Manager object based on Node Config" nodeConfig={RuntimeCgroupsName: SystemCgroupsName: KubeletCgroupsName: ContainerRuntime:remote CgroupsPerQOS:true CgroupRoot:/ CgroupDriver:cgroupfs KubeletRootDir:/var/snap/microk8s/common/var/lib/kubelet ProtectKernelDefaults:false NodeAllocatableConfig:{KubeReservedCgroupName: SystemReservedCgroupName: ReservedSystemCPUs: EnforceNodeAllocatable:map[pods:{}] KubeReserved:map[] SystemReserved:map[] HardEvictionThresholds:[{Signal:memory.available Operator:LessThan Value:{Quantity:100Mi Percentage:0} GracePeriod:0s MinReclaim:} {Signal:nodefs.available Operator:LessThan Value:{Quantity:1Gi Percentage:0} GracePeriod:0s MinReclaim:} {Signal:imagefs.available Operator:LessThan Value:{Quantity:1Gi Percentage:0} GracePeriod:0s MinReclaim:}]} QOSReserved:map[] ExperimentalCPUManagerPolicy:none ExperimentalTopologyManagerScope:container ExperimentalCPUManagerReconcilePeriod:10s ExperimentalMemoryManagerPolicy:None ExperimentalMemoryManagerReservedMemory:[] ExperimentalPodPidsLimit:-1 EnforceCPULimits:true CPUCFSQuotaPeriod:100ms ExperimentalTopologyManagerPolicy:none}
Apr 27 22:03:04 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:03:04.766787 8704 topology_manager.go:120] "Creating topology manager with policy per scope" topologyPolicyName="none" topologyScopeName="container"
Apr 27 22:03:04 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:03:04.766841 8704 container_manager_linux.go:314] "Initializing Topology Manager" policy="none" scope="container"
Apr 27 22:03:04 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:03:04.766878 8704 container_manager_linux.go:319] "Creating device plugin manager" devicePluginEnabled=true
Apr 27 22:03:04 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:03:04.767171 8704 util_unix.go:103] "Using this format as endpoint is deprecated, please consider using full url format." deprecatedFormat="/var/snap/microk8s/common/run/containerd.sock" fullURLFormat="unix:///var/snap/microk8s/common/run/containerd.sock"
Apr 27 22:03:04 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:03:04.767263 8704 remote_runtime.go:62] parsed scheme: ""
Apr 27 22:03:04 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:03:04.767297 8704 remote_runtime.go:62] scheme "" not registered, fallback to default scheme
Apr 27 22:03:04 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:03:04.767352 8704 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{/var/snap/microk8s/common/run/containerd.sock 0 }] }
Apr 27 22:03:04 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:03:04.767388 8704 clientconn.go:948] ClientConn switching balancer to "pick_first"
Apr 27 22:03:04 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:03:04.767531 8704 util_unix.go:103] "Using this format as endpoint is deprecated, please consider using full url format." deprecatedFormat="/var/snap/microk8s/common/run/containerd.sock" fullURLFormat="unix:///var/snap/microk8s/common/run/containerd.sock"
Apr 27 22:03:04 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:03:04.767587 8704 remote_image.go:50] parsed scheme: ""
Apr 27 22:03:04 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:03:04.767618 8704 remote_image.go:50] scheme "" not registered, fallback to default scheme
Apr 27 22:03:04 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:03:04.767659 8704 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{/var/snap/microk8s/common/run/containerd.sock 0 }] }
Apr 27 22:03:04 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:03:04.767688 8704 clientconn.go:948] ClientConn switching balancer to "pick_first"
Apr 27 22:03:04 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:03:04.767820 8704 kubelet.go:286] "Watching apiserver"
Apr 27 22:03:04 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: W0427 22:03:04.767926 8704 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {/var/snap/microk8s/common/run/containerd.sock 0 }. Err :connection error: desc = "transport: Error while dialing dial unix /var/snap/microk8s/common/run/containerd.sock: connect: no such file or directory". Reconnecting...
Apr 27 22:03:04 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: I0427 22:03:04.768030 8704 kubelet.go:465] "Kubelet client is not nil"
Apr 27 22:03:04 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: W0427 22:03:04.768209 8704 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {/var/snap/microk8s/common/run/containerd.sock 0 }. Err :connection error: desc = "transport: Error while dialing dial unix /var/snap/microk8s/common/run/containerd.sock: connect: no such file or directory". Reconnecting...
Apr 27 22:03:04 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: E0427 22:03:04.768780 8704 remote_runtime.go:86] "Version from runtime service failed" err="rpc error: code = Unavailable desc = connection error: desc = "transport: Error while dialing dial unix /var/snap/microk8s/common/run/containerd.sock: connect: no such file or directory""
Apr 27 22:03:04 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: E0427 22:03:04.768932 8704 kuberuntime_manager.go:208] "Get runtime version failed" err="get remote runtime typed version failed: rpc error: code = Unavailable desc = connection error: desc = "transport: Error while dialing dial unix /var/snap/microk8s/common/run/containerd.sock: connect: no such file or directory""
Apr 27 22:03:04 kube1.OMIT.lan microk8s.daemon-kubelite[8704]: E0427 22:03:04.769005 8704 server.go:297] "Failed to run kubelet" err="failed to run Kubelet: failed to create kubelet: get remote runtime typed version failed: rpc error: code = Unavailable desc = connection error: desc = "transport: Error while dialing dial unix /var/snap/microk8s/common/run/containerd.sock: connect: no such file or directory""
Apr 27 22:03:04 kube1.OMIT.lan systemd[1]: snap.microk8s.daemon-kubelite.service: Main process exited, code=exited, status=1/FAILURE
Apr 27 22:03:04 kube1.OMIT.lan systemd[1]: snap.microk8s.daemon-kubelite.service: Failed with result 'exit-code'.
Apr 27 22:03:05 kube1.OMIT.lan systemd[1]: snap.microk8s.daemon-kubelite.service: Scheduled restart job, restart counter is at 10.
Apr 27 22:03:05 kube1.OMIT.lan systemd[1]: Stopped Service for snap application microk8s.daemon-kubelite.
Apr 27 22:03:05 kube1.OMIT.lan systemd[1]: Started Service for snap application microk8s.daemon-kubelite.
Apr 27 22:03:05 kube1.OMIT.lan microk8s.daemon-kubelite[9410]: + export PATH=/snap/microk8s/2129/usr/sbin:/snap/microk8s/2129/usr/bin:/snap/microk8s/2129/sbin:/snap/microk8s/2129/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin
Apr 27 22:03:05 kube1.OMIT.lan microk8s.daemon-kubelite[9410]: + PATH=/snap/microk8s/2129/usr/sbin:/snap/microk8s/2129/usr/bin:/snap/microk8s/2129/sbin:/snap/microk8s/2129/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin
Apr 27 22:03:05 kube1.OMIT.lan microk8s.daemon-kubelite[9426]: ++ /snap/microk8s/2129/bin/uname -m
Apr 27 22:03:05 kube1.OMIT.lan microk8s.daemon-kubelite[9410]: + ARCH=aarch64
..................

snap.microk8s.daemon-containerd.service show the below:

Apr 27 22:08:58 kube1.OMIT.lan microk8s.daemon-containerd[1803]: time="2021-04-27T22:08:58.430024428+09:00" level=info msg="cleaning up dead shim"
Apr 27 22:08:58 kube1.OMIT.lan microk8s.daemon-containerd[1803]: time="2021-04-27T22:08:58.478478899+09:00" level=warning msg="cleanup warnings time="2021-04-27T22:08:58+09:00" level=info msg="starting signal loop" namespace=k8s.io pid=15198\n"
Apr 27 22:10:38 kube1.OMIT.lan microk8s.daemon-containerd[1803]: time="2021-04-27T22:10:38.484988978+09:00" level=warning msg="cleaning up after shim disconnected" id=3f9f2b45234c29ee1e3c2dae82a492b4b80e3583fa26ac2d73c2b11a7cdb9853 namespace=k8s.io
Apr 27 22:10:38 kube1.OMIT.lan microk8s.daemon-containerd[1803]: time="2021-04-27T22:10:38.485156309+09:00" level=info msg="cleaning up dead shim"
Apr 27 22:10:38 kube1.OMIT.lan microk8s.daemon-containerd[1803]: time="2021-04-27T22:10:38.551355101+09:00" level=warning msg="cleanup warnings time="2021-04-27T22:10:38+09:00" level=info msg="starting signal loop" namespace=k8s.io pid=17353\n"
Apr 27 22:12:18 kube1.OMIT.lan microk8s.daemon-containerd[1803]: time="2021-04-27T22:12:18.569924128+09:00" level=warning msg="cleaning up after shim disconnected" id=48e2344fe4e8709c706b52e34b72942d5cdc73602acdcca9b4d04f5b02bb032a namespace=k8s.io
Apr 27 22:12:18 kube1.OMIT.lan microk8s.daemon-containerd[1803]: time="2021-04-27T22:12:18.570087261+09:00" level=info msg="cleaning up dead shim"
Apr 27 22:12:18 kube1.OMIT.lan microk8s.daemon-containerd[1803]: time="2021-04-27T22:12:18.625080297+09:00" level=warning msg="cleanup warnings time="2021-04-27T22:12:18+09:00" level=info msg="starting signal loop" namespace=k8s.io pid=19413\n"
Apr 27 22:13:58 kube1.OMIT.lan microk8s.daemon-containerd[1803]: time="2021-04-27T22:13:58.630439458+09:00" level=warning msg="cleaning up after shim disconnected" id=5b211010fc6721130195e5d0f796615089663e10ea64d12c059635ca8d8aaf28 namespace=k8s.io
Apr 27 22:13:58 kube1.OMIT.lan microk8s.daemon-containerd[1803]: time="2021-04-27T22:13:58.630611089+09:00" level=info msg="cleaning up dead shim"
Apr 27 22:13:58 kube1.OMIT.lan microk8s.daemon-containerd[1803]: time="2021-04-27T22:13:58.677000178+09:00" level=warning msg="cleanup warnings time="2021-04-27T22:13:58+09:00" level=info msg="starting signal loop" namespace=k8s.io pid=21040\n"
Apr 27 22:15:38 kube1.OMIT.lan microk8s.daemon-containerd[1803]: time="2021-04-27T22:15:38.686826461+09:00" level=warning msg="cleaning up after shim disconnected" id=63f62154d8c4386e2bde29502abf2d20ffa3a332acd85c75c02245caa0eae424 namespace=k8s.io
Apr 27 22:15:38 kube1.OMIT.lan microk8s.daemon-containerd[1803]: time="2021-04-27T22:15:38.686946406+09:00" level=info msg="cleaning up dead shim"
Apr 27 22:15:38 kube1.OMIT.lan microk8s.daemon-containerd[1803]: time="2021-04-27T22:15:38.730859855+09:00" level=warning msg="cleanup warnings time="2021-04-27T22:15:38+09:00" level=info msg="starting signal loop" namespace=k8s.io pid=22677\n"
Apr 27 22:17:18 kube1.OMIT.lan microk8s.daemon-containerd[1803]: time="2021-04-27T22:17:18.736763501+09:00" level=warning msg="cleaning up after shim disconnected" id=6aae9fe91647b310a5c16c8c4bd5c12e64a7d9bb467185c31894e728864cf67a namespace=k8s.io
Apr 27 22:17:18 kube1.OMIT.lan microk8s.daemon-containerd[1803]: time="2021-04-27T22:17:18.736922742+09:00" level=info msg="cleaning up dead shim"
Apr 27 22:17:18 kube1.OMIT.lan microk8s.daemon-containerd[1803]: time="2021-04-27T22:17:18.803882259+09:00" level=warning msg="cleanup warnings time="2021-04-27T22:17:18+09:00" level=info msg="starting signal loop" namespace=k8s.io pid=24368\n"
..........................

[kevin-leong]

inspection-report-20210427_221057.tar.gz

[balchua]

@kevin-leong thank you for reporting. This was also reported here #2204.
The fix is on the way. But if it can't wait, you can follow some instructions here.
#2204 (comment)

[kevin-leong]

Thanks, I took a look at #2204. I will similar test the fix once it gets to edge.

The other thing that comes to mind is that Raspberry Pi do not have a (hardware) RTC, so on boot up the Raspberry Pi may have a really out-of-sync time (in the past) and so ntp/chrony/systemd-timesyncd needs to sync the time on the host. So if the time was not sync yet before snap.microk8s.* services starts, then relying on (calculating) time could possibly cause issues...

Just to note...

On my Raspberry Pi:

kube1 # date -r /proc/1
Thu Jan 1 09:00:01 AM JST 1970

On my VM (that on my desktop):

kube4 # date -r /proc/1
Tue Apr 27 03:25:44 PM JST 2021

[horvatic]

@kevin-leong just to confirm your notes I also ran date -r /proc/1

My results match yours

horvatic@oak:~$ date -r /proc/1
Thu Jan  1 00:00:01 UTC 1970

[ktsakalozos]

Could you try the 1.21/edge channel?

sudo snap install microk8s --classic --channel=1.21/edge

or in an existing deployment

sudo snap refresh microk8s --channel=1.21/edge

[kevin-leong]

@ktsakalozos

I updated to the below on one of my nodes, and it looks like it fixed after testing a reboot.

latest/edge: v1.21.0 2021-04-28 (2176) 168MB classic

When will this fix hit the latest/stable branch? This is a critical bug I think.

[ktsakalozos]

When will this fix hit the latest/stable branch? This is a critical bug I think.

@kevin-leong, we are working on releasing this fix to stable right now.

[kevin-leong]

@ktsakalozos - thanks it looks like it hit latest/stable. I refresh to this version, and rebooted my nodes and they came up fine now. Thanks, closing this.