Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

failed minikube start #7058

Closed
medaoutir opened this issue Mar 15, 2020 · 8 comments
Closed

failed minikube start #7058

medaoutir opened this issue Mar 15, 2020 · 8 comments
Labels
kind/support Categorizes issue or PR as a support question. priority/awaiting-more-evidence Lowest priority. Possibly useful, but not yet enough support to actually get it done.

Comments

@medaoutir
Copy link

Hi everyone,

I'm beginner in Kubernetes; I have got an error when I run minikube start in ubuntu with virtualbox as hypervisor for minikube vm. I have read the result log as below without understanding the issue:

😄 minikube v1.8.2 on Ubuntu 18.04
✨ Automatically selected the virtualbox driver
🔥 Creating virtualbox VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
🐳 Preparing Kubernetes v1.17.3 on Docker 19.03.6 ...
🚀 Launching Kubernetes ...

💣 Error starting cluster: init failed. output: "-- stdout --\n[init] Using Kubernetes version: v1.17.3\n[preflight] Running pre-flight checks\n[preflight] Pulling images required for setting up a Kubernetes cluster\n[preflight] This might take a minute or two, depending on the speed of your internet connection\n[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'\n[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"\n[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"\n[kubelet-start] Starting the kubelet\n[certs] Using certificateDir folder "/var/lib/minikube/certs"\n[certs] Using existing ca certificate authority\n[certs] Using existing apiserver certificate and key on disk\n[certs] Generating "apiserver-kubelet-client" certificate and key\n[certs] Generating "front-proxy-ca" certificate and key\n[certs] Generating "front-proxy-client" certificate and key\n[certs] Generating "etcd/ca" certificate and key\n[certs] Generating "etcd/server" certificate and key\n[certs] etcd/server serving cert is signed for DNS names [m01 localhost] and IPs [192.168.99.101 127.0.0.1 ::1]\n[certs] Generating "etcd/peer" certificate and key\n[certs] etcd/peer serving cert is signed for DNS names [m01 localhost] and IPs [192.168.99.101 127.0.0.1 ::1]\n\n-- /stdout --\n** stderr ** \nW0315 17:26:22.130201 2875 validation.go:28] Cannot validate kube-proxy config - no validator is available\nW0315 17:26:22.132190 2875 validation.go:28] Cannot validate kubelet config - no validator is available\n\t[WARNING Hostname]: hostname "m01" could not be reached\n\t[WARNING Hostname]: hostname "m01": lookup m01 on 10.0.2.3:53: no such host\n\t[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'\nerror execution phase certs/etcd-healthcheck-client: couldn't load CA certificate etcd-ca: failure loading etcd/ca certificate authority: failed to load certificate: the certificate is not valid yet\nTo see the stack trace of this error execute with --v=5 or higher\n\n** /stderr **": /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.17.3:$PATH kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,SystemVerification": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.17.3
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [m01 localhost] and IPs [192.168.99.101 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [m01 localhost] and IPs [192.168.99.101 127.0.0.1 ::1]

stderr:
W0315 17:26:22.130201 2875 validation.go:28] Cannot validate kube-proxy config - no validator is available
W0315 17:26:22.132190 2875 validation.go:28] Cannot validate kubelet config - no validator is available
[WARNING Hostname]: hostname "m01" could not be reached
[WARNING Hostname]: hostname "m01": lookup m01 on 10.0.2.3:53: no such host
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase certs/etcd-healthcheck-client: couldn't load CA certificate etcd-ca: failure loading etcd/ca certificate authority: failed to load certificate: the certificate is not valid yet
To see the stack trace of this error execute with --v=5 or higher

😿 minikube is exiting due to an error. If the above message is not useful, open an issue:
👉 https://github.com/kubernetes/minikube/issues/new/choose

Thanks in advance for your help.

@sharifelgamal
Copy link
Collaborator

Could you provide:

  • The full output of the minikube start command with --alsologtostderr -v=3 for extra logging.
  • The full output of minikube logs

That'll give us extra information to help debug your issue.
Thank you for sharing your experience!

@sharifelgamal sharifelgamal added kind/support Categorizes issue or PR as a support question. priority/awaiting-more-evidence Lowest priority. Possibly useful, but not yet enough support to actually get it done. labels Mar 18, 2020
@tstromberg
Copy link
Contributor

I'm closing this issue as it hasn't seen activity in awhile, and it's unclear if this issue still exists. If this issue does continue to exist in the most recent release of minikube, please feel free to re-open it by replying /reopen

If someone sees a similar issue to this one, please re-open it as replies to closed issues are unlikely to be noticed.

Thank you for opening the issue!

@liranmauda
Copy link

/reopen
Happends to me and it is repreducible.

sudo minikube start --kubernetes-version=v1.17.3 --extra-config=apiserver.authorization-mode=RBAC --alsologtostderr -v=3

I0506 09:49:32.938190    5215 start.go:252] hostinfo: {"hostname":"travis-job-290a7968-4b05-42fd-a9d1-45e4c80e982e","uptime":61,"bootTime":1588758511,"procs":165,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"16.04","kernelVersion":"4.15.0-1028-gcp","virtualizationSystem":"","virtualizationRole":"","hostid":"9b137f3d-6c59-2cfe-3e7d-5f1fcc442a45"}

I0506 09:49:32.938772    5215 start.go:262] virtualization:  

* minikube v1.8.2 on Ubuntu 16.04

  - KUBECONFIG=/home/travis/.kube/config

  - MINIKUBE_WANTREPORTERRORPROMPT=false

  - MINIKUBE_VERSION=v1.8.2

  - MINIKUBE_WANTUPDATENOTIFICATION=false

  - MINIKUBE_HOME=/home/travis

I0506 09:49:32.938986    5215 driver.go:226] Setting default libvirt URI to qemu:///system

* Using the none driver based on user configuration

I0506 09:49:32.939615    5215 start.go:299] selected driver: none

I0506 09:49:32.939628    5215 start.go:488] validating driver "none" against <nil>

I0506 09:49:32.939655    5215 start.go:494] status for none: {Installed:true Healthy:true Error:<nil> Fix: Doc:}

I0506 09:49:32.939804    5215 start.go:863] Using suggested 2200MB memory alloc based on sys=7976MB, container=0MB

I0506 09:49:32.940489    5215 profile.go:121] Saving config to /home/travis/.minikube/profiles/minikube/config.json ...

I0506 09:49:32.940577    5215 lock.go:35] WriteFile acquiring /home/travis/.minikube/profiles/minikube/config.json: {Name:mk3ff515ea0b8f2f4b93ee0ee9c0604afd1294cb Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

I0506 09:49:32.941037    5215 cache.go:109] Successfully downloaded all kic artifacts

I0506 09:49:32.941077    5215 start.go:245] acquiring machines lock for minikube: {Name:mk2cd192460d97102eb871201db192ca0179242e Clock:{} Delay:500ms Timeout:15m0s Cancel:<nil>}

I0506 09:49:32.941152    5215 start.go:249] acquired machines lock for "minikube" in 54.892µs

I0506 09:49:32.941176    5215 start.go:82] Provisioning new machine with config: {Name:minikube KeepContext:false EmbedCerts:false MinikubeISO: Memory:2200 CPUs:2 DiskSize:20000 Driver:none HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio KubernetesConfig:{KubernetesVersion:v1.17.3 ClusterName:minikube APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: ExtraOptions:[{Component:apiserver Key:authorization-mode Value:RBAC}] ShouldLoadCachedImages:false EnableDefaultCNI:false NodeIP: NodePort:0 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.17.3 ControlPlane:true Worker:true}] Addons:map[]}

I0506 09:49:32.941231    5215 start.go:101] createHost starting for "minikube" (driver="none")

* Running on localhost (CPUs=2, Memory=7976MB, Disk=69422MB) ...

I0506 09:49:32.941958    5215 start.go:137] libmachine.API.Create for "minikube" (driver="none")

I0506 09:49:32.942030    5215 main.go:110] libmachine: Creating CA: /home/travis/.minikube/certs/ca.pem

I0506 09:49:33.046047    5215 main.go:110] libmachine: Creating client certificate: /home/travis/.minikube/certs/cert.pem

I0506 09:49:33.435864    5215 start.go:142] libmachine.API.Create for "minikube" took 493.902042ms

I0506 09:49:33.435995    5215 start.go:183] post-start starting for "minikube" (driver="none")

I0506 09:49:33.436010    5215 start.go:193] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

I0506 09:49:33.436109    5215 start.go:216] determining appropriate runner for "none"

I0506 09:49:33.436123    5215 start.go:223] returning ExecRunner for "none" driver

I0506 09:49:33.442037    5215 main.go:110] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found

I0506 09:49:33.442067    5215 main.go:110] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found

* OS release is Ubuntu 16.04.6 LTS

I0506 09:49:33.442132    5215 filesync.go:118] Scanning /home/travis/.minikube/addons for local assets ...

I0506 09:49:33.442172    5215 filesync.go:118] Scanning /home/travis/.minikube/files for local assets ...

I0506 09:49:33.442209    5215 start.go:186] post-start completed in 6.195919ms

I0506 09:49:33.442422    5215 start.go:104] createHost completed in 501.178612ms

I0506 09:49:33.442437    5215 start.go:73] releasing machines lock for "minikube", held for 501.270227ms

I0506 09:49:33.582625    5215 profile.go:121] Saving config to /home/travis/.minikube/profiles/minikube/config.json ...

* Preparing Kubernetes v1.17.3 on Docker 18.06.0-ce ...

I0506 09:49:33.763080    5215 settings.go:123] acquiring lock: {Name:mk57cf054ea70ef81fcf0ea674b256884403c561 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

I0506 09:49:33.763209    5215 settings.go:131] Updating kubeconfig:  /home/travis/.kube/config

I0506 09:49:33.764313    5215 lock.go:35] WriteFile acquiring /home/travis/.kube/config: {Name:mk99447089f6ee8f5118fff3e024a25fc382dcfd Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

  - apiserver.authorization-mode=RBAC

I0506 09:49:33.764948    5215 kubeadm.go:126] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet: AdvertiseAddress:10.30.1.164 APIServerPort:8443 KubernetesVersion:v1.17.3 EtcdDataDir:/var/lib/minikube/etcd ClusterName:minikube NodeName: DNSDomain:cluster.local CRISocket: ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[authorization-mode:RBAC enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "10.30.1.164"]]}] FeatureArgs:map[] NoTaintMaster:true NodeIP:10.30.1.164 ControlPlaneAddress:localhost}

I0506 09:49:33.765071    5215 kubeadm.go:130] kubeadm config:

apiVersion: kubeadm.k8s.io/v1beta2

kind: InitConfiguration

localAPIEndpoint:

  advertiseAddress: 10.30.1.164

  bindPort: 8443

bootstrapTokens:

  - groups:

      - system:bootstrappers:kubeadm:default-node-token

    ttl: 24h0m0s

    usages:

      - signing

      - authentication

nodeRegistration:

  criSocket: /var/run/dockershim.sock

  name: ""

  kubeletExtraArgs:

    node-ip: 10.30.1.164

  taints: []

---

apiVersion: kubeadm.k8s.io/v1beta2

kind: ClusterConfiguration

apiServer:

  certSANs: ["127.0.0.1", "localhost", "10.30.1.164"]

  extraArgs:

    authorization-mode: "RBAC"

    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"

certificatesDir: /var/lib/minikube/certs

clusterName: kubernetes

controlPlaneEndpoint: localhost:8443

controllerManager: {}

dns:

  type: CoreDNS

etcd:

  local:

    dataDir: /var/lib/minikube/etcd

kubernetesVersion: v1.17.3

networking:

  dnsDomain: cluster.local

  podSubnet: ""

  serviceSubnet: 10.96.0.0/12

I0506 09:49:33.830070    5215 kubeadm.go:427] kubelet [Unit]

Wants=docker.socket

[Service]

ExecStart=

ExecStart=/var/lib/minikube/binaries/v1.17.3/kubelet --authorization-mode=Webhook --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --cgroup-driver=cgroupfs --client-ca-file=/var/lib/minikube/certs/ca.crt --cluster-domain=cluster.local --config=/var/lib/kubelet/config.yaml --container-runtime=docker --fail-swap-on=false --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=10.30.1.164 --pod-manifest-path=/etc/kubernetes/manifests

[Install]

 config:

{KubernetesVersion:v1.17.3 ClusterName:minikube APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: ExtraOptions:[{Component:apiserver Key:authorization-mode Value:RBAC}] ShouldLoadCachedImages:false EnableDefaultCNI:false NodeIP: NodePort:0 NodeName:}

W0506 09:49:33.835341    5215 kubeadm.go:431] unable to stop kubelet: command: "/bin/bash -c \"pgrep kubelet && sudo systemctl stop kubelet\"" output: "": /bin/bash -c "pgrep kubelet && sudo systemctl stop kubelet": exit status 1

stdout:

stderr:

I0506 09:49:33.842831    5215 binaries.go:45] Didn't find k8s binaries: sudo ls /var/lib/minikube/binaries/v1.17.3: exit status 2

stdout:

stderr:

ls: cannot access '/var/lib/minikube/binaries/v1.17.3': No such file or directory

Initiating transfer...

I0506 09:49:33.848762    5215 binary.go:74] Downloading: &{Ctx:<nil> Src:https://storage.googleapis.com/kubernetes-release/release/v1.17.3/bin/linux/amd64/kubectl?checksum=file:https://storage.googleapis.com/kubernetes-release/release/v1.17.3/bin/linux/amd64/kubectl.sha256 Dst:/home/travis/.minikube/cache/linux/v1.17.3/kubectl.download Pwd: Mode:2 Detectors:[] Decompressors:map[] Getters:map[] Dir:false ProgressListener:<nil> Options:[0xbdab30]}

I0506 09:49:33.848762    5215 binary.go:74] Downloading: &{Ctx:<nil> Src:https://storage.googleapis.com/kubernetes-release/release/v1.17.3/bin/linux/amd64/kubelet?checksum=file:https://storage.googleapis.com/kubernetes-release/release/v1.17.3/bin/linux/amd64/kubelet.sha256 Dst:/home/travis/.minikube/cache/linux/v1.17.3/kubelet.download Pwd: Mode:2 Detectors:[] Decompressors:map[] Getters:map[] Dir:false ProgressListener:<nil> Options:[0xbdab30]}

I0506 09:49:33.848980    5215 binary.go:74] Downloading: &{Ctx:<nil> Src:https://storage.googleapis.com/kubernetes-release/release/v1.17.3/bin/linux/amd64/kubeadm?checksum=file:https://storage.googleapis.com/kubernetes-release/release/v1.17.3/bin/linux/amd64/kubeadm.sha256 Dst:/home/travis/.minikube/cache/linux/v1.17.3/kubeadm.download Pwd: Mode:2 Detectors:[] Decompressors:map[] Getters:map[] Dir:false ProgressListener:<nil> Options:[0xbdab30]}

    > kubeadm.sha256: 65 B / 65 B [--------------------------] 100.00% ? p/s 0s

    > kubelet.sha256: 65 B / 65 B [--------------------------] 100.00% ? p/s 0s

    > kubectl.sha256: 65 B / 65 B [--------------------------] 100.00% ? p/s 0s

    > kubectl: 41.48 MiB / 41.48 MiB [--------------] 100.00% 386.70 MiB p/s 0s

    > kubeadm: 37.52 MiB / 37.52 MiB [--------------] 100.00% 178.34 MiB p/s 0s

    > kubelet: 106.42 MiB / 106.42 MiB [------------] 100.00% 123.49 MiB p/s 1s

I0506 09:49:35.722442    5215 certs.go:59] Setting up /home/travis/.minikube for IP: 10.30.1.164

I0506 09:49:35.722478    5215 certs.go:68] acquiring lock: {Name:mk4d65cc156b036675d84bd7aaea46077ebaaf43 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

I0506 09:49:36.165970    5215 crypto.go:157] Writing cert to /home/travis/.minikube/ca.crt ...

I0506 09:49:36.166009    5215 lock.go:35] WriteFile acquiring /home/travis/.minikube/ca.crt: {Name:mka43122446f432ef35bc0324b3fb98a93ed82a4 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

I0506 09:49:36.166221    5215 crypto.go:165] Writing key to /home/travis/.minikube/ca.key ...

I0506 09:49:36.166247    5215 lock.go:35] WriteFile acquiring /home/travis/.minikube/ca.key: {Name:mk503d8082ea913249dd604346069c628e843662 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

I0506 09:49:36.347527    5215 crypto.go:157] Writing cert to /home/travis/.minikube/proxy-client-ca.crt ...

I0506 09:49:36.347564    5215 lock.go:35] WriteFile acquiring /home/travis/.minikube/proxy-client-ca.crt: {Name:mka6901b207dbec15592b26cdaba73a12a953534 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

I0506 09:49:36.347754    5215 crypto.go:165] Writing key to /home/travis/.minikube/proxy-client-ca.key ...

I0506 09:49:36.347777    5215 lock.go:35] WriteFile acquiring /home/travis/.minikube/proxy-client-ca.key: {Name:mk7f67f7e4d2aa86a620bf17b50a0dc386119f95 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

I0506 09:49:36.347881    5215 crypto.go:69] Generating cert /home/travis/.minikube/client.crt with IP's: []

I0506 09:49:36.492350    5215 crypto.go:157] Writing cert to /home/travis/.minikube/client.crt ...

I0506 09:49:36.492385    5215 lock.go:35] WriteFile acquiring /home/travis/.minikube/client.crt: {Name:mkc1d148bd8378c23b8cbe73c6bb7bea40f7ba66 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

I0506 09:49:36.492574    5215 crypto.go:165] Writing key to /home/travis/.minikube/client.key ...

I0506 09:49:36.492596    5215 lock.go:35] WriteFile acquiring /home/travis/.minikube/client.key: {Name:mke112921a148b694ecf13709770a3cae96c664a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

I0506 09:49:36.492691    5215 crypto.go:69] Generating cert /home/travis/.minikube/apiserver.crt with IP's: [10.30.1.164 10.96.0.1 127.0.0.1 10.0.0.1]

I0506 09:49:36.673206    5215 crypto.go:157] Writing cert to /home/travis/.minikube/apiserver.crt ...

I0506 09:49:36.673247    5215 lock.go:35] WriteFile acquiring /home/travis/.minikube/apiserver.crt: {Name:mk05629d648db879dbbd257edd7274378be0b706 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

I0506 09:49:36.673445    5215 crypto.go:165] Writing key to /home/travis/.minikube/apiserver.key ...

I0506 09:49:36.673467    5215 lock.go:35] WriteFile acquiring /home/travis/.minikube/apiserver.key: {Name:mk63fcb117f0daa67d5c01ed508f0fa9adbbcabe Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

I0506 09:49:36.673564    5215 crypto.go:69] Generating cert /home/travis/.minikube/proxy-client.crt with IP's: []

I0506 09:49:36.807338    5215 crypto.go:157] Writing cert to /home/travis/.minikube/proxy-client.crt ...

I0506 09:49:36.807381    5215 lock.go:35] WriteFile acquiring /home/travis/.minikube/proxy-client.crt: {Name:mk38134286f86c8c5737b694b7d00521ce10f274 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

I0506 09:49:36.807843    5215 crypto.go:165] Writing key to /home/travis/.minikube/proxy-client.key ...

I0506 09:49:36.807880    5215 lock.go:35] WriteFile acquiring /home/travis/.minikube/proxy-client.key: {Name:mk32fe2f9b4f11fe8b66885eda6a1510289fc6fc Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

* Launching Kubernetes ... 

I0506 09:49:36.836761    5215 kubeadm.go:160] existence check: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd: exit status 2

stdout:

stderr:

ls: cannot access '/var/lib/kubelet/kubeadm-flags.env': No such file or directory

ls: cannot access '/var/lib/kubelet/config.yaml': No such file or directory

ls: cannot access '/var/lib/minikube/etcd': No such file or directory

I0506 09:49:36.836786    5215 kubeadm.go:163] StartCluster: {Name:minikube KeepContext:false EmbedCerts:false MinikubeISO: Memory:2200 CPUs:2 DiskSize:20000 Driver:none HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio KubernetesConfig:{KubernetesVersion:v1.17.3 ClusterName:minikube APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: ExtraOptions:[{Component:apiserver Key:authorization-mode Value:RBAC}] ShouldLoadCachedImages:false EnableDefaultCNI:false NodeIP: NodePort:0 NodeName:} Nodes:[{Name: IP:10.30.1.164 Port:8443 KubernetesVersion:v1.17.3 ControlPlane:true Worker:true}] Addons:map[]}

I0506 09:52:30.120165    5215 exec_runner.go:76] Completed: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.17.3:$PATH kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,SystemVerification": (2m53.283261602s)

I0506 09:52:30.120375    5215 kubeadm.go:165] StartCluster complete in 2m53.283588037s

I0506 09:52:30.175847    5215 logs.go:177] 1 containers: [8bceef1aab66]

I0506 09:52:30.229942    5215 logs.go:177] 0 containers: []

W0506 09:52:30.229977    5215 logs.go:179] No container was found matching "coredns"

I0506 09:52:30.284187    5215 logs.go:177] 1 containers: [ebbf9245b2ce]

I0506 09:52:30.336427    5215 logs.go:177] 0 containers: []

W0506 09:52:30.336527    5215 logs.go:179] No container was found matching "kube-proxy"

I0506 09:52:30.387563    5215 logs.go:177] 0 containers: []

W0506 09:52:30.387587    5215 logs.go:179] No container was found matching "kubernetes-dashboard"

I0506 09:52:30.442623    5215 logs.go:177] 0 containers: []

W0506 09:52:30.442649    5215 logs.go:179] No container was found matching "storage-provisioner"

I0506 09:52:30.497112    5215 logs.go:177] 1 containers: [37608f1a5fee]

I0506 09:52:30.497157    5215 logs.go:91] Gathering logs for kubelet ...

I0506 09:52:30.562569    5215 logs.go:91] Gathering logs for dmesg ...

I0506 09:52:30.572107    5215 logs.go:91] Gathering logs for kube-apiserver [8bceef1aab66] ...

I0506 09:52:30.650112    5215 logs.go:91] Gathering logs for kube-scheduler [ebbf9245b2ce] ...

I0506 09:52:30.713001    5215 logs.go:91] Gathering logs for kube-controller-manager [37608f1a5fee] ...

I0506 09:52:30.777158    5215 logs.go:91] Gathering logs for Docker ...

I0506 09:52:30.798309    5215 logs.go:91] Gathering logs for container status ...

W0506 09:52:30.869700    5215 exit.go:101] Error starting cluster: init failed. output: "-- stdout --\n[init] Using Kubernetes version: v1.17.3\n[preflight] Running pre-flight checks\n[preflight] Pulling images required for setting up a Kubernetes cluster\n[preflight] This might take a minute or two, depending on the speed of your internet connection\n[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'\n[kubelet-start] Writing kubelet environment file with flags to file \"/var/lib/kubelet/kubeadm-flags.env\"\n[kubelet-start] Writing kubelet configuration to file \"/var/lib/kubelet/config.yaml\"\n[kubelet-start] Starting the kubelet\n[certs] Using certificateDir folder \"/var/lib/minikube/certs\"\n[certs] Using existing ca certificate authority\n[certs] Using existing apiserver certificate and key on disk\n[certs] Generating \"apiserver-kubelet-client\" certificate and key\n[certs] Generating \"front-proxy-ca\" certificate and key\n[certs] Generating \"front-proxy-client\" certificate and key\n[certs] Generating \"etcd/ca\" certificate and key\n[certs] Generating \"etcd/server\" certificate and key\n[certs] etcd/server serving cert is signed for DNS names [travis-job-290a7968-4b05-42fd-a9d1-45e4c80e982e localhost] and IPs [10.30.1.164 127.0.0.1 ::1]\n[certs] Generating \"etcd/peer\" certificate and key\n[certs] etcd/peer serving cert is signed for DNS names [travis-job-290a7968-4b05-42fd-a9d1-45e4c80e982e localhost] and IPs [10.30.1.164 127.0.0.1 ::1]\n[certs] Generating \"etcd/healthcheck-client\" certificate and key\n[certs] Generating \"apiserver-etcd-client\" certificate and key\n[certs] Generating \"sa\" key and public key\n[kubeconfig] Using kubeconfig folder \"/etc/kubernetes\"\n[kubeconfig] Writing \"admin.conf\" kubeconfig file\n[kubeconfig] Writing \"kubelet.conf\" kubeconfig file\n[kubeconfig] Writing \"controller-manager.conf\" kubeconfig file\n[kubeconfig] Writing \"scheduler.conf\" kubeconfig file\n[control-plane] Using manifest folder \"/etc/kubernetes/manifests\"\n[control-plane] Creating static Pod manifest for \"kube-apiserver\"\n[control-plane] Creating static Pod manifest for \"kube-controller-manager\"\n[control-plane] Creating static Pod manifest for \"kube-scheduler\"\n[etcd] Creating static Pod manifest for local etcd in \"/etc/kubernetes/manifests\"\n[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory \"/etc/kubernetes/manifests\". This can take up to 4m0s\n[apiclient] All control plane components are healthy after 13.002497 seconds\n[upload-config] Storing the configuration used in ConfigMap \"kubeadm-config\" in the \"kube-system\" Namespace\n[kubelet] Creating a ConfigMap \"kubelet-config-1.17\" in namespace kube-system with the configuration for the kubelets in the cluster\n[kubelet-check] Initial timeout of 40s passed.\n[kubelet-check] It seems like the kubelet isn't running or healthy.\n[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.\n\n-- /stdout --\n** stderr ** \nW0506 09:49:36.877681    5382 validation.go:28] Cannot validate kube-proxy config - no validator is available\nW0506 09:49:36.877703    5382 validation.go:28] Cannot validate kubelet config - no validator is available\n\t[WARNING IsDockerSystemdCheck]: detected \"cgroupfs\" as the Docker cgroup driver. The recommended driver is \"systemd\". Please follow the guide at https://kubernetes.io/docs/setup/cri/\n\t[WARNING FileExisting-ebtables]: ebtables not found in system path\n\t[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'\nW0506 09:50:17.074232    5382 manifests.go:214] the default kube-apiserver authorization-mode is \"Node,RBAC\"; using \"RBAC\"\nW0506 09:50:17.081625    5382 manifests.go:214] the default kube-apiserver authorization-mode is \"Node,RBAC\"; using \"RBAC\"\nW0506 09:50:17.083885    5382 manifests.go:214] the default kube-apiserver authorization-mode is \"Node,RBAC\"; using \"RBAC\"\nerror execution phase upload-config/kubelet: Error writing Crisocket information for the control-plane node: timed out waiting for the condition\nTo see the stack trace of this error execute with --v=5 or higher\n\n** /stderr **": /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.17.3:$PATH kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,SystemVerification": exit status 1

stdout:

[init] Using Kubernetes version: v1.17.3

[preflight] Running pre-flight checks

[preflight] Pulling images required for setting up a Kubernetes cluster

[preflight] This might take a minute or two, depending on the speed of your internet connection

[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'

[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"

[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"

[kubelet-start] Starting the kubelet

[certs] Using certificateDir folder "/var/lib/minikube/certs"

[certs] Using existing ca certificate authority

[certs] Using existing apiserver certificate and key on disk

[certs] Generating "apiserver-kubelet-client" certificate and key

[certs] Generating "front-proxy-ca" certificate and key

[certs] Generating "front-proxy-client" certificate and key

[certs] Generating "etcd/ca" certificate and key

[certs] Generating "etcd/server" certificate and key

[certs] etcd/server serving cert is signed for DNS names [travis-job-290a7968-4b05-42fd-a9d1-45e4c80e982e localhost] and IPs [10.30.1.164 127.0.0.1 ::1]

[certs] Generating "etcd/peer" certificate and key

[certs] etcd/peer serving cert is signed for DNS names [travis-job-290a7968-4b05-42fd-a9d1-45e4c80e982e localhost] and IPs [10.30.1.164 127.0.0.1 ::1]

[certs] Generating "etcd/healthcheck-client" certificate and key

[certs] Generating "apiserver-etcd-client" certificate and key

[certs] Generating "sa" key and public key

[kubeconfig] Using kubeconfig folder "/etc/kubernetes"

[kubeconfig] Writing "admin.conf" kubeconfig file

[kubeconfig] Writing "kubelet.conf" kubeconfig file

[kubeconfig] Writing "controller-manager.conf" kubeconfig file

[kubeconfig] Writing "scheduler.conf" kubeconfig file

[control-plane] Using manifest folder "/etc/kubernetes/manifests"

[control-plane] Creating static Pod manifest for "kube-apiserver"

[control-plane] Creating static Pod manifest for "kube-controller-manager"

[control-plane] Creating static Pod manifest for "kube-scheduler"

[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"

[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s

[apiclient] All control plane components are healthy after 13.002497 seconds

[upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace

[kubelet] Creating a ConfigMap "kubelet-config-1.17" in namespace kube-system with the configuration for the kubelets in the cluster

[kubelet-check] Initial timeout of 40s passed.

[kubelet-check] It seems like the kubelet isn't running or healthy.

[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.

stderr:

W0506 09:49:36.877681    5382 validation.go:28] Cannot validate kube-proxy config - no validator is available

W0506 09:49:36.877703    5382 validation.go:28] Cannot validate kubelet config - no validator is available

	[WARNING IsDockerSystemdCheck]: detected "cgroupfs" as the Docker cgroup driver. The recommended driver is "systemd". Please follow the guide at https://kubernetes.io/docs/setup/cri/

	[WARNING FileExisting-ebtables]: ebtables not found in system path

	[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'

W0506 09:50:17.074232    5382 manifests.go:214] the default kube-apiserver authorization-mode is "Node,RBAC"; using "RBAC"

W0506 09:50:17.081625    5382 manifests.go:214] the default kube-apiserver authorization-mode is "Node,RBAC"; using "RBAC"

W0506 09:50:17.083885    5382 manifests.go:214] the default kube-apiserver authorization-mode is "Node,RBAC"; using "RBAC"

error execution phase upload-config/kubelet: Error writing Crisocket information for the control-plane node: timed out waiting for the condition

To see the stack trace of this error execute with --v=5 or higher

* 

X Error starting cluster: init failed. output: "-- stdout --\n[init] Using Kubernetes version: v1.17.3\n[preflight] Running pre-flight checks\n[preflight] Pulling images required for setting up a Kubernetes cluster\n[preflight] This might take a minute or two, depending on the speed of your internet connection\n[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'\n[kubelet-start] Writing kubelet environment file with flags to file \"/var/lib/kubelet/kubeadm-flags.env\"\n[kubelet-start] Writing kubelet configuration to file \"/var/lib/kubelet/config.yaml\"\n[kubelet-start] Starting the kubelet\n[certs] Using certificateDir folder \"/var/lib/minikube/certs\"\n[certs] Using existing ca certificate authority\n[certs] Using existing apiserver certificate and key on disk\n[certs] Generating \"apiserver-kubelet-client\" certificate and key\n[certs] Generating \"front-proxy-ca\" certificate and key\n[certs] Generating \"front-proxy-client\" certificate and key\n[certs] Generating \"etcd/ca\" certificate and key\n[certs] Generating \"etcd/server\" certificate and key\n[certs] etcd/server serving cert is signed for DNS names [travis-job-290a7968-4b05-42fd-a9d1-45e4c80e982e localhost] and IPs [10.30.1.164 127.0.0.1 ::1]\n[certs] Generating \"etcd/peer\" certificate and key\n[certs] etcd/peer serving cert is signed for DNS names [travis-job-290a7968-4b05-42fd-a9d1-45e4c80e982e localhost] and IPs [10.30.1.164 127.0.0.1 ::1]\n[certs] Generating \"etcd/healthcheck-client\" certificate and key\n[certs] Generating \"apiserver-etcd-client\" certificate and key\n[certs] Generating \"sa\" key and public key\n[kubeconfig] Using kubeconfig folder \"/etc/kubernetes\"\n[kubeconfig] Writing \"admin.conf\" kubeconfig file\n[kubeconfig] Writing \"kubelet.conf\" kubeconfig file\n[kubeconfig] Writing \"controller-manager.conf\" kubeconfig file\n[kubeconfig] Writing \"scheduler.conf\" kubeconfig file\n[control-plane] Using manifest folder \"/etc/kubernetes/manifests\"\n[control-plane] Creating static Pod manifest for \"kube-apiserver\"\n[control-plane] Creating static Pod manifest for \"kube-controller-manager\"\n[control-plane] Creating static Pod manifest for \"kube-scheduler\"\n[etcd] Creating static Pod manifest for local etcd in \"/etc/kubernetes/manifests\"\n[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory \"/etc/kubernetes/manifests\". This can take up to 4m0s\n[apiclient] All control plane components are healthy after 13.002497 seconds\n[upload-config] Storing the configuration used in ConfigMap \"kubeadm-config\" in the \"kube-system\" Namespace\n[kubelet] Creating a ConfigMap \"kubelet-config-1.17\" in namespace kube-system with the configuration for the kubelets in the cluster\n[kubelet-check] Initial timeout of 40s passed.\n[kubelet-check] It seems like the kubelet isn't running or healthy.\n[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.\n\n-- /stdout --\n** stderr ** \nW0506 09:49:36.877681    5382 validation.go:28] Cannot validate kube-proxy config - no validator is available\nW0506 09:49:36.877703    5382 validation.go:28] Cannot validate kubelet config - no validator is available\n\t[WARNING IsDockerSystemdCheck]: detected \"cgroupfs\" as the Docker cgroup driver. The recommended driver is \"systemd\". Please follow the guide at https://kubernetes.io/docs/setup/cri/\n\t[WARNING FileExisting-ebtables]: ebtables not found in system path\n\t[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'\nW0506 09:50:17.074232    5382 manifests.go:214] the default kube-apiserver authorization-mode is \"Node,RBAC\"; using \"RBAC\"\nW0506 09:50:17.081625    5382 manifests.go:214] the default kube-apiserver authorization-mode is \"Node,RBAC\"; using \"RBAC\"\nW0506 09:50:17.083885    5382 manifests.go:214] the default kube-apiserver authorization-mode is \"Node,RBAC\"; using \"RBAC\"\nerror execution phase upload-config/kubelet: Error writing Crisocket information for the control-plane node: timed out waiting for the condition\nTo see the stack trace of this error execute with --v=5 or higher\n\n** /stderr **": /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.17.3:$PATH kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,SystemVerification": exit status 1

stdout:

[init] Using Kubernetes version: v1.17.3

[preflight] Running pre-flight checks

[preflight] Pulling images required for setting up a Kubernetes cluster

[preflight] This might take a minute or two, depending on the speed of your internet connection

[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'

[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"

[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"

[kubelet-start] Starting the kubelet

[certs] Using certificateDir folder "/var/lib/minikube/certs"

[certs] Using existing ca certificate authority

[certs] Using existing apiserver certificate and key on disk

[certs] Generating "apiserver-kubelet-client" certificate and key

[certs] Generating "front-proxy-ca" certificate and key

[certs] Generating "front-proxy-client" certificate and key

[certs] Generating "etcd/ca" certificate and key

[certs] Generating "etcd/server" certificate and key

[certs] etcd/server serving cert is signed for DNS names [travis-job-290a7968-4b05-42fd-a9d1-45e4c80e982e localhost] and IPs [10.30.1.164 127.0.0.1 ::1]

[certs] Generating "etcd/peer" certificate and key

[certs] etcd/peer serving cert is signed for DNS names [travis-job-290a7968-4b05-42fd-a9d1-45e4c80e982e localhost] and IPs [10.30.1.164 127.0.0.1 ::1]

[certs] Generating "etcd/healthcheck-client" certificate and key

[certs] Generating "apiserver-etcd-client" certificate and key

[certs] Generating "sa" key and public key

[kubeconfig] Using kubeconfig folder "/etc/kubernetes"

[kubeconfig] Writing "admin.conf" kubeconfig file

[kubeconfig] Writing "kubelet.conf" kubeconfig file

[kubeconfig] Writing "controller-manager.conf" kubeconfig file

[kubeconfig] Writing "scheduler.conf" kubeconfig file

[control-plane] Using manifest folder "/etc/kubernetes/manifests"

[control-plane] Creating static Pod manifest for "kube-apiserver"

[control-plane] Creating static Pod manifest for "kube-controller-manager"

[control-plane] Creating static Pod manifest for "kube-scheduler"

[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"

[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s

[apiclient] All control plane components are healthy after 13.002497 seconds

[upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace

[kubelet] Creating a ConfigMap "kubelet-config-1.17" in namespace kube-system with the configuration for the kubelets in the cluster

[kubelet-check] Initial timeout of 40s passed.

[kubelet-check] It seems like the kubelet isn't running or healthy.

[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.

stderr:

W0506 09:49:36.877681    5382 validation.go:28] Cannot validate kube-proxy config - no validator is available

W0506 09:49:36.877703    5382 validation.go:28] Cannot validate kubelet config - no validator is available

	[WARNING IsDockerSystemdCheck]: detected "cgroupfs" as the Docker cgroup driver. The recommended driver is "systemd". Please follow the guide at https://kubernetes.io/docs/setup/cri/

	[WARNING FileExisting-ebtables]: ebtables not found in system path

	[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'

W0506 09:50:17.074232    5382 manifests.go:214] the default kube-apiserver authorization-mode is "Node,RBAC"; using "RBAC"

W0506 09:50:17.081625    5382 manifests.go:214] the default kube-apiserver authorization-mode is "Node,RBAC"; using "RBAC"

W0506 09:50:17.083885    5382 manifests.go:214] the default kube-apiserver authorization-mode is "Node,RBAC"; using "RBAC"

error execution phase upload-config/kubelet: Error writing Crisocket information for the control-plane node: timed out waiting for the condition

To see the stack trace of this error execute with --v=5 or higher

* 

* minikube is exiting due to an error. If the above message is not useful, open an issue:

  - https://github.com/kubernetes/minikube/issues/new/choose

@k8s-ci-robot
Copy link
Contributor

@liranmauda: You can't reopen an issue/PR unless you authored it or you are a collaborator.

In response to this:

/reopen
Happends to me and it is repreducible.

sudo minikube start --kubernetes-version=v1.17.3 --extra-config=apiserver.authorization-mode=RBAC --alsologtostderr -v=3

I0506 09:49:32.938190    5215 start.go:252] hostinfo: {"hostname":"travis-job-290a7968-4b05-42fd-a9d1-45e4c80e982e","uptime":61,"bootTime":1588758511,"procs":165,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"16.04","kernelVersion":"4.15.0-1028-gcp","virtualizationSystem":"","virtualizationRole":"","hostid":"9b137f3d-6c59-2cfe-3e7d-5f1fcc442a45"}

I0506 09:49:32.938772    5215 start.go:262] virtualization:  

* minikube v1.8.2 on Ubuntu 16.04

 - KUBECONFIG=/home/travis/.kube/config

 - MINIKUBE_WANTREPORTERRORPROMPT=false

 - MINIKUBE_VERSION=v1.8.2

 - MINIKUBE_WANTUPDATENOTIFICATION=false

 - MINIKUBE_HOME=/home/travis

I0506 09:49:32.938986    5215 driver.go:226] Setting default libvirt URI to qemu:///system

* Using the none driver based on user configuration

I0506 09:49:32.939615    5215 start.go:299] selected driver: none

I0506 09:49:32.939628    5215 start.go:488] validating driver "none" against <nil>

I0506 09:49:32.939655    5215 start.go:494] status for none: {Installed:true Healthy:true Error:<nil> Fix: Doc:}

I0506 09:49:32.939804    5215 start.go:863] Using suggested 2200MB memory alloc based on sys=7976MB, container=0MB

I0506 09:49:32.940489    5215 profile.go:121] Saving config to /home/travis/.minikube/profiles/minikube/config.json ...

I0506 09:49:32.940577    5215 lock.go:35] WriteFile acquiring /home/travis/.minikube/profiles/minikube/config.json: {Name:mk3ff515ea0b8f2f4b93ee0ee9c0604afd1294cb Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

I0506 09:49:32.941037    5215 cache.go:109] Successfully downloaded all kic artifacts

I0506 09:49:32.941077    5215 start.go:245] acquiring machines lock for minikube: {Name:mk2cd192460d97102eb871201db192ca0179242e Clock:{} Delay:500ms Timeout:15m0s Cancel:<nil>}

I0506 09:49:32.941152    5215 start.go:249] acquired machines lock for "minikube" in 54.892µs

I0506 09:49:32.941176    5215 start.go:82] Provisioning new machine with config: {Name:minikube KeepContext:false EmbedCerts:false MinikubeISO: Memory:2200 CPUs:2 DiskSize:20000 Driver:none HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio KubernetesConfig:{KubernetesVersion:v1.17.3 ClusterName:minikube APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: ExtraOptions:[{Component:apiserver Key:authorization-mode Value:RBAC}] ShouldLoadCachedImages:false EnableDefaultCNI:false NodeIP: NodePort:0 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.17.3 ControlPlane:true Worker:true}] Addons:map[]}

I0506 09:49:32.941231    5215 start.go:101] createHost starting for "minikube" (driver="none")

* Running on localhost (CPUs=2, Memory=7976MB, Disk=69422MB) ...

I0506 09:49:32.941958    5215 start.go:137] libmachine.API.Create for "minikube" (driver="none")

I0506 09:49:32.942030    5215 main.go:110] libmachine: Creating CA: /home/travis/.minikube/certs/ca.pem

I0506 09:49:33.046047    5215 main.go:110] libmachine: Creating client certificate: /home/travis/.minikube/certs/cert.pem

I0506 09:49:33.435864    5215 start.go:142] libmachine.API.Create for "minikube" took 493.902042ms

I0506 09:49:33.435995    5215 start.go:183] post-start starting for "minikube" (driver="none")

I0506 09:49:33.436010    5215 start.go:193] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

I0506 09:49:33.436109    5215 start.go:216] determining appropriate runner for "none"

I0506 09:49:33.436123    5215 start.go:223] returning ExecRunner for "none" driver

I0506 09:49:33.442037    5215 main.go:110] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found

I0506 09:49:33.442067    5215 main.go:110] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found

* OS release is Ubuntu 16.04.6 LTS

I0506 09:49:33.442132    5215 filesync.go:118] Scanning /home/travis/.minikube/addons for local assets ...

I0506 09:49:33.442172    5215 filesync.go:118] Scanning /home/travis/.minikube/files for local assets ...

I0506 09:49:33.442209    5215 start.go:186] post-start completed in 6.195919ms

I0506 09:49:33.442422    5215 start.go:104] createHost completed in 501.178612ms

I0506 09:49:33.442437    5215 start.go:73] releasing machines lock for "minikube", held for 501.270227ms

I0506 09:49:33.582625    5215 profile.go:121] Saving config to /home/travis/.minikube/profiles/minikube/config.json ...

* Preparing Kubernetes v1.17.3 on Docker 18.06.0-ce ...

I0506 09:49:33.763080    5215 settings.go:123] acquiring lock: {Name:mk57cf054ea70ef81fcf0ea674b256884403c561 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

I0506 09:49:33.763209    5215 settings.go:131] Updating kubeconfig:  /home/travis/.kube/config

I0506 09:49:33.764313    5215 lock.go:35] WriteFile acquiring /home/travis/.kube/config: {Name:mk99447089f6ee8f5118fff3e024a25fc382dcfd Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

 - apiserver.authorization-mode=RBAC

I0506 09:49:33.764948    5215 kubeadm.go:126] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet: AdvertiseAddress:10.30.1.164 APIServerPort:8443 KubernetesVersion:v1.17.3 EtcdDataDir:/var/lib/minikube/etcd ClusterName:minikube NodeName: DNSDomain:cluster.local CRISocket: ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[authorization-mode:RBAC enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "10.30.1.164"]]}] FeatureArgs:map[] NoTaintMaster:true NodeIP:10.30.1.164 ControlPlaneAddress:localhost}

I0506 09:49:33.765071    5215 kubeadm.go:130] kubeadm config:

apiVersion: kubeadm.k8s.io/v1beta2

kind: InitConfiguration

localAPIEndpoint:

 advertiseAddress: 10.30.1.164

 bindPort: 8443

bootstrapTokens:

 - groups:

     - system:bootstrappers:kubeadm:default-node-token

   ttl: 24h0m0s

   usages:

     - signing

     - authentication

nodeRegistration:

 criSocket: /var/run/dockershim.sock

 name: ""

 kubeletExtraArgs:

   node-ip: 10.30.1.164

 taints: []

---

apiVersion: kubeadm.k8s.io/v1beta2

kind: ClusterConfiguration

apiServer:

 certSANs: ["127.0.0.1", "localhost", "10.30.1.164"]

 extraArgs:

   authorization-mode: "RBAC"

   enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"

certificatesDir: /var/lib/minikube/certs

clusterName: kubernetes

controlPlaneEndpoint: localhost:8443

controllerManager: {}

dns:

 type: CoreDNS

etcd:

 local:

   dataDir: /var/lib/minikube/etcd

kubernetesVersion: v1.17.3

networking:

 dnsDomain: cluster.local

 podSubnet: ""

 serviceSubnet: 10.96.0.0/12

I0506 09:49:33.830070    5215 kubeadm.go:427] kubelet [Unit]

Wants=docker.socket

[Service]

ExecStart=

ExecStart=/var/lib/minikube/binaries/v1.17.3/kubelet --authorization-mode=Webhook --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --cgroup-driver=cgroupfs --client-ca-file=/var/lib/minikube/certs/ca.crt --cluster-domain=cluster.local --config=/var/lib/kubelet/config.yaml --container-runtime=docker --fail-swap-on=false --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=10.30.1.164 --pod-manifest-path=/etc/kubernetes/manifests

[Install]

config:

{KubernetesVersion:v1.17.3 ClusterName:minikube APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: ExtraOptions:[{Component:apiserver Key:authorization-mode Value:RBAC}] ShouldLoadCachedImages:false EnableDefaultCNI:false NodeIP: NodePort:0 NodeName:}

W0506 09:49:33.835341    5215 kubeadm.go:431] unable to stop kubelet: command: "/bin/bash -c \"pgrep kubelet && sudo systemctl stop kubelet\"" output: "": /bin/bash -c "pgrep kubelet && sudo systemctl stop kubelet": exit status 1

stdout:

stderr:

I0506 09:49:33.842831    5215 binaries.go:45] Didn't find k8s binaries: sudo ls /var/lib/minikube/binaries/v1.17.3: exit status 2

stdout:

stderr:

ls: cannot access '/var/lib/minikube/binaries/v1.17.3': No such file or directory

Initiating transfer...

I0506 09:49:33.848762    5215 binary.go:74] Downloading: &{Ctx:<nil> Src:https://storage.googleapis.com/kubernetes-release/release/v1.17.3/bin/linux/amd64/kubectl?checksum=file:https://storage.googleapis.com/kubernetes-release/release/v1.17.3/bin/linux/amd64/kubectl.sha256 Dst:/home/travis/.minikube/cache/linux/v1.17.3/kubectl.download Pwd: Mode:2 Detectors:[] Decompressors:map[] Getters:map[] Dir:false ProgressListener:<nil> Options:[0xbdab30]}

I0506 09:49:33.848762    5215 binary.go:74] Downloading: &{Ctx:<nil> Src:https://storage.googleapis.com/kubernetes-release/release/v1.17.3/bin/linux/amd64/kubelet?checksum=file:https://storage.googleapis.com/kubernetes-release/release/v1.17.3/bin/linux/amd64/kubelet.sha256 Dst:/home/travis/.minikube/cache/linux/v1.17.3/kubelet.download Pwd: Mode:2 Detectors:[] Decompressors:map[] Getters:map[] Dir:false ProgressListener:<nil> Options:[0xbdab30]}

I0506 09:49:33.848980    5215 binary.go:74] Downloading: &{Ctx:<nil> Src:https://storage.googleapis.com/kubernetes-release/release/v1.17.3/bin/linux/amd64/kubeadm?checksum=file:https://storage.googleapis.com/kubernetes-release/release/v1.17.3/bin/linux/amd64/kubeadm.sha256 Dst:/home/travis/.minikube/cache/linux/v1.17.3/kubeadm.download Pwd: Mode:2 Detectors:[] Decompressors:map[] Getters:map[] Dir:false ProgressListener:<nil> Options:[0xbdab30]}

   > kubeadm.sha256: 65 B / 65 B [--------------------------] 100.00% ? p/s 0s

   > kubelet.sha256: 65 B / 65 B [--------------------------] 100.00% ? p/s 0s

   > kubectl.sha256: 65 B / 65 B [--------------------------] 100.00% ? p/s 0s

   > kubectl: 41.48 MiB / 41.48 MiB [--------------] 100.00% 386.70 MiB p/s 0s

   > kubeadm: 37.52 MiB / 37.52 MiB [--------------] 100.00% 178.34 MiB p/s 0s

   > kubelet: 106.42 MiB / 106.42 MiB [------------] 100.00% 123.49 MiB p/s 1s

I0506 09:49:35.722442    5215 certs.go:59] Setting up /home/travis/.minikube for IP: 10.30.1.164

I0506 09:49:35.722478    5215 certs.go:68] acquiring lock: {Name:mk4d65cc156b036675d84bd7aaea46077ebaaf43 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

I0506 09:49:36.165970    5215 crypto.go:157] Writing cert to /home/travis/.minikube/ca.crt ...

I0506 09:49:36.166009    5215 lock.go:35] WriteFile acquiring /home/travis/.minikube/ca.crt: {Name:mka43122446f432ef35bc0324b3fb98a93ed82a4 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

I0506 09:49:36.166221    5215 crypto.go:165] Writing key to /home/travis/.minikube/ca.key ...

I0506 09:49:36.166247    5215 lock.go:35] WriteFile acquiring /home/travis/.minikube/ca.key: {Name:mk503d8082ea913249dd604346069c628e843662 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

I0506 09:49:36.347527    5215 crypto.go:157] Writing cert to /home/travis/.minikube/proxy-client-ca.crt ...

I0506 09:49:36.347564    5215 lock.go:35] WriteFile acquiring /home/travis/.minikube/proxy-client-ca.crt: {Name:mka6901b207dbec15592b26cdaba73a12a953534 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

I0506 09:49:36.347754    5215 crypto.go:165] Writing key to /home/travis/.minikube/proxy-client-ca.key ...

I0506 09:49:36.347777    5215 lock.go:35] WriteFile acquiring /home/travis/.minikube/proxy-client-ca.key: {Name:mk7f67f7e4d2aa86a620bf17b50a0dc386119f95 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

I0506 09:49:36.347881    5215 crypto.go:69] Generating cert /home/travis/.minikube/client.crt with IP's: []

I0506 09:49:36.492350    5215 crypto.go:157] Writing cert to /home/travis/.minikube/client.crt ...

I0506 09:49:36.492385    5215 lock.go:35] WriteFile acquiring /home/travis/.minikube/client.crt: {Name:mkc1d148bd8378c23b8cbe73c6bb7bea40f7ba66 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

I0506 09:49:36.492574    5215 crypto.go:165] Writing key to /home/travis/.minikube/client.key ...

I0506 09:49:36.492596    5215 lock.go:35] WriteFile acquiring /home/travis/.minikube/client.key: {Name:mke112921a148b694ecf13709770a3cae96c664a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

I0506 09:49:36.492691    5215 crypto.go:69] Generating cert /home/travis/.minikube/apiserver.crt with IP's: [10.30.1.164 10.96.0.1 127.0.0.1 10.0.0.1]

I0506 09:49:36.673206    5215 crypto.go:157] Writing cert to /home/travis/.minikube/apiserver.crt ...

I0506 09:49:36.673247    5215 lock.go:35] WriteFile acquiring /home/travis/.minikube/apiserver.crt: {Name:mk05629d648db879dbbd257edd7274378be0b706 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

I0506 09:49:36.673445    5215 crypto.go:165] Writing key to /home/travis/.minikube/apiserver.key ...

I0506 09:49:36.673467    5215 lock.go:35] WriteFile acquiring /home/travis/.minikube/apiserver.key: {Name:mk63fcb117f0daa67d5c01ed508f0fa9adbbcabe Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

I0506 09:49:36.673564    5215 crypto.go:69] Generating cert /home/travis/.minikube/proxy-client.crt with IP's: []

I0506 09:49:36.807338    5215 crypto.go:157] Writing cert to /home/travis/.minikube/proxy-client.crt ...

I0506 09:49:36.807381    5215 lock.go:35] WriteFile acquiring /home/travis/.minikube/proxy-client.crt: {Name:mk38134286f86c8c5737b694b7d00521ce10f274 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

I0506 09:49:36.807843    5215 crypto.go:165] Writing key to /home/travis/.minikube/proxy-client.key ...

I0506 09:49:36.807880    5215 lock.go:35] WriteFile acquiring /home/travis/.minikube/proxy-client.key: {Name:mk32fe2f9b4f11fe8b66885eda6a1510289fc6fc Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

* Launching Kubernetes ... 

I0506 09:49:36.836761    5215 kubeadm.go:160] existence check: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd: exit status 2

stdout:

stderr:

ls: cannot access '/var/lib/kubelet/kubeadm-flags.env': No such file or directory

ls: cannot access '/var/lib/kubelet/config.yaml': No such file or directory

ls: cannot access '/var/lib/minikube/etcd': No such file or directory

I0506 09:49:36.836786    5215 kubeadm.go:163] StartCluster: {Name:minikube KeepContext:false EmbedCerts:false MinikubeISO: Memory:2200 CPUs:2 DiskSize:20000 Driver:none HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio KubernetesConfig:{KubernetesVersion:v1.17.3 ClusterName:minikube APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: ExtraOptions:[{Component:apiserver Key:authorization-mode Value:RBAC}] ShouldLoadCachedImages:false EnableDefaultCNI:false NodeIP: NodePort:0 NodeName:} Nodes:[{Name: IP:10.30.1.164 Port:8443 KubernetesVersion:v1.17.3 ControlPlane:true Worker:true}] Addons:map[]}

I0506 09:52:30.120165    5215 exec_runner.go:76] Completed: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.17.3:$PATH kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,SystemVerification": (2m53.283261602s)

I0506 09:52:30.120375    5215 kubeadm.go:165] StartCluster complete in 2m53.283588037s

I0506 09:52:30.175847    5215 logs.go:177] 1 containers: [8bceef1aab66]

I0506 09:52:30.229942    5215 logs.go:177] 0 containers: []

W0506 09:52:30.229977    5215 logs.go:179] No container was found matching "coredns"

I0506 09:52:30.284187    5215 logs.go:177] 1 containers: [ebbf9245b2ce]

I0506 09:52:30.336427    5215 logs.go:177] 0 containers: []

W0506 09:52:30.336527    5215 logs.go:179] No container was found matching "kube-proxy"

I0506 09:52:30.387563    5215 logs.go:177] 0 containers: []

W0506 09:52:30.387587    5215 logs.go:179] No container was found matching "kubernetes-dashboard"

I0506 09:52:30.442623    5215 logs.go:177] 0 containers: []

W0506 09:52:30.442649    5215 logs.go:179] No container was found matching "storage-provisioner"

I0506 09:52:30.497112    5215 logs.go:177] 1 containers: [37608f1a5fee]

I0506 09:52:30.497157    5215 logs.go:91] Gathering logs for kubelet ...

I0506 09:52:30.562569    5215 logs.go:91] Gathering logs for dmesg ...

I0506 09:52:30.572107    5215 logs.go:91] Gathering logs for kube-apiserver [8bceef1aab66] ...

I0506 09:52:30.650112    5215 logs.go:91] Gathering logs for kube-scheduler [ebbf9245b2ce] ...

I0506 09:52:30.713001    5215 logs.go:91] Gathering logs for kube-controller-manager [37608f1a5fee] ...

I0506 09:52:30.777158    5215 logs.go:91] Gathering logs for Docker ...

I0506 09:52:30.798309    5215 logs.go:91] Gathering logs for container status ...

W0506 09:52:30.869700    5215 exit.go:101] Error starting cluster: init failed. output: "-- stdout --\n[init] Using Kubernetes version: v1.17.3\n[preflight] Running pre-flight checks\n[preflight] Pulling images required for setting up a Kubernetes cluster\n[preflight] This might take a minute or two, depending on the speed of your internet connection\n[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'\n[kubelet-start] Writing kubelet environment file with flags to file \"/var/lib/kubelet/kubeadm-flags.env\"\n[kubelet-start] Writing kubelet configuration to file \"/var/lib/kubelet/config.yaml\"\n[kubelet-start] Starting the kubelet\n[certs] Using certificateDir folder \"/var/lib/minikube/certs\"\n[certs] Using existing ca certificate authority\n[certs] Using existing apiserver certificate and key on disk\n[certs] Generating \"apiserver-kubelet-client\" certificate and key\n[certs] Generating \"front-proxy-ca\" certificate and key\n[certs] Generating \"front-proxy-client\" certificate and key\n[certs] Generating \"etcd/ca\" certificate and key\n[certs] Generating \"etcd/server\" certificate and key\n[certs] etcd/server serving cert is signed for DNS names [travis-job-290a7968-4b05-42fd-a9d1-45e4c80e982e localhost] and IPs [10.30.1.164 127.0.0.1 ::1]\n[certs] Generating \"etcd/peer\" certificate and key\n[certs] etcd/peer serving cert is signed for DNS names [travis-job-290a7968-4b05-42fd-a9d1-45e4c80e982e localhost] and IPs [10.30.1.164 127.0.0.1 ::1]\n[certs] Generating \"etcd/healthcheck-client\" certificate and key\n[certs] Generating \"apiserver-etcd-client\" certificate and key\n[certs] Generating \"sa\" key and public key\n[kubeconfig] Using kubeconfig folder \"/etc/kubernetes\"\n[kubeconfig] Writing \"admin.conf\" kubeconfig file\n[kubeconfig] Writing \"kubelet.conf\" kubeconfig file\n[kubeconfig] Writing \"controller-manager.conf\" kubeconfig file\n[kubeconfig] Writing \"scheduler.conf\" kubeconfig file\n[control-plane] Using manifest folder \"/etc/kubernetes/manifests\"\n[control-plane] Creating static Pod manifest for \"kube-apiserver\"\n[control-plane] Creating static Pod manifest for \"kube-controller-manager\"\n[control-plane] Creating static Pod manifest for \"kube-scheduler\"\n[etcd] Creating static Pod manifest for local etcd in \"/etc/kubernetes/manifests\"\n[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory \"/etc/kubernetes/manifests\". This can take up to 4m0s\n[apiclient] All control plane components are healthy after 13.002497 seconds\n[upload-config] Storing the configuration used in ConfigMap \"kubeadm-config\" in the \"kube-system\" Namespace\n[kubelet] Creating a ConfigMap \"kubelet-config-1.17\" in namespace kube-system with the configuration for the kubelets in the cluster\n[kubelet-check] Initial timeout of 40s passed.\n[kubelet-check] It seems like the kubelet isn't running or healthy.\n[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.\n\n-- /stdout --\n** stderr ** \nW0506 09:49:36.877681    5382 validation.go:28] Cannot validate kube-proxy config - no validator is available\nW0506 09:49:36.877703    5382 validation.go:28] Cannot validate kubelet config - no validator is available\n\t[WARNING IsDockerSystemdCheck]: detected \"cgroupfs\" as the Docker cgroup driver. The recommended driver is \"systemd\". Please follow the guide at https://kubernetes.io/docs/setup/cri/\n\t[WARNING FileExisting-ebtables]: ebtables not found in system path\n\t[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'\nW0506 09:50:17.074232    5382 manifests.go:214] the default kube-apiserver authorization-mode is \"Node,RBAC\"; using \"RBAC\"\nW0506 09:50:17.081625    5382 manifests.go:214] the default kube-apiserver authorization-mode is \"Node,RBAC\"; using \"RBAC\"\nW0506 09:50:17.083885    5382 manifests.go:214] the default kube-apiserver authorization-mode is \"Node,RBAC\"; using \"RBAC\"\nerror execution phase upload-config/kubelet: Error writing Crisocket information for the control-plane node: timed out waiting for the condition\nTo see the stack trace of this error execute with --v=5 or higher\n\n** /stderr **": /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.17.3:$PATH kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,SystemVerification": exit status 1

stdout:

[init] Using Kubernetes version: v1.17.3

[preflight] Running pre-flight checks

[preflight] Pulling images required for setting up a Kubernetes cluster

[preflight] This might take a minute or two, depending on the speed of your internet connection

[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'

[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"

[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"

[kubelet-start] Starting the kubelet

[certs] Using certificateDir folder "/var/lib/minikube/certs"

[certs] Using existing ca certificate authority

[certs] Using existing apiserver certificate and key on disk

[certs] Generating "apiserver-kubelet-client" certificate and key

[certs] Generating "front-proxy-ca" certificate and key

[certs] Generating "front-proxy-client" certificate and key

[certs] Generating "etcd/ca" certificate and key

[certs] Generating "etcd/server" certificate and key

[certs] etcd/server serving cert is signed for DNS names [travis-job-290a7968-4b05-42fd-a9d1-45e4c80e982e localhost] and IPs [10.30.1.164 127.0.0.1 ::1]

[certs] Generating "etcd/peer" certificate and key

[certs] etcd/peer serving cert is signed for DNS names [travis-job-290a7968-4b05-42fd-a9d1-45e4c80e982e localhost] and IPs [10.30.1.164 127.0.0.1 ::1]

[certs] Generating "etcd/healthcheck-client" certificate and key

[certs] Generating "apiserver-etcd-client" certificate and key

[certs] Generating "sa" key and public key

[kubeconfig] Using kubeconfig folder "/etc/kubernetes"

[kubeconfig] Writing "admin.conf" kubeconfig file

[kubeconfig] Writing "kubelet.conf" kubeconfig file

[kubeconfig] Writing "controller-manager.conf" kubeconfig file

[kubeconfig] Writing "scheduler.conf" kubeconfig file

[control-plane] Using manifest folder "/etc/kubernetes/manifests"

[control-plane] Creating static Pod manifest for "kube-apiserver"

[control-plane] Creating static Pod manifest for "kube-controller-manager"

[control-plane] Creating static Pod manifest for "kube-scheduler"

[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"

[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s

[apiclient] All control plane components are healthy after 13.002497 seconds

[upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace

[kubelet] Creating a ConfigMap "kubelet-config-1.17" in namespace kube-system with the configuration for the kubelets in the cluster

[kubelet-check] Initial timeout of 40s passed.

[kubelet-check] It seems like the kubelet isn't running or healthy.

[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.

stderr:

W0506 09:49:36.877681    5382 validation.go:28] Cannot validate kube-proxy config - no validator is available

W0506 09:49:36.877703    5382 validation.go:28] Cannot validate kubelet config - no validator is available

  [WARNING IsDockerSystemdCheck]: detected "cgroupfs" as the Docker cgroup driver. The recommended driver is "systemd". Please follow the guide at https://kubernetes.io/docs/setup/cri/

  [WARNING FileExisting-ebtables]: ebtables not found in system path

  [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'

W0506 09:50:17.074232    5382 manifests.go:214] the default kube-apiserver authorization-mode is "Node,RBAC"; using "RBAC"

W0506 09:50:17.081625    5382 manifests.go:214] the default kube-apiserver authorization-mode is "Node,RBAC"; using "RBAC"

W0506 09:50:17.083885    5382 manifests.go:214] the default kube-apiserver authorization-mode is "Node,RBAC"; using "RBAC"

error execution phase upload-config/kubelet: Error writing Crisocket information for the control-plane node: timed out waiting for the condition

To see the stack trace of this error execute with --v=5 or higher

* 

X Error starting cluster: init failed. output: "-- stdout --\n[init] Using Kubernetes version: v1.17.3\n[preflight] Running pre-flight checks\n[preflight] Pulling images required for setting up a Kubernetes cluster\n[preflight] This might take a minute or two, depending on the speed of your internet connection\n[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'\n[kubelet-start] Writing kubelet environment file with flags to file \"/var/lib/kubelet/kubeadm-flags.env\"\n[kubelet-start] Writing kubelet configuration to file \"/var/lib/kubelet/config.yaml\"\n[kubelet-start] Starting the kubelet\n[certs] Using certificateDir folder \"/var/lib/minikube/certs\"\n[certs] Using existing ca certificate authority\n[certs] Using existing apiserver certificate and key on disk\n[certs] Generating \"apiserver-kubelet-client\" certificate and key\n[certs] Generating \"front-proxy-ca\" certificate and key\n[certs] Generating \"front-proxy-client\" certificate and key\n[certs] Generating \"etcd/ca\" certificate and key\n[certs] Generating \"etcd/server\" certificate and key\n[certs] etcd/server serving cert is signed for DNS names [travis-job-290a7968-4b05-42fd-a9d1-45e4c80e982e localhost] and IPs [10.30.1.164 127.0.0.1 ::1]\n[certs] Generating \"etcd/peer\" certificate and key\n[certs] etcd/peer serving cert is signed for DNS names [travis-job-290a7968-4b05-42fd-a9d1-45e4c80e982e localhost] and IPs [10.30.1.164 127.0.0.1 ::1]\n[certs] Generating \"etcd/healthcheck-client\" certificate and key\n[certs] Generating \"apiserver-etcd-client\" certificate and key\n[certs] Generating \"sa\" key and public key\n[kubeconfig] Using kubeconfig folder \"/etc/kubernetes\"\n[kubeconfig] Writing \"admin.conf\" kubeconfig file\n[kubeconfig] Writing \"kubelet.conf\" kubeconfig file\n[kubeconfig] Writing \"controller-manager.conf\" kubeconfig file\n[kubeconfig] Writing \"scheduler.conf\" kubeconfig file\n[control-plane] Using manifest folder \"/etc/kubernetes/manifests\"\n[control-plane] Creating static Pod manifest for \"kube-apiserver\"\n[control-plane] Creating static Pod manifest for \"kube-controller-manager\"\n[control-plane] Creating static Pod manifest for \"kube-scheduler\"\n[etcd] Creating static Pod manifest for local etcd in \"/etc/kubernetes/manifests\"\n[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory \"/etc/kubernetes/manifests\". This can take up to 4m0s\n[apiclient] All control plane components are healthy after 13.002497 seconds\n[upload-config] Storing the configuration used in ConfigMap \"kubeadm-config\" in the \"kube-system\" Namespace\n[kubelet] Creating a ConfigMap \"kubelet-config-1.17\" in namespace kube-system with the configuration for the kubelets in the cluster\n[kubelet-check] Initial timeout of 40s passed.\n[kubelet-check] It seems like the kubelet isn't running or healthy.\n[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.\n\n-- /stdout --\n** stderr ** \nW0506 09:49:36.877681    5382 validation.go:28] Cannot validate kube-proxy config - no validator is available\nW0506 09:49:36.877703    5382 validation.go:28] Cannot validate kubelet config - no validator is available\n\t[WARNING IsDockerSystemdCheck]: detected \"cgroupfs\" as the Docker cgroup driver. The recommended driver is \"systemd\". Please follow the guide at https://kubernetes.io/docs/setup/cri/\n\t[WARNING FileExisting-ebtables]: ebtables not found in system path\n\t[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'\nW0506 09:50:17.074232    5382 manifests.go:214] the default kube-apiserver authorization-mode is \"Node,RBAC\"; using \"RBAC\"\nW0506 09:50:17.081625    5382 manifests.go:214] the default kube-apiserver authorization-mode is \"Node,RBAC\"; using \"RBAC\"\nW0506 09:50:17.083885    5382 manifests.go:214] the default kube-apiserver authorization-mode is \"Node,RBAC\"; using \"RBAC\"\nerror execution phase upload-config/kubelet: Error writing Crisocket information for the control-plane node: timed out waiting for the condition\nTo see the stack trace of this error execute with --v=5 or higher\n\n** /stderr **": /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.17.3:$PATH kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,SystemVerification": exit status 1

stdout:

[init] Using Kubernetes version: v1.17.3

[preflight] Running pre-flight checks

[preflight] Pulling images required for setting up a Kubernetes cluster

[preflight] This might take a minute or two, depending on the speed of your internet connection

[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'

[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"

[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"

[kubelet-start] Starting the kubelet

[certs] Using certificateDir folder "/var/lib/minikube/certs"

[certs] Using existing ca certificate authority

[certs] Using existing apiserver certificate and key on disk

[certs] Generating "apiserver-kubelet-client" certificate and key

[certs] Generating "front-proxy-ca" certificate and key

[certs] Generating "front-proxy-client" certificate and key

[certs] Generating "etcd/ca" certificate and key

[certs] Generating "etcd/server" certificate and key

[certs] etcd/server serving cert is signed for DNS names [travis-job-290a7968-4b05-42fd-a9d1-45e4c80e982e localhost] and IPs [10.30.1.164 127.0.0.1 ::1]

[certs] Generating "etcd/peer" certificate and key

[certs] etcd/peer serving cert is signed for DNS names [travis-job-290a7968-4b05-42fd-a9d1-45e4c80e982e localhost] and IPs [10.30.1.164 127.0.0.1 ::1]

[certs] Generating "etcd/healthcheck-client" certificate and key

[certs] Generating "apiserver-etcd-client" certificate and key

[certs] Generating "sa" key and public key

[kubeconfig] Using kubeconfig folder "/etc/kubernetes"

[kubeconfig] Writing "admin.conf" kubeconfig file

[kubeconfig] Writing "kubelet.conf" kubeconfig file

[kubeconfig] Writing "controller-manager.conf" kubeconfig file

[kubeconfig] Writing "scheduler.conf" kubeconfig file

[control-plane] Using manifest folder "/etc/kubernetes/manifests"

[control-plane] Creating static Pod manifest for "kube-apiserver"

[control-plane] Creating static Pod manifest for "kube-controller-manager"

[control-plane] Creating static Pod manifest for "kube-scheduler"

[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"

[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s

[apiclient] All control plane components are healthy after 13.002497 seconds

[upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace

[kubelet] Creating a ConfigMap "kubelet-config-1.17" in namespace kube-system with the configuration for the kubelets in the cluster

[kubelet-check] Initial timeout of 40s passed.

[kubelet-check] It seems like the kubelet isn't running or healthy.

[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.

stderr:

W0506 09:49:36.877681    5382 validation.go:28] Cannot validate kube-proxy config - no validator is available

W0506 09:49:36.877703    5382 validation.go:28] Cannot validate kubelet config - no validator is available

  [WARNING IsDockerSystemdCheck]: detected "cgroupfs" as the Docker cgroup driver. The recommended driver is "systemd". Please follow the guide at https://kubernetes.io/docs/setup/cri/

  [WARNING FileExisting-ebtables]: ebtables not found in system path

  [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'

W0506 09:50:17.074232    5382 manifests.go:214] the default kube-apiserver authorization-mode is "Node,RBAC"; using "RBAC"

W0506 09:50:17.081625    5382 manifests.go:214] the default kube-apiserver authorization-mode is "Node,RBAC"; using "RBAC"

W0506 09:50:17.083885    5382 manifests.go:214] the default kube-apiserver authorization-mode is "Node,RBAC"; using "RBAC"

error execution phase upload-config/kubelet: Error writing Crisocket information for the control-plane node: timed out waiting for the condition

To see the stack trace of this error execute with --v=5 or higher

* 

* minikube is exiting due to an error. If the above message is not useful, open an issue:

 - https://github.com/kubernetes/minikube/issues/new/choose

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

@liranmauda
Copy link

@tstromberg I have tried to reopen but i am not the author.

@sharifelgamal
Copy link
Collaborator

sharifelgamal commented May 6, 2020

@liranmauda Please open a new issue, ideally with all the debug details so we can help figure out your issue.

@liranmauda
Copy link

@sharifelgamal
We figured it out, not sure it is the same issue as here as we are using minikube config set vm-driver none

in any case, we had to install contract: sudo apt-get -y install conntrack

and to remove --extra-config=apiserver.authorization-mode=RBAC (using --extra-config=apiserver.authorization-mode=Node,RBAC worked also)

we used #7905 and #6061 as reference.

@gurleensethi
Copy link

Might not be a logical answer, but this worked for me.

minikube delete

then

minikube start

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
kind/support Categorizes issue or PR as a support question. priority/awaiting-more-evidence Lowest priority. Possibly useful, but not yet enough support to actually get it done.
Projects
None yet
Development

No branches or pull requests

6 participants