Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

kubelet fails to start with custom docker root dir #76604

Open
jansmets opened this Issue Apr 15, 2019 · 3 comments

Comments

Projects
None yet
4 participants
@jansmets
Copy link

jansmets commented Apr 15, 2019

Kubelet v1.14.1 fails to start when the Dcker Root dir is changed from the default.

# cat /etc/docker/daemon.json 
{
"data-root" : "/data/docker"
}
$ docker info
Docker Root Dir: /data/docker

I am running kubelet in a container that mounted volume /data/docker:/data/docker:rw
(also /var/lib/kubelet is mounted that way)

(reduced)
/usr/bin/docker run --rm --net host --pid host --privileged --volume /var/run:/var/run:rw --volume /data/docker:/data/docker:rw --volume /var/lib/kubelet:/var/lib/kubelet:shared -v /sys:/sys:ro  gcr.io/google-containers/hyperkube-amd64:v1.14.1     kubelet
F0415 12:57:40.074265   14895 kubelet.go:1359] Failed to start ContainerManager failed to get rootfs info: failed to get device for dir "/var/lib/kubelet": could not find device with major: 0, minor: 37 in cached partitions map

When I also change the 'host side' /var/lib/kubelet to /data/kubelet, kubelet starts.

/usr/bin/docker run --rm --net host --pid host --privileged --volume /var/run:/var/run:rw --volume /data/docker:/data/docker:rw --volume /data/kubelet:/var/lib/kubelet:shared  gcr.io/google-containers/hyperkube-amd64:v1.14.1     kubelet

When all the above is attempted with k8s v1.13.5 it all works as expected.

Thank you

@jansmets

This comment has been minimized.

Copy link
Author

jansmets commented Apr 15, 2019

/sig bugs

@neolit123

This comment has been minimized.

Copy link
Member

neolit123 commented Apr 15, 2019

/sig node

@k8s-ci-robot k8s-ci-robot added sig/node and removed needs-sig labels Apr 15, 2019

@YoubingLi

This comment has been minimized.

Copy link
Contributor

YoubingLi commented Apr 18, 2019

@jansmets

Can you share more log about this issue?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
You can’t perform that action at this time.