New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

CoreOS 1745.7.0 sudden reboots on k8s worker vms #2475

Open
encodeflush opened this Issue Jul 13, 2018 · 3 comments

Comments

Projects
None yet
3 participants
@encodeflush

encodeflush commented Jul 13, 2018

Issue Report

Bug

Container Linux Version

$ cat /etc/os-release
DISTRIB_ID="Container Linux by CoreOS"
DISTRIB_RELEASE=1745.7.0
DISTRIB_CODENAME="Rhyolite"
DISTRIB_DESCRIPTION="Container Linux by CoreOS 1745.7.0 (Rhyolite)"

Environment

vSphere 6.5
Docker version: 18.03.1-ce, build 9ee9f40
Etcd version: v3.2.17
Flannel version: v0.10.0
K8s version: v1.10.5

Expected Behavior

K8s workers without sudden reboots.

Actual Behavior

K8s workers are rebooting unexpectedly.

Reproduction Steps

  1. Deploy some workload on the k8s cluster
  2. Then, out of nowhere one or more worker vms are rebooting.

Other Information

$ journalctl

Jul 13 07:25:33 worker04 kubelet-wrapper[4753]: E0713 07:25:33.916957    4753 kubelet_volumes.go:140] Orphaned pod "4d103385-8660-11e8-9f7f-005056b0125b" found, but volume paths are still present on disk : There were a total of 1 errors similar to this. Turn up verbosity to see them.
Jul 13 07:25:34 worker04 kubelet-wrapper[4753]: I0713 07:25:34.080653    4753 kuberuntime_manager.go:513] Container {Name:elasticsearch Image:registrypro elasticsearch:6.2.3 Command:[] Args:[] WorkingDir: Ports:[{Name:transport HostPort:0 ContainerPort:9300 Protocol:TCP HostIP:}] EnvFrom:[] Env:[{Name:SERVICE Value:consumer-elasticsearch-master ValueFrom:nil} {Name:NODE_DATA Value:true ValueFrom:nil} {Name:NODE_MASTER Value:false ValueFrom:nil} {Name:NODE_INGEST Value:false ValueFrom:nil} {Name:PROCESSORS Value: ValueFrom:&EnvVarSource{FieldRef:nil,ResourceFieldRef:&ResourceFieldSelector{ContainerName:,Resource:limits.cpu,Divisor:0,},ConfigMapKeyRef:nil,SecretKeyRef:nil,}} {Name:ES_JAVA_OPTS Value:-Djava.net.preferIPv4Stack=true -Xms2048m -Xmx2048m -Djava.security.policy=/usr/share/elasticsearch/plugins/readonlyrest/plugin-security.policy -Des.allow_insecure_settings=true ValueFrom:nil}] Resources:{Limits:map[cpu:{i:{value:3 scale:0} d:{Dec:<nil>} s:3 Format:DecimalSI} memory:{i:{value:3221225472 scale:0} d:{Dec:<nil>} s:3Gi Format:BinarySI}] Requests:map[memory:{i:{value:1073741824 scale:0} d:{Dec:<nil>} s:1Gi Format:BinarySI} cpu:{i:{value:300 scale:-3} d:{Dec:<nil>} s:300m Format:DecimalSI}]} VolumeMounts:[{Name:config ReadOnly:false MountPath:/usr/share/elasticsearch/config/jvm.options SubPath:jvm.options MountPropagation:<nil>} {Name:plugindir ReadOnly:false MountPath:/usr/share/elasticsearch/plugins/ SubPath: MountPropagation:<nil>} {Name:elasticsearch-data ReadOnly:false MountPath:/usr/share/elasticsearch/data SubPath: MountPropagation:<nil>} {Name:config ReadOnly:false MountPath:/usr/share/elasticsearch/config/elasticsearch.yml SubPath:elasticsearch.yml MountPropagation:<nil>} {Name:config ReadOnly:false MountPath:/usr/share/elasticsearch/config/log4j2.properties SubPath:log4j2.properties MountPropagation:<nil>} {Name:configdir ReadOnly:false MountPath:/usr/share/elasticsearch/config/ SubPath: MountPropagation:<nil>} {Name:config ReadOnly:false MountPath:/pre-stop-hook.sh SubPath:pre-stop-hook.sh MountPropagation:<nil>} {Name:readonlyrest-config ReadOnly:false MountPath:/usr/share/elasticsearch/config/readonlyrest.yml SubPath:readonlyrest.yml MountPropagation:<nil>} {Name:consumer-elasticsearch-token-jw62f ReadOnly:true MountPath:/var/run/secrets/kubernetes.io/serviceaccount SubPath: MountPropagation:<nil>}] VolumeDevices:[] LivenessProbe:&Probe{Handler:Handler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/_cluster/health?local=true,Port:9200,Host:,Scheme:HTTP,HTTPHeaders:[],},TCPSocket:nil,},InitialDelaySeconds:60,TimeoutSeconds:2,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,} ReadinessProbe:&Probe{Handler:Handler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/_cluster/health?local=true,Port:9200,Host:,Scheme:HTTP,HTTPHeaders:[],},TCPSocket:nil,},InitialDelaySeconds:5,TimeoutSeconds:5,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,} Lifecycle:&Lifecycle{PostStart:nil,PreStop:&Handler{Exec:&ExecAction{Command:[/bin/bash /pre-stop-hook.sh],},HTTPGet:nil,TCPSocket:nil,},} TerminationMessagePath:/dev/termination-log TerminationMessagePolicy:File ImagePullPolicy:Always SecurityContext:nil Stdin:false StdinOnce:false TTY:false} is dead, but RestartPolicy says that we should restart it.
Jul 13 07:25:34 worker04 systemd[1]: Failed to set up mount unit: Invalid argument
Jul 13 07:25:34 worker04 systemd[1]: Failed to set up mount unit: Invalid argument
Jul 13 07:25:34 worker04 systemd[1]: Failed to set up mount unit: Invalid argument
Jul 13 07:25:34 worker04 systemd[1]: Failed to set up mount unit: Invalid argument
Jul 13 07:25:34 worker04 kubelet-wrapper[4753]: I0713 07:25:34.195471    4753 kubelet_resources.go:45] allocatable: map[hugepages-2Mi:{{0 0} {<nil>} 0 DecimalSI} memory:{{30408019968 0} {<nil>} 29695332Ki BinarySI} pods:{{110 0} {<nil>} 110 DecimalSI} cpu:{{3 0} {<nil>} 3 DecimalSI} ephemeral-storage:{{57690677972 0} {<nil>} 57690677972 DecimalSI}]
Jul 13 07:25:34 worker04 systemd[1]: Failed to set up mount unit: Invalid argument
Jul 13 07:25:34 worker04 systemd[1]: Failed to set up mount unit: Invalid argument
Jul 13 07:25:34 worker04 systemd[1]: Failed to set up mount unit: Invalid argument
Jul 13 07:25:34 worker04 systemd[1]: Failed to set up mount unit: Invalid argument
Jul 13 07:25:34 worker04 systemd[1]: Failed to set up mount unit: Invalid argument
Jul 13 07:25:34 worker04 systemd[1]: Failed to set up mount unit: Invalid argument
Jul 13 07:25:34 worker04 systemd[1]: Failed to set up mount unit: Invalid argument
Jul 13 07:25:34 worker04 systemd[1]: Failed to set up mount unit: Invalid argument
Jul 13 07:25:34 worker04 systemd[1]: Failed to set up mount unit: Invalid argument
Jul 13 07:25:34 worker04 systemd[1]: Failed to set up mount unit: Invalid argument
Jul 13 07:25:34 worker04 systemd[1]: Failed to set up mount unit: Invalid argument
Jul 13 07:25:34 worker04 systemd[1]: Failed to set up mount unit: Invalid argument
Jul 13 07:25:34 worker04 systemd[1]: Failed to set up mount unit: Invalid argument
Jul 13 07:25:34 worker04 systemd[1]: Failed to set up mount unit: Invalid argument
Jul 13 07:25:34 worker04 systemd[1]: Failed to set up mount unit: Invalid argument
Jul 13 07:25:34 worker04 systemd[1]: Failed to set up mount unit: Invalid argument
Jul 13 07:25:34 worker04 systemd[1]: Failed to set up mount unit: Invalid argument
Jul 13 07:25:34 worker04 systemd[1]: Failed to set up mount unit: Invalid argument
Jul 13 07:25:34 worker04 systemd[1]: Failed to set up mount unit: Invalid argument
Jul 13 07:25:34 worker04 systemd[1]: Failed to set up mount unit: Invalid argument
Jul 13 07:25:34 worker04 systemd[1]: Failed to set up mount unit: Invalid argument
Jul 13 07:25:34 worker04 systemd[1]: Failed to set up mount unit: Invalid argument
Jul 13 07:25:34 worker04 systemd[1]: Failed to set up mount unit: Invalid argument
Jul 13 07:25:34 worker04 systemd[1]: Failed to set up mount unit: Invalid argument
Jul 13 07:25:34 worker04 systemd[1]: Failed to set up mount unit: Invalid argument
Jul 13 07:25:34 worker04 systemd[1]: Failed to set up mount unit: Invalid argument
Jul 13 07:25:34 worker04 systemd[1]: Failed to set up mount unit: Invalid argument
Jul 13 07:25:34 worker04 systemd[1]: Failed to set up mount unit: Invalid argument
Jul 13 07:25:34 worker04 systemd[1]: Failed to set up mount unit: Invalid argument
Jul 13 07:25:34 worker04 systemd[1]: Failed to set up mount unit: Invalid argument
Jul 13 07:25:34 worker04 env[818]: time="2018-07-13T07:25:34Z" level=info msg="shim containerd-shim started" address="/containerd-shim/moby/a244c1b973155b822a7ee2faee65403941fd9e8f2f87c53e5b55cef35a8ea171/shim.sock" debug=true module="containerd/tasks" pid=25450
Jul 13 07:25:34 worker04 env[818]: time="2018-07-13T07:25:34Z" level=debug msg="registering ttrpc server"
Jul 13 07:25:34 worker04 env[818]: time="2018-07-13T07:25:34Z" level=debug msg="serving api on unix socket" socket="[inherited from parent]"
Jul 13 07:25:34 worker04 systemd[1]: Failed to set up mount unit: Invalid argument
Jul 13 07:25:34 worker04 systemd[1]: Failed to set up mount unit: Invalid argument
Jul 13 07:25:34 worker04 systemd[1]: Failed to set up mount unit: Invalid argument
Jul 13 07:25:34 worker04 systemd[1]: Failed to set up mount unit: Invalid argument
Jul 13 07:25:34 worker04 systemd[1]: Failed to set up mount unit: Invalid argument
Jul 13 07:25:34 worker04 systemd[1]: Failed to set up mount unit: Invalid argument
Jul 13 07:25:34 worker04 systemd[1]: Failed to set up mount unit: Invalid argument
Jul 13 07:25:34 worker04 systemd[1]: Failed to set up mount unit: Invalid argument
Jul 13 07:25:34 worker04 systemd[1]: Failed to set up mount unit: Invalid argument
Jul 13 07:25:34 worker04 systemd[1]: Failed to set up mount unit: Invalid argument
Jul 13 07:25:34 worker04 systemd[1]: Failed to set up mount unit: Invalid argument
Jul 13 07:25:34 worker04 systemd[1]: Failed to set up mount unit: Invalid argument
Jul 13 07:25:34 worker04 systemd[1]: Failed to set up mount unit: Invalid argument
Jul 13 07:25:34 worker04 systemd[1]: Failed to set up mount unit: Invalid argument
Jul 13 07:25:34 worker04 systemd[1]: Failed to set up mount unit: Invalid argument
Jul 13 07:25:34 worker04 systemd[1]: Failed to set up mount unit: Invalid argument
Jul 13 07:25:34 worker04 systemd[1]: Failed to set up mount unit: Invalid argument
Jul 13 07:25:35 worker04 kubelet-wrapper[4753]: E0713 07:25:35.966790    4753 kubelet_volumes.go:140] Orphaned pod "4d103385-8660-11e8-9f7f-005056b0125b" found, but volume paths are still present on disk : There were a total of 1 errors similar to this. Turn up verbosity to see them.
Jul 13 07:25:37 worker04 kubelet-wrapper[4753]: E0713 07:25:37.974457    4753 kubelet_volumes.go:140] Orphaned pod "4d103385-8660-11e8-9f7f-005056b0125b" found, but volume paths are still present on disk : There were a total of 1 errors similar to this. Turn up verbosity to see them.
Jul 13 07:25:39 worker04 kubelet-wrapper[4753]: E0713 07:25:39.919921    4753 kubelet_volumes.go:140] Orphaned pod "4d103385-8660-11e8-9f7f-005056b0125b" found, but volume paths are still present on disk : There were a total of 1 errors similar to this. Turn up verbosity to see them.
Jul 13 07:25:41 worker04 kubelet-wrapper[4753]: E0713 07:25:41.948075    4753 kubelet_volumes.go:140] Orphaned pod "4d103385-8660-11e8-9f7f-005056b0125b" found, but volume paths are still present on disk : There were a total of 1 errors similar to this. Turn up verbosity to see them.
Jul 13 07:25:43 worker04 kubelet-wrapper[4753]: E0713 07:25:43.920534    4753 kubelet_volumes.go:140] Orphaned pod "4d103385-8660-11e8-9f7f-005056b0125b" found, but volume paths are still present on disk : There were a total of 1 errors similar to this. Turn up verbosity to see them.
Jul 13 07:25:45 worker04 kubelet-wrapper[4753]: E0713 07:25:45.940356    4753 kubelet_volumes.go:140] Orphaned pod "4d103385-8660-11e8-9f7f-005056b0125b" found, but volume paths are still present on disk : There were a total of 1 errors similar to this. Turn up verbosity to see them.
Jul 13 07:25:47 worker04 kubelet-wrapper[4753]: E0713 07:25:47.941352    4753 kubelet_volumes.go:140] Orphaned pod "4d103385-8660-11e8-9f7f-005056b0125b" found, but volume paths are still present on disk : There were a total of 1 errors similar to this. Turn up verbosity to see them.
Jul 13 07:25:49 worker04 kubelet-wrapper[4753]: E0713 07:25:49.916292    4753 kubelet_volumes.go:140] Orphaned pod "4d103385-8660-11e8-9f7f-005056b0125b" found, but volume paths are still present on disk : There were a total of 1 errors similar to this. Turn up verbosity to see them.
Jul 13 07:25:51 worker04 kubelet-wrapper[4753]: E0713 07:25:51.940370    4753 kubelet_volumes.go:140] Orphaned pod "4d103385-8660-11e8-9f7f-005056b0125b" found, but volume paths are still present on disk : There were a total of 1 errors similar to this. Turn up verbosity to see them.
Jul 13 07:25:53 worker04 kubelet-wrapper[4753]: E0713 07:25:53.971141    4753 kubelet_volumes.go:140] Orphaned pod "4d103385-8660-11e8-9f7f-005056b0125b" found, but volume paths are still present on disk : There were a total of 1 errors similar to this. Turn up verbosity to see them.
Jul 13 07:25:55 worker04 kubelet-wrapper[4753]: E0713 07:25:55.918097    4753 kubelet_volumes.go:140] Orphaned pod "4d103385-8660-11e8-9f7f-005056b0125b" found, but volume paths are still present on disk : There were a total of 1 errors similar to this. Turn up verbosity to see them.
Jul 13 07:25:57 worker04 kubelet-wrapper[4753]: E0713 07:25:57.926373    4753 kubelet_volumes.go:140] Orphaned pod "4d103385-8660-11e8-9f7f-005056b0125b" found, but volume paths are still present on disk : There were a total of 1 errors similar to this. Turn up verbosity to see them.
Jul 13 07:25:58 worker04 docker[3885]: 2018/07/13 07:25:58.082215 metrics.go:39: INFO Non-zero metrics in the last 30s: libbeat.logstash.call_count.PublishEvents=16 libbeat.logstash.publish.read_bytes=96 libbeat.logstash.publish.write_bytes=33892 libbeat.logstash.published_and_acked_events=164 libbeat.publisher.messages_in_worker_queues=164 libbeat.publisher.published_events=164
Jul 13 07:25:59 worker04 kubelet-wrapper[4753]: E0713 07:25:59.940519    4753 kubelet_volumes.go:140] Orphaned pod "4d103385-8660-11e8-9f7f-005056b0125b" found, but volume paths are still present on disk : There were a total of 1 errors similar to this. Turn up verbosity to see them.
Jul 13 07:26:01 worker04 kubelet-wrapper[4753]: E0713 07:26:01.913381    4753 kubelet_volumes.go:140] Orphaned pod "4d103385-8660-11e8-9f7f-005056b0125b" found, but volume paths are still present on disk : There were a total of 1 errors similar to this. Turn up verbosity to see them.
Jul 13 07:26:03 worker04 kubelet-wrapper[4753]: E0713 07:26:03.952084    4753 kubelet_volumes.go:140] Orphaned pod "4d103385-8660-11e8-9f7f-005056b0125b" found, but volume paths are still present on disk : There were a total of 1 errors similar to this. Turn up verbosity to see them.
Jul 13 07:26:05 worker04 kubelet-wrapper[4753]: E0713 07:26:05.940326    4753 kubelet_volumes.go:140] Orphaned pod "4d103385-8660-11e8-9f7f-005056b0125b" found, but volume paths are still present on disk : There were a total of 1 errors similar to this. Turn up verbosity to see them.
Jul 13 07:26:07 worker04 kubelet-wrapper[4753]: E0713 07:26:07.917470    4753 kubelet_volumes.go:140] Orphaned pod "4d103385-8660-11e8-9f7f-005056b0125b" found, but volume paths are still present on disk : There were a total of 1 errors similar to this. Turn up verbosity to see them.
Jul 13 07:26:10 worker04 kubelet-wrapper[4753]: E0713 07:26:10.015543    4753 kubelet_volumes.go:140] Orphaned pod "4d103385-8660-11e8-9f7f-005056b0125b" found, but volume paths are still present on disk : There were a total of 1 errors similar to this. Turn up verbosity to see them.
Jul 13 07:26:11 worker04 kubelet-wrapper[4753]: E0713 07:26:11.950491    4753 kubelet_volumes.go:140] Orphaned pod "4d103385-8660-11e8-9f7f-005056b0125b" found, but volume paths are still present on disk : There were a total of 1 errors similar to this. Turn up verbosity to see them.
Jul 13 07:26:13 worker04 kubelet-wrapper[4753]: E0713 07:26:13.988248    4753 kubelet_volumes.go:140] Orphaned pod "4d103385-8660-11e8-9f7f-005056b0125b" found, but volume paths are still present on disk : There were a total of 1 errors similar to this. Turn up verbosity to see them.
Jul 13 07:26:15 worker04 kubelet-wrapper[4753]: E0713 07:26:15.993175    4753 kubelet_volumes.go:140] Orphaned pod "4d103385-8660-11e8-9f7f-005056b0125b" found, but volume paths are still present on disk : There were a total of 1 errors similar to this. Turn up verbosity to see them.
Jul 13 07:26:17 worker04 kubelet-wrapper[4753]: E0713 07:26:17.936447    4753 kubelet_volumes.go:140] Orphaned pod "4d103385-8660-11e8-9f7f-005056b0125b" found, but volume paths are still present on disk : There were a total of 1 errors similar to this. Turn up verbosity to see them.
Jul 13 07:26:19 worker04 kubelet-wrapper[4753]: E0713 07:26:19.958226    4753 kubelet_volumes.go:140] Orphaned pod "4d103385-8660-11e8-9f7f-005056b0125b" found, but volume paths are still present on disk : There were a total of 1 errors similar to this. Turn up verbosity to see them.
Jul 13 07:26:21 worker04 kubelet-wrapper[4753]: E0713 07:26:21.952547    4753 kubelet_volumes.go:140] Orphaned pod "4d103385-8660-11e8-9f7f-005056b0125b" found, but volume paths are still present on disk : There were a total of 1 errors similar to this. Turn up verbosity to see them.
Jul 13 07:26:23 worker04 kubelet-wrapper[4753]: E0713 07:26:23.938714    4753 kubelet_volumes.go:140] Orphaned pod "4d103385-8660-11e8-9f7f-005056b0125b" found, but volume paths are still present on disk : There were a total of 1 errors similar to this. Turn up verbosity to see them.
Jul 13 07:26:25 worker04 kubelet-wrapper[4753]: E0713 07:26:25.916586    4753 kubelet_volumes.go:140] Orphaned pod "4d103385-8660-11e8-9f7f-005056b0125b" found, but volume paths are still present on disk : There were a total of 1 errors similar to this. Turn up verbosity to see them.
Jul 13 07:26:27 worker04 kubelet-wrapper[4753]: E0713 07:26:27.940500    4753 kubelet_volumes.go:140] Orphaned pod "4d103385-8660-11e8-9f7f-005056b0125b" found, but volume paths are still present on disk : There were a total of 1 errors similar to this. Turn up verbosity to see them.
Jul 13 07:26:28 worker04 docker[3885]: 2018/07/13 07:26:28.082254 metrics.go:39: INFO Non-zero metrics in the last 30s: libbeat.logstash.call_count.PublishEvents=15 libbeat.logstash.publish.read_bytes=90 libbeat.logstash.publish.write_bytes=15281 libbeat.logstash.published_and_acked_events=16 libbeat.publisher.messages_in_worker_queues=16 libbeat.publisher.published_events=16
Jul 13 07:26:29 worker04 kubelet-wrapper[4753]: E0713 07:26:29.952328    4753 kubelet_volumes.go:140] Orphaned pod "4d103385-8660-11e8-9f7f-005056b0125b" found, but volume paths are still present on disk : There were a total of 1 errors similar to this. Turn up verbosity to see them.
Jul 13 07:26:31 worker04 kubelet-wrapper[4753]: E0713 07:26:31.956634    4753 kubelet_volumes.go:140] Orphaned pod "4d103385-8660-11e8-9f7f-005056b0125b" found, but volume paths are still present on disk : There were a total of 1 errors similar to this. Turn up verbosity to see them.
Jul 13 07:26:33 worker04 kubelet-wrapper[4753]: E0713 07:26:33.942164    4753 kubelet_volumes.go:140] Orphaned pod "4d103385-8660-11e8-9f7f-005056b0125b" found, but volume paths are still present on disk : There were a total of 1 errors similar to this. Turn up verbosity to see them.
Jul 13 07:26:35 worker04 kubelet-wrapper[4753]: E0713 07:26:35.919301    4753 kubelet_volumes.go:140] Orphaned pod "4d103385-8660-11e8-9f7f-005056b0125b" found, but volume paths are still present on disk : There were a total of 1 errors similar to this. Turn up verbosity to see them.
Jul 13 07:26:37 worker04 kubelet-wrapper[4753]: E0713 07:26:37.941291    4753 kubelet_volumes.go:140] Orphaned pod "4d103385-8660-11e8-9f7f-005056b0125b" found, but volume paths are still present on disk : There were a total of 1 errors similar to this. Turn up verbosity to see them.
Jul 13 07:26:39 worker04 kubelet-wrapper[4753]: E0713 07:26:39.955901    4753 kubelet_volumes.go:140] Orphaned pod "4d103385-8660-11e8-9f7f-005056b0125b" found, but volume paths are still present on disk : There were a total of 1 errors similar to this. Turn up verbosity to see them.
Jul 13 07:26:41 worker04 kubelet-wrapper[4753]: E0713 07:26:41.916021    4753 kubelet_volumes.go:140] Orphaned pod "4d103385-8660-11e8-9f7f-005056b0125b" found, but volume paths are still present on disk : There were a total of 1 errors similar to this. Turn up verbosity to see them.
Jul 13 07:26:43 worker04 kubelet-wrapper[4753]: E0713 07:26:43.945704    4753 kubelet_volumes.go:140] Orphaned pod "4d103385-8660-11e8-9f7f-005056b0125b" found, but volume paths are still present on disk : There were a total of 1 errors similar to this. Turn up verbosity to see them.
Jul 13 07:26:45 worker04 kubelet-wrapper[4753]: E0713 07:26:45.960003    4753 kubelet_volumes.go:140] Orphaned pod "4d103385-8660-11e8-9f7f-005056b0125b" found, but volume paths are still present on disk : There were a total of 1 errors similar to this. Turn up verbosity to see them.
Jul 13 07:26:47 worker04 kubelet-wrapper[4753]: E0713 07:26:47.917453    4753 kubelet_volumes.go:140] Orphaned pod "4d103385-8660-11e8-9f7f-005056b0125b" found, but volume paths are still present on disk : There were a total of 1 errors similar to this. Turn up verbosity to see them.
Jul 13 07:26:49 worker04 kubelet-wrapper[4753]: E0713 07:26:49.949096    4753 kubelet_volumes.go:140] Orphaned pod "4d103385-8660-11e8-9f7f-005056b0125b" found, but volume paths are still present on disk : There were a total of 1 errors similar to this. Turn up verbosity to see them.
Jul 13 07:26:51 worker04 kubelet-wrapper[4753]: E0713 07:26:51.949435    4753 kubelet_volumes.go:140] Orphaned pod "4d103385-8660-11e8-9f7f-005056b0125b" found, but volume paths are still present on disk : There were a total of 1 errors similar to this. Turn up verbosity to see them.
Jul 13 07:26:53 worker04 kubelet-wrapper[4753]: E0713 07:26:53.942728    4753 kubelet_volumes.go:140] Orphaned pod "4d103385-8660-11e8-9f7f-005056b0125b" found, but volume paths are still present on disk : There were a total of 1 errors similar to this. Turn up verbosity to see them.
Jul 13 07:26:55 worker04 kubelet-wrapper[4753]: E0713 07:26:55.914661    4753 kubelet_volumes.go:140] Orphaned pod "4d103385-8660-11e8-9f7f-005056b0125b" found, but volume paths are still present on disk : There were a total of 1 errors similar to this. Turn up verbosity to see them.
Jul 13 07:26:57 worker04 kubelet-wrapper[4753]: E0713 07:26:57.922337    4753 kubelet_volumes.go:140] Orphaned pod "4d103385-8660-11e8-9f7f-005056b0125b" found, but volume paths are still present on disk : There were a total of 1 errors similar to this. Turn up verbosity to see them.
-- Reboot --
Jul 13 07:27:47 localhost kernel: Linux version 4.14.48-coreos-r2 (jenkins@ip-10-7-32-103) (gcc version 7.3.0 (Gentoo Hardened 7.3.0 p1.0)) #1 SMP Thu Jun 14 08:23:03 UTC 2018
Jul 13 07:27:47 localhost kernel: Command line: BOOT_IMAGE=/coreos/vmlinuz-a mount.usr=/dev/mapper/usr verity.usr=PARTUUID=7130c94a-213a-4e5a-8e26-6cce9662f132 rootflags=rw mount.usrflags=ro consoleblank=0 root=LABEL=ROOT console=ttyS0,115200n8 console=tty0 coreos.oem.id=vmware verity.usrhash=40d5ccdbb27a1b659fe84a6da8a68277bf53927d2939c947df896362dc915ec8
Jul 13 07:27:47 localhost kernel: Disabled fast string operations
Jul 13 07:27:47 localhost kernel: x86/fpu: x87 FPU will use FXSAVE
Jul 13 07:27:47 localhost kernel: e820: BIOS-provided physical RAM map:
Jul 13 07:27:47 localhost kernel: BIOS-e820: [mem 0x0000000000000000-0x000000000009f7ff] usable
Jul 13 07:27:47 localhost kernel: BIOS-e820: [mem 0x000000000009f800-0x000000000009ffff] reserved
Jul 13 07:27:47 localhost kernel: BIOS-e820: [mem 0x00000000000dc000-0x00000000000fffff] reserved
Jul 13 07:27:47 localhost kernel: BIOS-e820: [mem 0x0000000000100000-0x00000000bfeeffff] usable
Jul 13 07:27:47 localhost kernel: BIOS-e820: [mem 0x00000000bfef0000-0x00000000bfefefff] ACPI data
Jul 13 07:27:47 localhost kernel: BIOS-e820: [mem 0x00000000bfeff000-0x00000000bfefffff] ACPI NVS
Jul 13 07:27:47 localhost kernel: BIOS-e820: [mem 0x00000000bff00000-0x00000000bfffffff] usable
Jul 13 07:27:47 localhost kernel: BIOS-e820: [mem 0x00000000e8000000-0x00000000efffffff] reserved
Jul 13 07:27:47 localhost kernel: BIOS-e820: [mem 0x00000000fec00000-0x00000000fec0ffff] reserved
Jul 13 07:27:47 localhost kernel: BIOS-e820: [mem 0x00000000fee00000-0x00000000fee00fff] reserved
Jul 13 07:27:47 localhost kernel: BIOS-e820: [mem 0x00000000fffe0000-0x00000000ffffffff] reserved
Jul 13 07:27:47 localhost kernel: BIOS-e820: [mem 0x0000000100000000-0x000000083fffffff] usable
@redbaron

This comment has been minimized.

Show comment
Hide comment
@redbaron

redbaron Jul 18, 2018

linux reboots on panic, check sysctl kernel.panic set it to something like 1800 to stay up for 30 mins, so that you can catch that node is not available and check error shown on the vmware console

redbaron commented Jul 18, 2018

linux reboots on panic, check sysctl kernel.panic set it to something like 1800 to stay up for 30 mins, so that you can catch that node is not available and check error shown on the vmware console

@lucab

This comment has been minimized.

Show comment
Hide comment
@lucab

lucab Jul 26, 2018

Member

If this a kernel panic, pstore may contain some crash logs. See https://coreos.com/os/docs/latest/collecting-crash-logs.html and let us know if there is anything relevant there. I didn't spot anything interesting from your logs above.

Member

lucab commented Jul 26, 2018

If this a kernel panic, pstore may contain some crash logs. See https://coreos.com/os/docs/latest/collecting-crash-logs.html and let us know if there is anything relevant there. I didn't spot anything interesting from your logs above.

@encodeflush

This comment has been minimized.

Show comment
Hide comment
@encodeflush

encodeflush Aug 2, 2018

Here are crash logs from 2 k8s workers.

[243340.078539] Kernel Offset: 0xd000000 from 0xffffffff81000000 (relocation range: 0xffffffff80000000-0xffffffffbfffffff)
[243339.572050] R13: 0000000000000018 R14: 0000000000000011 R15: 0000000000000002
[243339.571353] R10: 00005613b7f73d60 R11: 0000000000000246 R12: 0000000000000001
[243339.570638] RBP: 00005613b7f73c80 R08: 000000002d68616d R09: 00007ffcd0546d90
[243339.569925] RDX: 00005613b7f73d40 RSI: 0000000000000001 RDI: 0000000000000001
[243339.569214] RAX: ffffffffffffffda RBX: 00005613b7f73d40 RCX: 00007f915f2adb59
[243339.568503] RSP: 002b:00007ffcd0546d28 EFLAGS: 00000246 ORIG_RAX: 000000000000013d
[243339.567871] RIP: 0033:0x7f915f2adb59
[243339.567205]  entry_SYSCALL_64_after_hwframe+0x3d/0xa2
[243339.566552]  do_syscall_64+0x67/0x120
[243339.565903]  do_seccomp+0x285/0x6c0
[243339.565217]  ? hardlockup_detector_perf_cleanup+0x80/0x80
[243339.564551]  bpf_prog_create_from_user+0xb0/0x110
[243339.563911]  ? kmemdup+0x2d/0x40
[243339.563253]  bpf_prepare_filter+0x2f0/0x3d0
[243339.562584]  bpf_prog_select_runtime+0x4e/0xe0
[243339.561934]  set_memory_ro+0x26/0x30
[243339.561271]  ? bpf_convert_filter+0x9e4/0xa50
[243339.560601]  change_page_attr_set_clr+0x2b3/0x470
[243339.559946]  vm_unmap_aliases+0xe9/0x120
[243339.559278]  __purge_vmap_area_lazy+0x4d/0xc0
[243339.558609]  flush_tlb_kernel_range+0x48/0x90
[243339.557962]  on_each_cpu+0x28/0x60
[243339.557306]  ? load_new_mm_cr3+0xe0/0xe0
[243339.556637]  ? smp_call_function_many+0x209/0x250
[243339.555976]  ? load_new_mm_cr3+0xe0/0xe0
[243339.555270] R13: 0000000000000200 R14: ffffffff8e06c7e0 R15: 0000000000000000
[243339.554569] R10: ffff93817fca2448 R11: 0000000000000008 R12: ffff93817fca2448
[243339.553862] RBP: ffff93817fca2488 R08: ffffffffffffffff R09: 000000000000000d
[243339.553151] RDX: ffff93817fc26180 RSI: 0000000000000000 RDI: ffff93817fca2448
[243339.552434] RAX: 0000000000000000 RBX: ffff93817fca2440 RCX: 0000000000000001
[243339.551715] RSP: 0018:ffffa97a07cffc88 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff10
[243339.551042] RIP: 0010:smp_call_function_many+0x22d/0x250
[243339.550425]  </IRQ>
[243339.549766]  apic_timer_interrupt+0x7d/0x90
[243339.549086]  smp_apic_timer_interrupt+0x66/0x120
[243339.548415]  hrtimer_interrupt+0xa6/0x1f0
[243339.547735]  __hrtimer_run_queues+0xde/0x230
[243339.547062]  ? watchdog+0x30/0x30
[243339.546357]  watchdog_timer_fn+0x20e/0x220
[243339.545652]  panic+0xe4/0x252
[243339.544924]  dump_stack+0x5c/0x85
[243339.544214]  <IRQ>
[243339.543472] Call Trace:
[243339.541830] Hardware name: VMware, Inc. VMware7,1/440BX Desktop Reference Platform, BIOS VMW71.00V.0.B64.1801120748 01/12/2018
[243339.540952] CPU: 1 PID: 565 Comm: runc:[2:INIT] Tainted: G             L  4.14.48-coreos-r2 #1
[243339.540111] Kernel panic - not syncing: softlockup: hung tasks
[243339.538262] Code: 89 c7 e8 37 cf 4f 00 3b 05 85 c5 21 01 0f 83 57 fe ff ff 48 63 c8 48 8b 13 48 03 14 cd 80 26 00 8f 8b 4a 18 83 e1 01 74 0a f3 90 <8b> 4a 18 83 e1 01 75 f6 eb c8 48 c7 c2 e0 79 31 8f 48 89 ee 89 
[243339.537396] R13: 0000000000000018 R14: 0000000000000011 R15: 0000000000000002
[243339.536528] R10: 00005613b7f73d60 R11: 0000000000000246 R12: 0000000000000001
[243339.535658] RBP: 00005613b7f73c80 R08: 000000002d68616d R09: 00007ffcd0546d90
[243339.534782] RDX: 00005613b7f73d40 RSI: 0000000000000001 RDI: 0000000000000001
[243339.533906] RAX: ffffffffffffffda RBX: 00005613b7f73d40 RCX: 00007f915f2adb59
[243339.533030] RSP: 002b:00007ffcd0546d28 EFLAGS: 00000246 ORIG_RAX: 000000000000013d
[243339.532231] RIP: 0033:0x7f915f2adb59
[243339.531394]  entry_SYSCALL_64_after_hwframe+0x3d/0xa2
[243339.530585]  do_syscall_64+0x67/0x120
[243339.529765]  do_seccomp+0x285/0x6c0
[243339.528900]  ? hardlockup_detector_perf_cleanup+0x80/0x80
[243339.528050]  bpf_prog_create_from_user+0xb0/0x110
[243339.527217]  ? kmemdup+0x2d/0x40
[243339.526365]  bpf_prepare_filter+0x2f0/0x3d0
[243339.525504]  bpf_prog_select_runtime+0x4e/0xe0
[243339.524648]  set_memory_ro+0x26/0x30
[243339.523772]  ? bpf_convert_filter+0x9e4/0xa50
[243339.522572]  change_page_attr_set_clr+0x2b3/0x470
[243339.521153]  vm_unmap_aliases+0xe9/0x120
[243339.521035]  __purge_vmap_area_lazy+0x4d/0xc0
[243339.520916]  flush_tlb_kernel_range+0x48/0x90
[243339.520815]  on_each_cpu+0x28/0x60
[243339.520705]  ? load_new_mm_cr3+0xe0/0xe0
[243339.520615] Call Trace:
[243339.520398] CR2: 00005613b8017008 CR3: 00000007073fa003 CR4: 00000000000606e0
[243339.520258] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[243339.520075] FS:  00007f915fdf5e80(0000) GS:ffff93817fc80000(0000) knlGS:0000000000000000
[243339.519909] R13: 0000000000000200 R14: ffffffff8e06c7e0 R15: 0000000000000000
[243339.519743] R10: ffff93817fca2448 R11: 0000000000000008 R12: ffff93817fca2448
[243339.519573] RBP: ffff93817fca2488 R08: ffffffffffffffff R09: 000000000000000d
[243339.519407] RDX: ffff93817fc26180 RSI: 0000000000000000 RDI: ffff93817fca2448
[243339.519241] RAX: 0000000000000000 RBX: ffff93817fca2440 RCX: 0000000000000001
[243339.519067] RSP: 0018:ffffa97a07cffc88 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff10
[243339.518934] RIP: 0010:smp_call_function_many+0x22d/0x250
[243339.518784] task: ffff938067d90000 task.stack: ffffa97a07cfc000
[243339.518511] Hardware name: VMware, Inc. VMware7,1/440BX Desktop Reference Platform, BIOS VMW71.00V.0.B64.1801120748 01/12/2018
[243339.518340] CPU: 1 PID: 565 Comm: runc:[2:INIT] Not tainted 4.14.48-coreos-r2 #1
[243339.518168]  vmxnet3 scsi_mod dm_mirror dm_region_hash dm_log dm_mod dax
[243339.516599] Modules linked in: xt_statistic xt_nat xt_recent ipt_REJECT nf_reject_ipv4 ip_set veth xt_comment xt_mark cmac arc4 ecb md4 nls_utf8 cifs ccm fscache nf_conntrack_netlink nfnetlink xfrm_user xfrm_algo xt_addrtype xt_conntrack br_netfilter bridge stp llc iptable_filter ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack libcrc32c vxlan ip6_udp_tunnel udp_tunnel overlay vmw_vsock_vmci_transport vsock nls_ascii nls_cp437 vfat fat mousedev vmw_balloon evdev efi_pstore sb_edac edac_core psmouse efivars i2c_piix4 vmw_vmci i2c_core button sch_fq_codel ext4 crc32c_generic crc16 mbcache jbd2 fscrypto dm_verity dm_bufio sr_mod cdrom sd_mod crc32c_intel aesni_intel aes_x86_64 crypto_simd cryptd glue_helper ata_piix libata vmw_pvscsi
[243339.516362] watchdog: BUG: soft lockup - CPU#1 stuck for 22s! [runc:[2:INIT]:565]
[243314.155852] docker0: port 22(veth5c9e11d) entered forwarding state
[243314.155708] docker0: port 22(veth5c9e11d) entered blocking state
[243314.155497] IPv6: ADDRCONF(NETDEV_UP): veth5c9e11d: link is not ready
[243314.142862] device veth5c9e11d entered promiscuous mode
[243314.142676] docker0: port 22(veth5c9e11d) entered disabled state
[243314.142511] docker0: port 22(veth5c9e11d) entered blocking state
[243313.934229] IPv6: ADDRCONF(NETDEV_UP): veth5649440: link is not ready
[243313.934030] device veth5649440 entered promiscuous mode
[243313.933826] docker0: port 21(veth5649440) entered disabled state
[243313.933625] docker0: port 21(veth5649440) entered blocking state
[243287.850288] docker0: port 20(veth648577f) entered forwarding state
[243287.850142] docker0: port 20(veth648577f) entered blocking state
[243287.849929] IPv6: ADDRCONF(NETDEV_CHANGE): veth648577f: link becomes ready
[243287.845609] eth0: renamed from veth6eb2c07
[243287.622664] docker0: port 20(veth648577f) entered disabled state
[243287.575228] docker0: port 20(veth648577f) entered forwarding state
[243287.575085] docker0: port 20(veth648577f) entered blocking state
[243287.574922] IPv6: ADDRCONF(NETDEV_UP): veth648577f: link is not ready
[243287.574705] device veth648577f entered promiscuous mode
[243287.574497] docker0: port 20(veth648577f) entered disabled state
[243287.574296] docker0: port 20(veth648577f) entered blocking state
[243286.825205] docker0: port 19(veth326c558) entered forwarding state
[243286.825058] docker0: port 19(veth326c558) entered blocking state
[243286.824834] IPv6: ADDRCONF(NETDEV_CHANGE): veth326c558: link becomes ready
[243286.818919] eth0: renamed from vethf09c996
[243286.622676] IPv6: ADDRCONF(NETDEV_UP): veth326c558: link is not ready
[243286.622603] device veth326c558 entered promiscuous mode
[243286.622566] docker0: port 19(veth326c558) entered disabled state
[243286.622563] docker0: port 19(veth326c558) entered blocking state
[243285.820185] docker0: port 18(vethc96923d) entered forwarding state
[243285.820039] docker0: port 18(vethc96923d) entered blocking state
[243285.819845] IPv6: ADDRCONF(NETDEV_CHANGE): vethc96923d: link becomes ready
[243285.811155] eth0: renamed from vethf63159b
[243285.548340] IPv6: ADDRCONF(NETDEV_UP): vethc96923d: link is not ready
[243285.548142] device vethc96923d entered promiscuous mode
[243285.547954] docker0: port 18(vethc96923d) entered disabled state
[243285.547747] docker0: port 18(vethc96923d) entered blocking state
[243285.219237] IPv6: ADDRCONF(NETDEV_CHANGE): veth19e8417: link becomes ready
[243285.214354] eth0: renamed from veth61ef1d1
[243284.952588] docker0: port 17(veth19e8417) entered forwarding state
[243284.952446] docker0: port 17(veth19e8417) entered blocking state
[243284.952288] IPv6: ADDRCONF(NETDEV_UP): veth19e8417: link is not ready
[243284.951578] device veth19e8417 entered promiscuous mode
[243284.951384] docker0: port 17(veth19e8417) entered disabled state
[243284.951194] docker0: port 17(veth19e8417) entered blocking state
[243284.642209] docker0: port 16(vethe9dce91) entered forwarding state
[243284.642064] docker0: port 16(vethe9dce91) entered blocking state
[243284.641860] IPv6: ADDRCONF(NETDEV_CHANGE): vethe9dce91: link becomes ready
[243284.635451] eth0: renamed from veth1d107e7
[243284.313154] IPv6: ADDRCONF(NETDEV_UP): vethe9dce91: link is not ready
[243284.307464] device vethe9dce91 entered promiscuous mode
[243284.307279] docker0: port 16(vethe9dce91) entered disabled state
[243284.307082] docker0: port 16(vethe9dce91) entered blocking state
[243283.292908] IPv6: ADDRCONF(NETDEV_CHANGE): veth3e2e545: link becomes ready
[243283.282044] eth0: renamed from veth92a96d2
[243283.005249] docker0: port 15(veth3e2e545) entered forwarding state
[243283.005105] docker0: port 15(veth3e2e545) entered blocking state
[243283.004950] IPv6: ADDRCONF(NETDEV_UP): veth3e2e545: link is not ready
[243283.004754] device veth3e2e545 entered promiscuous mode
[243283.004546] docker0: port 15(veth3e2e545) entered disabled state
[243283.004344] docker0: port 15(veth3e2e545) entered blocking state
[243282.735695] docker0: port 14(veth33a44ac) entered forwarding state
[243282.735532] docker0: port 14(veth33a44ac) entered blocking state
[243282.735299] IPv6: ADDRCONF(NETDEV_CHANGE): veth33a44ac: link becomes ready
[243282.723449] eth0: renamed from veth0095a17
[243282.498760] IPv6: ADDRCONF(NETDEV_UP): veth33a44ac: link is not ready
[243282.497027] device veth33a44ac entered promiscuous mode
[243282.496838] docker0: port 14(veth33a44ac) entered disabled state
[243282.496630] docker0: port 14(veth33a44ac) entered blocking state
[243281.543868] IPv6: ADDRCONF(NETDEV_CHANGE): vethada3c75: link becomes ready
[243281.538780] eth0: renamed from veth630c5e0
[243281.267890] docker0: port 13(vethada3c75) entered forwarding state
[243281.267745] docker0: port 13(vethada3c75) entered blocking state
[243281.267576] IPv6: ADDRCONF(NETDEV_UP): vethada3c75: link is not ready
[243281.267369] device vethada3c75 entered promiscuous mode
[243281.265912] docker0: port 13(vethada3c75) entered disabled state
[243281.265713] docker0: port 13(vethada3c75) entered blocking state
[243281.032627] docker0: port 12(veth3690d19) entered forwarding state
[243281.032478] docker0: port 12(veth3690d19) entered blocking state
[243281.032105] IPv6: ADDRCONF(NETDEV_CHANGE): veth3690d19: link becomes ready
[243281.026133] eth0: renamed from vetha2a977a
[243280.934437] docker0: port 11(veth7836875) entered forwarding state
[243280.934291] docker0: port 11(veth7836875) entered blocking state
[243280.934098] IPv6: ADDRCONF(NETDEV_CHANGE): veth7836875: link becomes ready
[243280.933890] docker0: port 12(veth3690d19) entered disabled state
[243280.929284] eth0: renamed from vethb13090c
[243280.726958] docker0: port 12(veth3690d19) entered forwarding state
[243280.726811] docker0: port 12(veth3690d19) entered blocking state
[243280.726637] IPv6: ADDRCONF(NETDEV_UP): veth3690d19: link is not ready
[243280.724527] device veth3690d19 entered promiscuous mode
[243280.722930] docker0: port 12(veth3690d19) entered disabled state
[243280.722726] docker0: port 12(veth3690d19) entered blocking state
[243280.657708] docker0: port 11(veth7836875) entered disabled state
[243280.551343] docker0: port 11(veth7836875) entered forwarding state
[243280.551199] docker0: port 11(veth7836875) entered blocking state
[243280.550985] IPv6: ADDRCONF(NETDEV_UP): veth7836875: link is not ready
[243280.545494] device veth7836875 entered promiscuous mode
[243280.545337] docker0: port 11(veth7836875) entered disabled state
[243280.545217] docker0: port 11(veth7836875) entered blocking state
[243280.163355] docker0: port 10(veth63ba84a) entered forwarding state
[243280.163206] docker0: port 10(veth63ba84a) entered blocking state
[243280.162996] IPv6: ADDRCONF(NETDEV_CHANGE): veth63ba84a: link becomes ready
[243280.157413] eth0: renamed from vethd501b40
[243279.837600] docker0: port 9(vethbcc5218) entered forwarding state
[243279.837599] docker0: port 9(vethbcc5218) entered blocking state
[243279.837573] IPv6: ADDRCONF(NETDEV_CHANGE): vethbcc5218: link becomes ready
[243279.837526] docker0: port 10(veth63ba84a) entered disabled state
[243279.825796] eth0: renamed from vethdccae08
[243279.778518] docker0: port 10(veth63ba84a) entered forwarding state
[243279.778367] docker0: port 10(veth63ba84a) entered blocking state
[243279.778192] IPv6: ADDRCONF(NETDEV_UP): veth63ba84a: link is not ready
[243279.774477] device veth63ba84a entered promiscuous mode
[243279.774226] docker0: port 10(veth63ba84a) entered disabled state
[243279.774031] docker0: port 10(veth63ba84a) entered blocking state
[243279.650760] docker0: port 9(vethbcc5218) entered disabled state
[243279.389230] docker0: port 9(vethbcc5218) entered forwarding state
[243279.388586] docker0: port 9(vethbcc5218) entered blocking state
[243279.387914] IPv6: ADDRCONF(NETDEV_UP): vethbcc5218: link is not ready
[243279.386784] device vethbcc5218 entered promiscuous mode
[243279.384784] docker0: port 9(vethbcc5218) entered disabled state
[243279.382640] docker0: port 9(vethbcc5218) entered blocking state
[243279.335705] docker0: port 7(veth78c4261) entered forwarding state
[243279.335022] docker0: port 7(veth78c4261) entered blocking state
[243279.332784] IPv6: ADDRCONF(NETDEV_CHANGE): veth78c4261: link becomes ready
[243279.323089] eth0: renamed from vethb4da3be
[243279.297319] docker0: port 8(veth345c7b7) entered forwarding state
[243279.296469] docker0: port 8(veth345c7b7) entered blocking state
[243279.294261] IPv6: ADDRCONF(NETDEV_CHANGE): veth345c7b7: link becomes ready
[243279.279486] eth0: renamed from vethc232d0f
[243278.925455] docker0: port 6(veth43e0505) entered forwarding state
[243278.924832] docker0: port 6(veth43e0505) entered blocking state
[243278.924150] IPv6: ADDRCONF(NETDEV_CHANGE): veth43e0505: link becomes ready
[243278.923483] docker0: port 8(veth345c7b7) entered disabled state
[243278.921312] docker0: port 7(veth78c4261) entered disabled state
[243278.909824] eth0: renamed from veth210548d
[243278.871511] docker0: port 8(veth345c7b7) entered forwarding state
[243278.870884] docker0: port 8(veth345c7b7) entered blocking state
[243278.870218] IPv6: ADDRCONF(NETDEV_UP): veth345c7b7: link is not ready
[243278.868219] device veth345c7b7 entered promiscuous mode
[243278.865959] docker0: port 8(veth345c7b7) entered disabled state
[243278.863778] docker0: port 8(veth345c7b7) entered blocking state
[243278.682494] docker0: port 7(veth78c4261) entered forwarding state
[243278.681811] docker0: port 7(veth78c4261) entered blocking state
[243278.681080] IPv6: ADDRCONF(NETDEV_UP): veth78c4261: link is not ready
[243278.677350] device veth78c4261 entered promiscuous mode
[243278.667837] docker0: port 7(veth78c4261) entered disabled state
[243278.665653] docker0: port 7(veth78c4261) entered blocking state
[243278.647856] docker0: port 6(veth43e0505) entered disabled state
[243278.250470] docker0: port 6(veth43e0505) entered forwarding state
[243278.249422] docker0: port 6(veth43e0505) entered blocking state
[243278.247398] IPv6: ADDRCONF(NETDEV_UP): veth43e0505: link is not ready
[243278.241195] device veth43e0505 entered promiscuous mode
[243278.237841] docker0: port 6(veth43e0505) entered disabled state
[243278.237634] docker0: port 6(veth43e0505) entered blocking state
[243278.183759] docker0: port 5(veth9af116b) entered forwarding state
[243278.183582] docker0: port 5(veth9af116b) entered blocking state
[243278.183406] IPv6: ADDRCONF(NETDEV_CHANGE): veth9af116b: link becomes ready
[243278.183234] docker0: port 4(veth6ffaed4) entered forwarding state
[243278.183085] docker0: port 4(veth6ffaed4) entered blocking state
[243278.182836] IPv6: ADDRCONF(NETDEV_CHANGE): veth6ffaed4: link becomes ready
[243278.135212] eth0: renamed from vethdecbdb1
[243278.110267] eth0: renamed from vethe0774b0
[243278.034944] docker0: port 3(veth0ff0a23) entered forwarding state
[243278.034798] docker0: port 3(veth0ff0a23) entered blocking state
[243278.034596] IPv6: ADDRCONF(NETDEV_CHANGE): veth0ff0a23: link becomes ready
[243278.034418] docker0: port 5(veth9af116b) entered disabled state
[243278.034144] docker0: port 4(veth6ffaed4) entered disabled state
[243278.029654] eth0: renamed from vethc7437dd
[243277.891355] docker0: port 5(veth9af116b) entered forwarding state
[243277.891212] docker0: port 5(veth9af116b) entered blocking state
[243277.891034] IPv6: ADDRCONF(NETDEV_UP): veth9af116b: link is not ready
[243277.886111] device veth9af116b entered promiscuous mode
[243277.885462] docker0: port 5(veth9af116b) entered disabled state
[243277.885254] docker0: port 5(veth9af116b) entered blocking state
[243277.731739] docker0: port 4(veth6ffaed4) entered forwarding state
[243277.731577] docker0: port 4(veth6ffaed4) entered blocking state
[243277.731423] IPv6: ADDRCONF(NETDEV_UP): veth6ffaed4: link is not ready
[243277.731235] device veth6ffaed4 entered promiscuous mode
[243277.731057] docker0: port 4(veth6ffaed4) entered disabled state
[243277.730863] docker0: port 4(veth6ffaed4) entered blocking state
[243277.637602] IPv6: ADDRCONF(NETDEV_UP): veth0ff0a23: link is not ready
[243277.637262] device veth0ff0a23 entered promiscuous mode
[243277.636991] docker0: port 3(veth0ff0a23) entered disabled state
[243277.636793] docker0: port 3(veth0ff0a23) entered blocking state
[210416.235159] CIFS VFS: Free previous auth_key.response = ffff938161cdfa00
[210416.233813] CIFS VFS: Server has not responded in 120 seconds. Reconnecting...
[169090.706515] docker0: port 24(veth7bbfebf) entered disabled state
[169090.706410] device veth7bbfebf left promiscuous mode
[169090.705467] docker0: port 24(veth7bbfebf) entered disabled state
[169090.681347] veth629e01f: renamed from eth0
[169090.680058] docker0: port 24(veth7bbfebf) entered disabled state
[169090.139791] docker0: port 21(vethf3c0b04) entered disabled state
[169090.139787] device vethf3c0b04 left promiscuous mode
[169090.139101] docker0: port 21(vethf3c0b04) entered disabled state
[169090.092164] vethb2c1650: renamed from eth0
[169090.091887] docker0: port 21(vethf3c0b04) entered disabled state
[169087.251200] docker0: port 8(vethb20a654) entered disabled state
[169087.251196] device vethb20a654 left promiscuous mode
[169087.247933] docker0: port 8(vethb20a654) entered disabled state
[169087.217705] veth6eab0e0: renamed from eth0
[169087.217449] docker0: port 8(vethb20a654) entered disabled state
[169087.069431] docker0: port 22(veth27ecd57) entered disabled state
[169087.069328] device veth27ecd57 left promiscuous mode
[169087.066084] docker0: port 22(veth27ecd57) entered disabled state
[169087.033634] docker0: port 23(veth596ab10) entered disabled state
[169087.033531] device veth596ab10 left promiscuous mode
[169087.032157] docker0: port 23(veth596ab10) entered disabled state
[169087.004058] veth1b2115c: renamed from eth0
[169087.003788] docker0: port 22(veth27ecd57) entered disabled state
[169086.985677] veth77a2a6c: renamed from eth0
[169086.985413] docker0: port 23(veth596ab10) entered disabled state
[169072.555061] vmw_pvscsi: msg: device removed at scsi0:2:0
[169072.554868] vmw_pvscsi: msg type: 0x1 - MSG RING: 10/9 (5) 
[169066.003730] docker0: port 29(veth6b4dafb) entered disabled state
[169066.003549] device veth6b4dafb left promiscuous mode
[169065.991115] docker0: port 29(veth6b4dafb) entered disabled state
[169065.879882] vethfb95e1b: renamed from eth0
[169065.879593] docker0: port 29(veth6b4dafb) entered disabled state
[169064.534545] docker0: port 20(veth8ec635f) entered disabled state
[169064.534542] device veth8ec635f left promiscuous mode
[169064.533250] docker0: port 20(veth8ec635f) entered disabled state
[169064.512612] docker0: port 13(veth4877b5a) entered disabled state
[169064.512608] device veth4877b5a left promiscuous mode
[169064.512150] docker0: port 13(veth4877b5a) entered disabled state
[169064.492805] docker0: port 5(veth4db8725) entered disabled state
[169064.492802] device veth4db8725 left promiscuous mode
[169064.490375] docker0: port 5(veth4db8725) entered disabled state
[169064.469848] docker0: port 19(vethe241df2) entered disabled state
[169064.469707] device vethe241df2 left promiscuous mode
[169064.466039] docker0: port 19(vethe241df2) entered disabled state
[169064.451547] docker0: port 5(veth4db8725) entered disabled state
[169064.436554] veth493e496: renamed from eth0
[169064.420140] veth4853cc9: renamed from eth0
[169064.419892] docker0: port 13(veth4877b5a) entered disabled state
[169064.408692] vetha1fdaeb: renamed from eth0
[169064.408447] docker0: port 20(veth8ec635f) entered disabled state
[169064.382212] veth6f8b610: renamed from eth0
[169064.378298] docker0: port 19(vethe241df2) entered disabled state
[169064.368666] vmw_pvscsi: msg: device removed at scsi0:3:0
[169064.368511] vmw_pvscsi: msg type: 0x1 - MSG RING: 9/8 (5) 
[169063.840280] docker0: port 9(veth1d9cf8c) entered disabled state
[169063.840074] device veth1d9cf8c left promiscuous mode
[169063.822241] docker0: port 9(veth1d9cf8c) entered disabled state
[169063.779743] docker0: port 15(veth26e3270) entered disabled state
[169063.779563] device veth26e3270 left promiscuous mode
[169063.772709] docker0: port 15(veth26e3270) entered disabled state
[169063.716365] docker0: port 3(veth73d792e) entered disabled state
[169063.716213] device veth73d792e left promiscuous mode
[169063.714659] docker0: port 3(veth73d792e) entered disabled state
[169063.651857] docker0: port 16(veth96a51be) entered disabled state
[169063.651853] device veth96a51be left promiscuous mode
[169063.651523] docker0: port 16(veth96a51be) entered disabled state
[169063.625044] docker0: port 7(vetha0b0094) entered disabled state
[169063.624861] device vetha0b0094 left promiscuous mode
[169063.624291] docker0: port 7(vetha0b0094) entered disabled state
[169063.608799] docker0: port 12(veth3a9550f) entered disabled state
[169063.608656] device veth3a9550f left promiscuous mode
[169063.607235] docker0: port 12(veth3a9550f) entered disabled state
[169063.573091] docker0: port 26(veth0eb1e21) entered disabled state
[169063.573087] device veth0eb1e21 left promiscuous mode
[169063.569534] docker0: port 26(veth0eb1e21) entered disabled state
[169063.542553] vethdf2fa32: renamed from eth0
[169063.538518] docker0: port 15(veth26e3270) entered disabled state
[169063.532012] vethf3a8f00: renamed from eth0
[169063.455086] docker0: port 9(veth1d9cf8c) entered disabled state
[169063.454335] docker0: port 26(veth0eb1e21) entered disabled state
[169063.424394] veth746fc3a: renamed from eth0
[169063.395803] veth71efe52: renamed from eth0
[169063.390690] docker0: port 16(veth96a51be) entered disabled state
[169063.390425] docker0: port 7(vetha0b0094) entered disabled state
[169063.380951] veth7320c45: renamed from eth0
[169063.374713] docker0: port 17(vethcb3b61c) entered disabled state
[169063.374572] device vethcb3b61c left promiscuous mode
[169063.373097] docker0: port 17(vethcb3b61c) entered disabled state
[169063.320765] veth88c5ed6: renamed from eth0
[169063.320310] docker0: port 3(veth73d792e) entered disabled state
[169063.306150] docker0: port 27(veth2ef7d19) entered disabled state
[169063.305965] device veth2ef7d19 left promiscuous mode
[169063.300655] docker0: port 27(veth2ef7d19) entered disabled state
[169063.278802] docker0: port 12(veth3a9550f) entered disabled state
[169063.272019] veth5523f5a: renamed from eth0
[169063.253378] veth6a0e846: renamed from eth0
[169063.253129] docker0: port 17(vethcb3b61c) entered disabled state
[169063.239552] docker0: port 18(veth641b2ef) entered disabled state
[169063.239411] device veth641b2ef left promiscuous mode
[169063.234129] docker0: port 18(veth641b2ef) entered disabled state
[169063.192210] docker0: port 30(veth5f34a63) entered disabled state
[169063.192067] device veth5f34a63 left promiscuous mode
[169063.190159] docker0: port 30(veth5f34a63) entered disabled state
[169063.105773] vethfd419aa: renamed from eth0
[169063.105114] docker0: port 27(veth2ef7d19) entered disabled state
[169063.034842] veth9082d3f: renamed from eth0
[169063.034577] docker0: port 18(veth641b2ef) entered disabled state
[169062.931635] docker0: port 28(vethfa21f8a) entered disabled state
[169062.931632] device vethfa21f8a left promiscuous mode
[169062.929781] docker0: port 28(vethfa21f8a) entered disabled state
[169062.849826] vethdd0b2af: renamed from eth0
[169062.849537] docker0: port 30(veth5f34a63) entered disabled state
[169062.799596] docker0: port 28(vethfa21f8a) entered disabled state
[169062.786354] veth5beb1a7: renamed from eth0
[169061.035855] docker0: port 4(veth217e7ec) entered disabled state
[169061.035719] device veth217e7ec left promiscuous mode
[169061.034512] docker0: port 4(veth217e7ec) entered disabled state
[169060.972288] vethbfd49b0: renamed from eth0
[169060.971135] docker0: port 4(veth217e7ec) entered disabled state
[169060.922349] docker0: port 14(veth6a20067) entered disabled state
[169060.922174] device veth6a20067 left promiscuous mode
[169060.914514] docker0: port 14(veth6a20067) entered disabled state
[169060.877171] veth20d5879: renamed from eth0
[169060.875965] docker0: port 14(veth6a20067) entered disabled state
[169060.861541] docker0: port 6(vethcc8744c) entered disabled state
[169060.861405] device vethcc8744c left promiscuous mode
[169060.860578] docker0: port 6(vethcc8744c) entered disabled state
[169060.811763] veth2ee4cc3: renamed from eth0
[169060.811489] docker0: port 6(vethcc8744c) entered disabled state
[169060.421647] docker0: port 11(veth7bc12df) entered disabled state
[169060.421450] device veth7bc12df left promiscuous mode
[169060.404449] docker0: port 11(veth7bc12df) entered disabled state
[169060.341202] vmw_pvscsi: msg: device removed at scsi0:1:0
[169060.341020] vmw_pvscsi: msg type: 0x1 - MSG RING: 8/7 (5) 
[169060.332511] vethc794670: renamed from eth0
[169060.326584] docker0: port 11(veth7bc12df) entered disabled state
[169060.065013] docker0: port 25(vethb7cda73) entered disabled state
[169060.064826] device vethb7cda73 left promiscuous mode
[169060.024715] docker0: port 25(vethb7cda73) entered disabled state
[169059.878266] veth6643644: renamed from eth0
[169059.877444] docker0: port 25(vethb7cda73) entered disabled state
[169059.622318] docker0: port 10(vethe5a92c4) entered disabled state
[169059.622314] device vethe5a92c4 left promiscuous mode
[169059.619118] docker0: port 10(vethe5a92c4) entered disabled state
[169059.595506] veth19d50af: renamed from eth0
[169059.595215] docker0: port 10(vethe5a92c4) entered disabled state
[169004.154858] docker0: port 29(veth6b4dafb) entered forwarding state
[169004.154148] docker0: port 29(veth6b4dafb) entered blocking state
[169004.151861] IPv6: ADDRCONF(NETDEV_CHANGE): veth6b4dafb: link becomes ready
[169004.138811] eth0: renamed from vethfb95e1b
[169004.085225] docker0: port 30(veth5f34a63) entered forwarding state
[169004.084542] docker0: port 30(veth5f34a63) entered blocking state
[169004.082206] IPv6: ADDRCONF(NETDEV_CHANGE): veth5f34a63: link becomes ready
[169004.057601] eth0: renamed from vethdd0b2af
[169003.114405] docker0: port 28(vethfa21f8a) entered forwarding state
[169003.113724] docker0: port 28(vethfa21f8a) entered blocking state
[169003.111202] IPv6: ADDRCONF(NETDEV_CHANGE): vethfa21f8a: link becomes ready
[169003.085676] eth0: renamed from veth5beb1a7
[169002.849852] docker0: port 30(veth5f34a63) entered disabled state
[169002.847571] docker0: port 29(veth6b4dafb) entered disabled state
[169002.468561] docker0: port 30(veth5f34a63) entered forwarding state
[169002.467842] docker0: port 30(veth5f34a63) entered blocking state
[169002.465649] IPv6: ADDRCONF(NETDEV_UP): veth5f34a63: link is not ready
[169002.454433] device veth5f34a63 entered promiscuous mode
[169002.451290] docker0: port 30(veth5f34a63) entered disabled state
[169002.451088] docker0: port 30(veth5f34a63) entered blocking state
[169002.324339] docker0: port 29(veth6b4dafb) entered forwarding state
[169002.324191] docker0: port 29(veth6b4dafb) entered blocking state
[169002.323988] IPv6: ADDRCONF(NETDEV_UP): veth6b4dafb: link is not ready
[169002.320654] device veth6b4dafb entered promiscuous mode
[169002.320440] docker0: port 29(veth6b4dafb) entered disabled state
[169002.320242] docker0: port 29(veth6b4dafb) entered blocking state
[169001.828933] IPv6: ADDRCONF(NETDEV_UP): vethfa21f8a: link is not ready
[169001.828221] device vethfa21f8a entered promiscuous mode
[169001.828023] docker0: port 28(vethfa21f8a) entered disabled state
[169001.827816] docker0: port 28(vethfa21f8a) entered blocking state
[169001.661856] EXT4-fs (sdb): mounted filesystem with ordered data mode. Opts: (null)
[169001.543770] EXT4-fs (sdc): mounted filesystem with ordered data mode. Opts: (null)
[169001.314684] EXT4-fs (sdd): mounted filesystem with ordered data mode. Opts: (null)
[168998.680912] sd 0:0:3:0: [sdd] Attached SCSI disk
[168998.678576] sd 0:0:3:0: [sdd] Assuming drive cache: write through
[168998.678434] sd 0:0:3:0: [sdd] Cache data unavailable
[168998.678414] sd 0:0:3:0: [sdd] Mode Sense: 31 00 00 00
[168998.678288] sd 0:0:3:0: [sdd] Write Protect is off
[168998.678092] sd 0:0:3:0: [sdd] 10485760 512-byte logical blocks: (5.37 GB/5.00 GiB)
[168998.677250] scsi 0:0:3:0: Direct-Access     VMware   Virtual disk     2.0  PQ: 0 ANSI: 6
[168998.676938] vmw_pvscsi: msg: device added at scsi0:3:0
[168998.676748] vmw_pvscsi: msg type: 0x0 - MSG RING: 7/6 (5) 
[168998.327917] sd 0:0:2:0: [sdc] Attached SCSI disk
[168998.325894] sd 0:0:2:0: [sdc] Assuming drive cache: write through
[168998.325766] sd 0:0:2:0: [sdc] Cache data unavailable
[168998.325735] sd 0:0:2:0: [sdc] Mode Sense: 31 00 00 00
[168998.325609] sd 0:0:2:0: [sdc] Write Protect is off
[168998.325389] sd 0:0:2:0: [sdc] 20971520 512-byte logical blocks: (10.7 GB/10.0 GiB)
[168998.324357] scsi 0:0:2:0: Direct-Access     VMware   Virtual disk     2.0  PQ: 0 ANSI: 6
[168998.323996] vmw_pvscsi: msg: device added at scsi0:2:0
[168998.323801] vmw_pvscsi: msg type: 0x0 - MSG RING: 6/5 (5) 
[168996.587662] sd 0:0:1:0: [sdb] Attached SCSI disk
[168996.585119] sd 0:0:1:0: [sdb] Assuming drive cache: write through
[168996.584993] sd 0:0:1:0: [sdb] Cache data unavailable
[168996.584967] sd 0:0:1:0: [sdb] Mode Sense: 31 00 00 00
[168996.584842] sd 0:0:1:0: [sdb] Write Protect is off
[168996.584629] sd 0:0:1:0: [sdb] 62914560 512-byte logical blocks: (32.2 GB/30.0 GiB)
[168996.583572] scsi 0:0:1:0: Direct-Access     VMware   Virtual disk     2.0  PQ: 0 ANSI: 6
[168996.583161] vmw_pvscsi: msg: device added at scsi0:1:0
[168996.582970] vmw_pvscsi: msg type: 0x0 - MSG RING: 5/4 (5) 

[165194.336127] Kernel Offset: 0x34000000 from 0xffffffff81000000 (relocation range: 0xffffffff80000000-0xffffffffbfffffff)
[165194.335328]  ret_from_fork+0x35/0x40
[165194.334673]  ? SyS_exit_group+0x10/0x10
[165194.333898]  ? kthread_create_on_node+0x70/0x70
[165194.333265]  kthread+0x11a/0x130
[165194.330489]  ? process_one_work+0x3d0/0x3d0
[165194.329459]  worker_thread+0x2b/0x3f0
[165194.328086]  process_one_work+0x1da/0x3d0
[165194.327427]  wait_rcu_exp_gp+0x1b/0x30
[165194.326756]  ? cpu_needs_another_gp+0x70/0x70
[165194.326085]  sync_rcu_exp_select_cpus+0x1f6/0x410
[165194.325436]  ? cpumask_next+0x16/0x20
[165194.324766]  ? sync_rcu_exp_select_cpus+0x1f6/0x410
[165194.324086]  ? cpu_needs_another_gp+0x70/0x70
[165194.323360] R13: 000000000000000c R14: 0000000000000001 R15: ffff8a35bfd22240
[165194.322631] R10: ffffb5f90314be38 R11: 0000000000001200 R12: ffffffffb625f1c0
[165194.320369] RBP: ffffb5f90314be10 R08: 0000000000000002 R09: 0000000000000004
[165194.319637] RDX: ffffffffb625f1c0 RSI: ffffffffb50db1f0 RDI: 0000000000000002
[165194.318886] RAX: ffff8a35bfc223c0 RBX: ffffffffb625f1c0 RCX: 0000000000000001
[165194.318114] RSP: 0018:ffffb5f90314bdc0 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff10
[165194.317343] RIP: 0010:smp_call_function_single+0x8e/0x100
[165194.316665]  </IRQ>
[165194.315893]  apic_timer_interrupt+0x7d/0x90
[165194.314836]  smp_apic_timer_interrupt+0x66/0x120
[165194.314063]  hrtimer_interrupt+0xa6/0x1f0
[165194.313265]  __hrtimer_run_queues+0xde/0x230
[165194.312334]  ? watchdog+0x30/0x30
[165194.310060]  watchdog_timer_fn+0x20e/0x220
[165194.309223]  panic+0xe4/0x252
[165194.308356]  dump_stack+0x5c/0x85
[165194.307516]  <IRQ>
[165194.306664] Call Trace:
[165194.305772] Workqueue: events wait_rcu_exp_gp
[165194.303963] Hardware name: VMware, Inc. VMware7,1/440BX Desktop Reference Platform, BIOS VMW71.00V.0.B64.1801120748 01/12/2018
[165194.303042] CPU: 0 PID: 14546 Comm: kworker/0:3 Tainted: G             L  4.14.48-coreos-r2 #1
[165194.301532] Kernel panic - not syncing: softlockup: hung tasks
[165194.298755] Code: 73 0c 9c 58 66 66 90 66 90 f6 c4 02 74 75 85 c9 75 4e 48 c7 c0 c0 23 02 00 65 48 03 05 2c 40 f1 4a 8b 48 18 83 e1 01 74 0a f3 90 <8b> 48 18 83 e1 01 75 f6 83 48 18 01 48 89 d1 48 89 f2 48 89 c6 
[165194.297953]  ret_from_fork+0x35/0x40
[165194.297150]  ? SyS_exit_group+0x10/0x10
[165194.296343]  ? kthread_create_on_node+0x70/0x70
[165194.295556]  kthread+0x11a/0x130
[165194.294740]  ? process_one_work+0x3d0/0x3d0
[165194.293915]  worker_thread+0x2b/0x3f0
[165194.293086]  process_one_work+0x1da/0x3d0
[165194.292104]  wait_rcu_exp_gp+0x1b/0x30
[165194.289744]  ? cpu_needs_another_gp+0x70/0x70
[165194.288886]  sync_rcu_exp_select_cpus+0x1f6/0x410
[165194.288037]  ? cpumask_next+0x16/0x20
[165194.287156]  ? sync_rcu_exp_select_cpus+0x1f6/0x410
[165194.286269] Call Trace:
[165194.284534] CR2: 000055ba3ead6ff0 CR3: 00000003f320a005 CR4: 00000000000606f0
[165194.284392] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[165194.284208] FS:  0000000000000000(0000) GS:ffff8a35bfc00000(0000) knlGS:0000000000000000
[165194.284040] R13: 000000000000000c R14: 0000000000000001 R15: ffff8a35bfd22240
[165194.283873] R10: ffffb5f90314be38 R11: 0000000000001200 R12: ffffffffb625f1c0
[165194.283706] RBP: ffffb5f90314be10 R08: 0000000000000002 R09: 0000000000000004
[165194.283536] RDX: ffffffffb625f1c0 RSI: ffffffffb50db1f0 RDI: 0000000000000002
[165194.283368] RAX: ffff8a35bfc223c0 RBX: ffffffffb625f1c0 RCX: 0000000000000001
[165194.283192] RSP: 0018:ffffb5f90314bdc0 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff10
[165194.283057] RIP: 0010:smp_call_function_single+0x8e/0x100
[165194.282909] task: ffff8a3175155a00 task.stack: ffffb5f903148000
[165194.282792] Workqueue: events wait_rcu_exp_gp
[165194.282509] Hardware name: VMware, Inc. VMware7,1/440BX Desktop Reference Platform, BIOS VMW71.00V.0.B64.1801120748 01/12/2018
[165194.282321] CPU: 0 PID: 14546 Comm: kworker/0:3 Not tainted 4.14.48-coreos-r2 #1
[165194.282146]  vmxnet3 scsi_mod dm_mirror dm_region_hash dm_log dm_mod dax
[165168.260729] eth0: renamed from veth98f846c
[165168.062442] docker0: port 25(veth6509fe7) entered disabled state
[165168.061943] docker0: port 25(veth6509fe7) entered forwarding state
[165168.061800] docker0: port 25(veth6509fe7) entered blocking state
[165168.061643] IPv6: ADDRCONF(NETDEV_UP): veth6509fe7: link is not ready
[165168.061347] device veth6509fe7 entered promiscuous mode
[165168.051124] docker0: port 25(veth6509fe7) entered disabled state
[165168.050926] docker0: port 25(veth6509fe7) entered blocking state
[165167.733705] docker0: port 23(veth24b1442) entered forwarding state
[165167.733557] docker0: port 23(veth24b1442) entered blocking state
[165167.733353] IPv6: ADDRCONF(NETDEV_CHANGE): veth24b1442: link becomes ready
[165167.733024] docker0: port 24(vethf543f8d) entered disabled state
[165167.623423] eth0: renamed from veth47284da
[165167.322035] docker0: port 24(vethf543f8d) entered forwarding state
[165167.321892] docker0: port 24(vethf543f8d) entered blocking state
[165167.321736] IPv6: ADDRCONF(NETDEV_UP): vethf543f8d: link is not ready
[165167.321530] device vethf543f8d entered promiscuous mode
[165167.321344] docker0: port 24(vethf543f8d) entered disabled state
[165167.321127] docker0: port 24(vethf543f8d) entered blocking state
[165166.551385] docker0: port 21(veth1e03adf) entered forwarding state
[165166.551239] docker0: port 21(veth1e03adf) entered blocking state
[165166.551034] IPv6: ADDRCONF(NETDEV_CHANGE): veth1e03adf: link becomes ready
[165166.550858] docker0: port 23(veth24b1442) entered disabled state
[165166.550614] docker0: port 22(veth9da0379) entered disabled state
[165166.543756] eth0: renamed from veth38a6d91
[165166.505313] docker0: port 23(veth24b1442) entered forwarding state
[165166.505157] docker0: port 23(veth24b1442) entered blocking state
[165166.504986] IPv6: ADDRCONF(NETDEV_UP): veth24b1442: link is not ready
[165166.503841] device veth24b1442 entered promiscuous mode
[165166.503643] docker0: port 23(veth24b1442) entered disabled state
[165166.503439] docker0: port 23(veth24b1442) entered blocking state
[165166.352123] docker0: port 22(veth9da0379) entered forwarding state
[165166.351978] docker0: port 22(veth9da0379) entered blocking state
[165166.351813] IPv6: ADDRCONF(NETDEV_UP): veth9da0379: link is not ready
[165166.350714] device veth9da0379 entered promiscuous mode
[165166.350520] docker0: port 22(veth9da0379) entered disabled state
[165166.350323] docker0: port 22(veth9da0379) entered blocking state
[165165.297667] docker0: port 20(veth837ebbe) entered forwarding state
[165165.297522] docker0: port 20(veth837ebbe) entered blocking state
[165165.297329] IPv6: ADDRCONF(NETDEV_CHANGE): veth837ebbe: link becomes ready
[165165.297104] docker0: port 21(veth1e03adf) entered disabled state
[165165.291545] eth0: renamed from vethf0f7b66
[165165.246653] docker0: port 21(veth1e03adf) entered forwarding state
[165165.246508] docker0: port 21(veth1e03adf) entered blocking state
[165165.246336] IPv6: ADDRCONF(NETDEV_UP): veth1e03adf: link is not ready
[165165.243965] device veth1e03adf entered promiscuous mode
[165165.242426] docker0: port 21(veth1e03adf) entered disabled state
[165165.242205] docker0: port 21(veth1e03adf) entered blocking state
[165164.857660] docker0: port 19(vethd141602) entered forwarding state
[165164.856937] docker0: port 19(vethd141602) entered blocking state
[165164.854412] IPv6: ADDRCONF(NETDEV_CHANGE): vethd141602: link becomes ready
[165164.837558] eth0: renamed from vethc418832
[165164.793399] docker0: port 7(vethb34b84c) entered forwarding state
[165164.792629] docker0: port 7(vethb34b84c) entered blocking state
[165164.790383] IPv6: ADDRCONF(NETDEV_CHANGE): vethb34b84c: link becomes ready
[165164.771595] eth0: renamed from vethb4157ef
[165164.615270] docker0: port 14(veth7f9e04d) entered forwarding state
[165164.613207] docker0: port 14(veth7f9e04d) entered blocking state
[165164.613013] IPv6: ADDRCONF(NETDEV_CHANGE): veth7f9e04d: link becomes ready
[165164.612761] docker0: port 20(veth837ebbe) entered disabled state
[165164.595891] eth0: renamed from veth4451b21
[165164.460306] docker0: port 20(veth837ebbe) entered forwarding state
[165164.460148] docker0: port 20(veth837ebbe) entered blocking state
[165164.459939] IPv6: ADDRCONF(NETDEV_UP): veth837ebbe: link is not ready
[165164.406407] device veth837ebbe entered promiscuous mode
[165164.402088] docker0: port 20(veth837ebbe) entered disabled state
[165164.401888] docker0: port 20(veth837ebbe) entered blocking state
[165163.734543] docker0: port 19(vethd141602) entered disabled state
[165163.734282] docker0: port 14(veth7f9e04d) entered disabled state
[165163.725556] IPv6: ADDRCONF(NETDEV_CHANGE): vethd9d897c: link becomes ready
[165163.719484] eth0: renamed from vethaf5cabf
[165163.559973] docker0: port 19(vethd141602) entered forwarding state
[165163.559829] docker0: port 19(vethd141602) entered blocking state
[165163.559672] IPv6: ADDRCONF(NETDEV_UP): vethd141602: link is not ready
[165163.559466] device vethd141602 entered promiscuous mode
[165163.559083] docker0: port 19(vethd141602) entered disabled state
[165163.558887] docker0: port 19(vethd141602) entered blocking state
[165163.246119] docker0: port 14(veth7f9e04d) entered forwarding state
[165163.245974] docker0: port 14(veth7f9e04d) entered blocking state
[165163.245802] IPv6: ADDRCONF(NETDEV_UP): veth7f9e04d: link is not ready
[165163.243290] device veth7f9e04d entered promiscuous mode
[165163.243087] docker0: port 14(veth7f9e04d) entered disabled state
[165163.242886] docker0: port 14(veth7f9e04d) entered blocking state
[165163.125424] docker0: port 11(vethd9d897c) entered forwarding state
[165163.125278] docker0: port 11(vethd9d897c) entered blocking state
[165163.125103] IPv6: ADDRCONF(NETDEV_UP): vethd9d897c: link is not ready
[165163.124400] device vethd9d897c entered promiscuous mode
[165163.124193] docker0: port 11(vethd9d897c) entered disabled state
[165163.123986] docker0: port 11(vethd9d897c) entered blocking state
[165162.978014] IPv6: ADDRCONF(NETDEV_UP): vethb34b84c: link is not ready
[165162.977816] device vethb34b84c entered promiscuous mode
[165162.977627] docker0: port 7(vethb34b84c) entered disabled state
[165162.977432] docker0: port 7(vethb34b84c) entered blocking state
[165118.648733] docker0: port 7(vethc5160ef) entered disabled state
[165118.648729] device vethc5160ef left promiscuous mode
[165118.648062] docker0: port 7(vethc5160ef) entered disabled state
[165118.626112] vethdd8cad7: renamed from eth0
[165118.625758] docker0: port 7(vethc5160ef) entered disabled state
[165084.882321] docker0: port 7(vethc5160ef) entered forwarding state
[165084.882175] docker0: port 7(vethc5160ef) entered blocking state
[165084.881967] IPv6: ADDRCONF(NETDEV_CHANGE): vethc5160ef: link becomes ready
[165084.876886] eth0: renamed from vethdd8cad7
[165084.484845] docker0: port 7(vethc5160ef) entered disabled state
[165084.484295] docker0: port 7(vethc5160ef) entered forwarding state
[165084.484154] docker0: port 7(vethc5160ef) entered blocking state
[165084.483997] IPv6: ADDRCONF(NETDEV_UP): vethc5160ef: link is not ready
[165084.483799] device vethc5160ef entered promiscuous mode
[165084.483560] docker0: port 7(vethc5160ef) entered disabled state
[165084.483361] docker0: port 7(vethc5160ef) entered blocking state
[164988.084574] docker0: port 7(veth96b5a39) entered disabled state
[164988.084473] device veth96b5a39 left promiscuous mode
[164988.079981] docker0: port 7(veth96b5a39) entered disabled state
[164988.057193] docker0: port 7(veth96b5a39) entered disabled state
[164988.042964] vethd04de33: renamed from eth0
[164954.293788] docker0: port 7(veth96b5a39) entered forwarding state
[164954.293643] docker0: port 7(veth96b5a39) entered blocking state
[164954.293440] IPv6: ADDRCONF(NETDEV_CHANGE): veth96b5a39: link becomes ready
[164954.288579] eth0: renamed from vethd04de33
[164953.979629] IPv6: ADDRCONF(NETDEV_UP): veth96b5a39: link is not ready
[164953.979425] device veth96b5a39 entered promiscuous mode
[164953.978913] docker0: port 7(veth96b5a39) entered disabled state
[164953.978721] docker0: port 7(veth96b5a39) entered blocking state
[164860.162989] docker0: port 7(vethfc7256e) entered disabled state
[164860.162985] device vethfc7256e left promiscuous mode
[164860.161705] docker0: port 7(vethfc7256e) entered disabled state
[164860.149460] docker0: port 7(vethfc7256e) entered disabled state
[164860.133904] veth7ff9578: renamed from eth0
[164826.580614] docker0: port 7(vethfc7256e) entered forwarding state
[164826.580467] docker0: port 7(vethfc7256e) entered blocking state
[164826.580261] IPv6: ADDRCONF(NETDEV_CHANGE): vethfc7256e: link becomes ready
[164826.573182] eth0: renamed from veth7ff9578
[164826.250877] docker0: port 7(vethfc7256e) entered disabled state
[164826.250222] docker0: port 7(vethfc7256e) entered forwarding state
[164826.250079] docker0: port 7(vethfc7256e) entered blocking state
[164826.249922] IPv6: ADDRCONF(NETDEV_UP): vethfc7256e: link is not ready
[164826.249537] device vethfc7256e entered promiscuous mode
[164826.249288] docker0: port 7(vethfc7256e) entered disabled state
[164826.249118] docker0: port 7(vethfc7256e) entered blocking state
[164652.680015] docker0: port 7(vethf60725a) entered disabled state
[164652.680011] device vethf60725a left promiscuous mode
[164652.679350] docker0: port 7(vethf60725a) entered disabled state
[164652.667600] docker0: port 7(vethf60725a) entered disabled state
[164652.657304] veth3318939: renamed from eth0
[164619.081486] docker0: port 7(vethf60725a) entered forwarding state
[164619.081342] docker0: port 7(vethf60725a) entered blocking state
[164619.081145] IPv6: ADDRCONF(NETDEV_CHANGE): vethf60725a: link becomes ready
[164619.077771] eth0: renamed from veth3318939
[164618.705036] IPv6: ADDRCONF(NETDEV_UP): vethf60725a: link is not ready
[164618.704653] device vethf60725a entered promiscuous mode
[164618.704403] docker0: port 7(vethf60725a) entered disabled state
[164618.704209] docker0: port 7(vethf60725a) entered blocking state
[164518.709157] docker0: port 7(veth4c56f89) entered disabled state
[164518.709054] device veth4c56f89 left promiscuous mode
[164518.706180] docker0: port 7(veth4c56f89) entered disabled state
[164518.683107] veth8ba0a7d: renamed from eth0
[164518.682848] docker0: port 7(veth4c56f89) entered disabled state
[164484.575460] docker0: port 7(veth4c56f89) entered forwarding state
[164484.575315] docker0: port 7(veth4c56f89) entered blocking state
[164484.575119] IPv6: ADDRCONF(NETDEV_CHANGE): veth4c56f89: link becomes ready
[164484.570403] eth0: renamed from veth8ba0a7d
[164484.292816] IPv6: ADDRCONF(NETDEV_UP): veth4c56f89: link is not ready
[164484.291774] device veth4c56f89 entered promiscuous mode
[164484.291566] docker0: port 7(veth4c56f89) entered disabled state
[164484.291409] docker0: port 7(veth4c56f89) entered blocking state
[164393.312556] docker0: port 7(veth775da5b) entered disabled state
[164393.312365] device veth775da5b left promiscuous mode
[164393.297326] docker0: port 7(veth775da5b) entered disabled state
[164393.285573] docker0: port 7(veth775da5b) entered disabled state
[164393.261337] veth84cdf3d: renamed from eth0
[164358.908959] docker0: port 7(veth775da5b) entered forwarding state
[164358.908813] docker0: port 7(veth775da5b) entered blocking state
[164358.908595] IPv6: ADDRCONF(NETDEV_CHANGE): veth775da5b: link becomes ready
[164358.902306] eth0: renamed from veth84cdf3d
[164358.441156] IPv6: ADDRCONF(NETDEV_UP): veth775da5b: link is not ready
[164358.440952] device veth775da5b entered promiscuous mode
[164358.440728] docker0: port 7(veth775da5b) entered disabled state
[164358.440520] docker0: port 7(veth775da5b) entered blocking state
[164258.296499] docker0: port 7(vethd8d1a97) entered disabled state
[164258.296391] device vethd8d1a97 left promiscuous mode
[164258.293966] docker0: port 7(vethd8d1a97) entered disabled state
[164258.269876] vethf117b3f: renamed from eth0
[164258.269304] docker0: port 7(vethd8d1a97) entered disabled state
[164224.491473] docker0: port 7(vethd8d1a97) entered forwarding state
[164224.491326] docker0: port 7(vethd8d1a97) entered blocking state
[164224.491130] IPv6: ADDRCONF(NETDEV_CHANGE): vethd8d1a97: link becomes ready
[164224.484087] eth0: renamed from vethf117b3f
[164224.044962] docker0: port 7(vethd8d1a97) entered disabled state
[164224.044664] docker0: port 7(vethd8d1a97) entered forwarding state
[164224.044521] docker0: port 7(vethd8d1a97) entered blocking state
[164224.044366] IPv6: ADDRCONF(NETDEV_UP): vethd8d1a97: link is not ready
[164224.044168] device vethd8d1a97 entered promiscuous mode
[164224.043984] docker0: port 7(vethd8d1a97) entered disabled state
[164224.043775] docker0: port 7(vethd8d1a97) entered blocking state
[164128.386421] docker0: port 7(veth39215de) entered disabled state
[164128.386302] device veth39215de left promiscuous mode
[164128.385312] docker0: port 7(veth39215de) entered disabled state
[164128.364538] vethae00d25: renamed from eth0
[164128.362267] docker0: port 7(veth39215de) entered disabled state
[164094.635662] docker0: port 7(veth39215de) entered forwarding state
[164094.635502] docker0: port 7(veth39215de) entered blocking state
[164094.635255] IPv6: ADDRCONF(NETDEV_CHANGE): veth39215de: link becomes ready
[164094.623979] eth0: renamed from vethae00d25
[164094.308179] IPv6: ADDRCONF(NETDEV_UP): veth39215de: link is not ready
[164094.307267] device veth39215de entered promiscuous mode
[164094.306305] docker0: port 7(veth39215de) entered disabled state
[164094.306108] docker0: port 7(veth39215de) entered blocking state
[164008.844958] docker0: port 7(vethaad1d66) entered disabled state
[164008.844852] device vethaad1d66 left promiscuous mode
[164008.837624] docker0: port 7(vethaad1d66) entered disabled state
[164008.796203] vethca716ce: renamed from eth0
[164008.795359] docker0: port 7(vethaad1d66) entered disabled state
[163974.619433] docker0: port 7(vethaad1d66) entered forwarding state
[163974.619287] docker0: port 7(vethaad1d66) entered blocking state
[163974.619050] IPv6: ADDRCONF(NETDEV_CHANGE): vethaad1d66: link becomes ready
[163974.611098] eth0: renamed from vethca716ce
[163974.193444] docker0: port 7(vethaad1d66) entered disabled state
[163974.192879] docker0: port 7(vethaad1d66) entered forwarding state
[163974.192734] docker0: port 7(vethaad1d66) entered blocking state
[163974.192568] IPv6: ADDRCONF(NETDEV_UP): vethaad1d66: link is not ready
[163974.191970] device vethaad1d66 entered promiscuous mode
[163974.191776] docker0: port 7(vethaad1d66) entered disabled state
[163974.191579] docker0: port 7(vethaad1d66) entered blocking state
[163800.915814] docker0: port 7(veth1765e6d) entered disabled state
[163800.915714] device veth1765e6d left promiscuous mode
[163800.915313] docker0: port 7(veth1765e6d) entered disabled state
[163800.886485] veth170eb5e: renamed from eth0
[163800.886225] docker0: port 7(veth1765e6d) entered disabled state
[163767.187809] docker0: port 7(veth1765e6d) entered forwarding state
[163767.187662] docker0: port 7(veth1765e6d) entered blocking state
[163767.187457] IPv6: ADDRCONF(NETDEV_CHANGE): veth1765e6d: link becomes ready
[163767.182089] eth0: renamed from veth170eb5e
[163766.550246] IPv6: ADDRCONF(NETDEV_UP): veth1765e6d: link is not ready
[163766.547305] device veth1765e6d entered promiscuous mode
[163766.545662] docker0: port 7(veth1765e6d) entered disabled state
[163766.545451] docker0: port 7(veth1765e6d) entered blocking state
[163666.400891] docker0: port 7(veth680572b) entered disabled state
[163666.400888] device veth680572b left promiscuous mode
[163666.400203] docker0: port 7(veth680572b) entered disabled state
[163666.384260] veth0233df3: renamed from eth0
[163666.384016] docker0: port 7(veth680572b) entered disabled state
[163632.549887] docker0: port 7(veth680572b) entered forwarding state
[163632.549742] docker0: port 7(veth680572b) entered blocking state
[163632.549493] IPv6: ADDRCONF(NETDEV_CHANGE): veth680572b: link becomes ready
[163632.537375] eth0: renamed from veth0233df3
[163632.090503] IPv6: ADDRCONF(NETDEV_UP): veth680572b: link is not ready
[163632.090289] device veth680572b entered promiscuous mode
[163632.089881] docker0: port 7(veth680572b) entered disabled state
[163632.089684] docker0: port 7(veth680572b) entered blocking state
[163546.989276] docker0: port 7(veth20f1f38) entered disabled state
[163546.989175] device veth20f1f38 left promiscuous mode
[163546.988808] docker0: port 7(veth20f1f38) entered disabled state
[163546.979964] docker0: port 7(veth20f1f38) entered disabled state
[163546.960522] veth1573bc3: renamed from eth0
[163512.654529] docker0: port 7(veth20f1f38) entered forwarding state
[163512.654383] docker0: port 7(veth20f1f38) entered blocking state
[163512.654158] IPv6: ADDRCONF(NETDEV_CHANGE): veth20f1f38: link becomes ready
[163512.649755] eth0: renamed from veth1573bc3
[163512.078640] IPv6: ADDRCONF(NETDEV_UP): veth20f1f38: link is not ready
[163512.059173] device veth20f1f38 entered promiscuous mode
[163512.058920] docker0: port 7(veth20f1f38) entered disabled state
[163512.058717] docker0: port 7(veth20f1f38) entered blocking state
[163418.250216] docker0: port 7(veth9be2cd6) entered disabled state
[163418.250029] device veth9be2cd6 left promiscuous mode
[163418.241830] docker0: port 7(veth9be2cd6) entered disabled state
[163418.195740] docker0: port 7(veth9be2cd6) entered disabled state
[163418.187216] veth8d6bd13: renamed from eth0
[163384.311830] docker0: port 7(veth9be2cd6) entered forwarding state
[163384.311686] docker0: port 7(veth9be2cd6) entered blocking state
[163384.311470] IPv6: ADDRCONF(NETDEV_CHANGE): veth9be2cd6: link becomes ready
[163384.302486] eth0: renamed from veth8d6bd13
[163383.790230] IPv6: ADDRCONF(NETDEV_UP): veth9be2cd6: link is not ready
[163383.785722] device veth9be2cd6 entered promiscuous mode
[163383.785471] docker0: port 7(veth9be2cd6) entered disabled state
[163383.785270] docker0: port 7(veth9be2cd6) entered blocking state
[163202.163985] docker0: port 7(veth40602a7) entered disabled state
[163202.163805] device veth40602a7 left promiscuous mode
[163202.146869] docker0: port 7(veth40602a7) entered disabled state
[163202.088532] veth61be9f9: renamed from eth0
[163202.088262] docker0: port 7(veth40602a7) entered disabled state
[163168.475823] docker0: port 7(veth40602a7) entered forwarding state
[163168.475677] docker0: port 7(veth40602a7) entered blocking state
[163168.475483] IPv6: ADDRCONF(NETDEV_CHANGE): veth40602a7: link becomes ready
[163168.470819] eth0: renamed from veth61be9f9
[163168.091141] docker0: port 7(veth40602a7) entered disabled state
[163168.082163] docker0: port 7(veth40602a7) entered forwarding state
[163168.082019] docker0: port 7(veth40602a7) entered blocking state
[163168.081842] IPv6: ADDRCONF(NETDEV_UP): veth40602a7: link is not ready
[163168.080713] device veth40602a7 entered promiscuous mode
[163168.080521] docker0: port 7(veth40602a7) entered disabled state
[163168.080357] docker0: port 7(veth40602a7) entered blocking state
[163076.807085] docker0: port 7(vethf273140) entered disabled state
[163076.806907] device vethf273140 left promiscuous mode
[163076.803874] docker0: port 7(vethf273140) entered disabled state
[163076.775198] veth56d78ce: renamed from eth0
[163076.774944] docker0: port 7(vethf273140) entered disabled state
[163042.534179] docker0: port 7(vethf273140) entered forwarding state
[163042.534034] docker0: port 7(vethf273140) entered blocking state
[163042.533809] IPv6: ADDRCONF(NETDEV_CHANGE): vethf273140: link becomes ready
[163042.527866] eth0: renamed from veth56d78ce
[163042.060717] docker0: port 7(vethf273140) entered disabled state
[163042.060238] docker0: port 7(vethf273140) entered forwarding state
[163042.060094] docker0: port 7(vethf273140) entered blocking state
[163042.059930] IPv6: ADDRCONF(NETDEV_UP): vethf273140: link is not ready
[163042.059715] device vethf273140 entered promiscuous mode
[163042.059528] docker0: port 7(vethf273140) entered disabled state
[163042.059333] docker0: port 7(vethf273140) entered blocking state
[162944.796918] docker0: port 7(vethe19c363) entered disabled state
[162944.796819] device vethe19c363 left promiscuous mode
[162944.796433] docker0: port 7(vethe19c363) entered disabled state
[162944.767634] veth4ab18b3: renamed from eth0
[162944.767361] docker0: port 7(vethe19c363) entered disabled state
[162911.086119] docker0: port 7(vethe19c363) entered forwarding state
[162911.085974] docker0: port 7(vethe19c363) entered blocking state
[162911.085779] IPv6: ADDRCONF(NETDEV_CHANGE): vethe19c363: link becomes ready
[162911.078370] eth0: renamed from veth4ab18b3
[162910.749492] docker0: port 7(vethe19c363) entered disabled state
[162910.734533] docker0: port 7(vethe19c363) entered forwarding state
[162910.734391] docker0: port 7(vethe19c363) entered blocking state
[162910.734234] IPv6: ADDRCONF(NETDEV_UP): vethe19c363: link is not ready
[162910.734035] device vethe19c363 entered promiscuous mode
[162910.733848] docker0: port 7(vethe19c363) entered disabled state
[162910.733652] docker0: port 7(vethe19c363) entered blocking state
[162819.445979] docker0: port 7(veth1a8d257) entered disabled state
[162819.445846] device veth1a8d257 left promiscuous mode
[162819.442556] docker0: port 7(veth1a8d257) entered disabled state
[162819.398233] veth84e77b5: renamed from eth0
[162819.397962] docker0: port 7(veth1a8d257) entered disabled state
[162785.290378] docker0: port 7(veth1a8d257) entered forwarding state
[162785.290224] docker0: port 7(veth1a8d257) entered blocking state
[162785.290010] IPv6: ADDRCONF(NETDEV_CHANGE): veth1a8d257: link becomes ready
[162785.282388] eth0: renamed from veth84e77b5
[162784.840166] IPv6: ADDRCONF(NETDEV_UP): veth1a8d257: link is not ready
[162784.835833] device veth1a8d257 entered promiscuous mode
[162784.835632] docker0: port 7(veth1a8d257) entered disabled state
[162784.835428] docker0: port 7(veth1a8d257) entered blocking state
[162691.775949] docker0: port 7(veth45f0026) entered disabled state
[162691.775945] device veth45f0026 left promiscuous mode
[162691.772524] docker0: port 7(veth45f0026) entered disabled state
[162691.754582] docker0: port 7(veth45f0026) entered disabled state
[162691.746103] veth676642d: renamed from eth0
[162658.098938] docker0: port 7(veth45f0026) entered forwarding state
[162658.098777] docker0: port 7(veth45f0026) entered blocking state
[162658.098550] IPv6: ADDRCONF(NETDEV_CHANGE): veth45f0026: link becomes ready
[162658.088996] eth0: renamed from veth676642d
[162657.774274] IPv6: ADDRCONF(NETDEV_UP): veth45f0026: link is not ready
[162657.774072] device veth45f0026 entered promiscuous mode
[162657.773871] docker0: port 7(veth45f0026) entered disabled state
[162657.773664] docker0: port 7(veth45f0026) entered blocking state
[162475.850748] docker0: port 7(veth206f8ab) entered disabled state
[162475.850582] device veth206f8ab left promiscuous mode
[162475.844803] docker0: port 7(veth206f8ab) entered disabled state
[162475.792790] veth34a1190: renamed from eth0
[162475.792508] docker0: port 7(veth206f8ab) entered disabled state
[162442.005461] docker0: port 7(veth206f8ab) entered forwarding state
[162442.005314] docker0: port 7(veth206f8ab) entered blocking state
[162442.005116] IPv6: ADDRCONF(NETDEV_CHANGE): veth206f8ab: link becomes ready
[162441.998204] eth0: renamed from veth34a1190
[162441.482896] docker0: port 7(veth206f8ab) entered disabled state
[162441.482287] docker0: port 7(veth206f8ab) entered forwarding state
[162441.482136] docker0: port 7(veth206f8ab) entered blocking state
[162441.481949] IPv6: ADDRCONF(NETDEV_UP): veth206f8ab: link is not ready
[162441.481709] device veth206f8ab entered promiscuous mode
[162441.481527] docker0: port 7(veth206f8ab) entered disabled state
[162441.481327] docker0: port 7(veth206f8ab) entered blocking state
[162386.463642] docker0: port 7(veth24db96b) entered disabled state
[162386.463638] device veth24db96b left promiscuous mode
[162386.463077] docker0: port 7(veth24db96b) entered disabled state
[162386.455311] docker0: port 7(veth24db96b) entered disabled state
[162386.444430] vethd631864: renamed from eth0
[162371.488830] docker0: port 9(veth0e96763) entered forwarding state
[162371.488677] docker0: port 9(veth0e96763) entered blocking state
[162371.488475] IPv6: ADDRCONF(NETDEV_CHANGE): veth0e96763: link becomes ready
[162371.484628] eth0: renamed from veth5dd417c
[162371.173397] IPv6: ADDRCONF(NETDEV_UP): veth0e96763: link is not ready
[162371.173182] device veth0e96763 entered promiscuous mode
[162371.173000] docker0: port 9(veth0e96763) entered disabled state
[162371.172801] docker0: port 9(veth0e96763) entered blocking state
[162368.484768] docker0: port 11(vethff6a8d1) entered disabled state
[162368.484765] device vethff6a8d1 left promiscuous mode
[162368.484223] docker0: port 11(vethff6a8d1) entered disabled state
[162368.475832] docker0: port 11(vethff6a8d1) entered disabled state
[162368.459183] vethf2b3de5: renamed from eth0
[162352.494967] docker0: port 7(veth24db96b) entered forwarding state
[162352.494820] docker0: port 7(veth24db96b) entered blocking state
[162352.494588] IPv6: ADDRCONF(NETDEV_CHANGE): veth24db96b: link becomes ready
[162352.479323] eth0: renamed from vethd631864
[162352.149613] docker0: port 7(veth24db96b) entered disabled state
[162352.149409] docker0: port 7(veth24db96b) entered forwarding state
[162352.149254] docker0: port 7(veth24db96b) entered blocking state
[162352.149093] IPv6: ADDRCONF(NETDEV_UP): veth24db96b: link is not ready
[162352.148889] device veth24db96b entered promiscuous mode
[162352.148695] docker0: port 7(veth24db96b) entered disabled state
[162352.148498] docker0: port 7(veth24db96b) entered blocking state
[162170.880641] docker0: port 7(veth7b262b7) entered disabled state
[162170.880540] device veth7b262b7 left promiscuous mode
[162170.880074] docker0: port 7(veth7b262b7) entered disabled state
[162170.862102] docker0: port 7(veth7b262b7) entered disabled state
[162170.854380] vethb598573: renamed from eth0
[162136.798967] docker0: port 7(veth7b262b7) entered forwarding state
[162136.798822] docker0: port 7(veth7b262b7) entered blocking state
[162136.798619] IPv6: ADDRCONF(NETDEV_CHANGE): veth7b262b7: link becomes ready
[162136.789702] eth0: renamed from vethb598573
[162136.439362] IPv6: ADDRCONF(NETDEV_UP): veth7b262b7: link is not ready
[162136.438952] device veth7b262b7 entered promiscuous mode
[162136.438554] docker0: port 7(veth7b262b7) entered disabled state
[162136.438344] docker0: port 7(veth7b262b7) entered blocking state
[162033.988688] docker0: port 7(vethf3c6a21) entered disabled state
[162033.988587] device vethf3c6a21 left promiscuous mode
[162033.987848] docker0: port 7(vethf3c6a21) entered disabled state
[162033.961452] vethdf700b2: renamed from eth0
[162033.961187] docker0: port 7(vethf3c6a21) entered disabled state
[162000.294505] docker0: port 7(vethf3c6a21) entered forwarding state
[162000.294359] docker0: port 7(vethf3c6a21) entered blocking state
[162000.294148] IPv6: ADDRCONF(NETDEV_CHANGE): vethf3c6a21: link becomes ready
[162000.287951] eth0: renamed from vethdf700b2
[161999.973005] IPv6: ADDRCONF(NETDEV_UP): vethf3c6a21: link is not ready
[161999.972644] device vethf3c6a21 entered promiscuous mode
[161999.972402] docker0: port 7(vethf3c6a21) entered disabled state
[161999.972204] docker0: port 7(vethf3c6a21) entered blocking state
[161989.260400] docker0: port 9(veth5978a90) entered disabled state
[161989.260297] device veth5978a90 left promiscuous mode
[161989.259913] docker0: port 9(veth5978a90) entered disabled state
[161989.241456] docker0: port 9(veth5978a90) entered disabled state
[161989.226000] vethafd4d10: renamed from eth0
[161977.896992] docker0: port 7(vetha308ecb) entered disabled state
[161977.896989] device vetha308ecb left promiscuous mode
[161977.896416] docker0: port 7(vetha308ecb) entered disabled state
[161977.874381] vetha2ad6ab: renamed from eth0
[161977.873196] docker0: port 7(vetha308ecb) entered disabled state
[161968.324104] docker0: port 12(vethc54ef91) entered forwarding state
[161968.323958] docker0: port 12(vethc54ef91) entered blocking state
[161968.323737] IPv6: ADDRCONF(NETDEV_CHANGE): vethc54ef91: link becomes ready
[161968.317646] eth0: renamed from veth52875ae
[161967.883559] docker0: port 12(vethc54ef91) entered disabled state
[161967.883046] docker0: port 12(vethc54ef91) entered forwarding state
[161967.882895] docker0: port 12(vethc54ef91) entered blocking state
[161967.882710] IPv6: ADDRCONF(NETDEV_UP): vethc54ef91: link is not ready
[161967.882458] device vethc54ef91 entered promiscuous mode
[161967.882208] docker0: port 12(vethc54ef91) entered disabled state

In between we upgraded to the new CoreOS stable release 1800.4.0 with the hope that there reboots won't happen, however still the same.

encodeflush commented Aug 2, 2018

Here are crash logs from 2 k8s workers.

[243340.078539] Kernel Offset: 0xd000000 from 0xffffffff81000000 (relocation range: 0xffffffff80000000-0xffffffffbfffffff)
[243339.572050] R13: 0000000000000018 R14: 0000000000000011 R15: 0000000000000002
[243339.571353] R10: 00005613b7f73d60 R11: 0000000000000246 R12: 0000000000000001
[243339.570638] RBP: 00005613b7f73c80 R08: 000000002d68616d R09: 00007ffcd0546d90
[243339.569925] RDX: 00005613b7f73d40 RSI: 0000000000000001 RDI: 0000000000000001
[243339.569214] RAX: ffffffffffffffda RBX: 00005613b7f73d40 RCX: 00007f915f2adb59
[243339.568503] RSP: 002b:00007ffcd0546d28 EFLAGS: 00000246 ORIG_RAX: 000000000000013d
[243339.567871] RIP: 0033:0x7f915f2adb59
[243339.567205]  entry_SYSCALL_64_after_hwframe+0x3d/0xa2
[243339.566552]  do_syscall_64+0x67/0x120
[243339.565903]  do_seccomp+0x285/0x6c0
[243339.565217]  ? hardlockup_detector_perf_cleanup+0x80/0x80
[243339.564551]  bpf_prog_create_from_user+0xb0/0x110
[243339.563911]  ? kmemdup+0x2d/0x40
[243339.563253]  bpf_prepare_filter+0x2f0/0x3d0
[243339.562584]  bpf_prog_select_runtime+0x4e/0xe0
[243339.561934]  set_memory_ro+0x26/0x30
[243339.561271]  ? bpf_convert_filter+0x9e4/0xa50
[243339.560601]  change_page_attr_set_clr+0x2b3/0x470
[243339.559946]  vm_unmap_aliases+0xe9/0x120
[243339.559278]  __purge_vmap_area_lazy+0x4d/0xc0
[243339.558609]  flush_tlb_kernel_range+0x48/0x90
[243339.557962]  on_each_cpu+0x28/0x60
[243339.557306]  ? load_new_mm_cr3+0xe0/0xe0
[243339.556637]  ? smp_call_function_many+0x209/0x250
[243339.555976]  ? load_new_mm_cr3+0xe0/0xe0
[243339.555270] R13: 0000000000000200 R14: ffffffff8e06c7e0 R15: 0000000000000000
[243339.554569] R10: ffff93817fca2448 R11: 0000000000000008 R12: ffff93817fca2448
[243339.553862] RBP: ffff93817fca2488 R08: ffffffffffffffff R09: 000000000000000d
[243339.553151] RDX: ffff93817fc26180 RSI: 0000000000000000 RDI: ffff93817fca2448
[243339.552434] RAX: 0000000000000000 RBX: ffff93817fca2440 RCX: 0000000000000001
[243339.551715] RSP: 0018:ffffa97a07cffc88 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff10
[243339.551042] RIP: 0010:smp_call_function_many+0x22d/0x250
[243339.550425]  </IRQ>
[243339.549766]  apic_timer_interrupt+0x7d/0x90
[243339.549086]  smp_apic_timer_interrupt+0x66/0x120
[243339.548415]  hrtimer_interrupt+0xa6/0x1f0
[243339.547735]  __hrtimer_run_queues+0xde/0x230
[243339.547062]  ? watchdog+0x30/0x30
[243339.546357]  watchdog_timer_fn+0x20e/0x220
[243339.545652]  panic+0xe4/0x252
[243339.544924]  dump_stack+0x5c/0x85
[243339.544214]  <IRQ>
[243339.543472] Call Trace:
[243339.541830] Hardware name: VMware, Inc. VMware7,1/440BX Desktop Reference Platform, BIOS VMW71.00V.0.B64.1801120748 01/12/2018
[243339.540952] CPU: 1 PID: 565 Comm: runc:[2:INIT] Tainted: G             L  4.14.48-coreos-r2 #1
[243339.540111] Kernel panic - not syncing: softlockup: hung tasks
[243339.538262] Code: 89 c7 e8 37 cf 4f 00 3b 05 85 c5 21 01 0f 83 57 fe ff ff 48 63 c8 48 8b 13 48 03 14 cd 80 26 00 8f 8b 4a 18 83 e1 01 74 0a f3 90 <8b> 4a 18 83 e1 01 75 f6 eb c8 48 c7 c2 e0 79 31 8f 48 89 ee 89 
[243339.537396] R13: 0000000000000018 R14: 0000000000000011 R15: 0000000000000002
[243339.536528] R10: 00005613b7f73d60 R11: 0000000000000246 R12: 0000000000000001
[243339.535658] RBP: 00005613b7f73c80 R08: 000000002d68616d R09: 00007ffcd0546d90
[243339.534782] RDX: 00005613b7f73d40 RSI: 0000000000000001 RDI: 0000000000000001
[243339.533906] RAX: ffffffffffffffda RBX: 00005613b7f73d40 RCX: 00007f915f2adb59
[243339.533030] RSP: 002b:00007ffcd0546d28 EFLAGS: 00000246 ORIG_RAX: 000000000000013d
[243339.532231] RIP: 0033:0x7f915f2adb59
[243339.531394]  entry_SYSCALL_64_after_hwframe+0x3d/0xa2
[243339.530585]  do_syscall_64+0x67/0x120
[243339.529765]  do_seccomp+0x285/0x6c0
[243339.528900]  ? hardlockup_detector_perf_cleanup+0x80/0x80
[243339.528050]  bpf_prog_create_from_user+0xb0/0x110
[243339.527217]  ? kmemdup+0x2d/0x40
[243339.526365]  bpf_prepare_filter+0x2f0/0x3d0
[243339.525504]  bpf_prog_select_runtime+0x4e/0xe0
[243339.524648]  set_memory_ro+0x26/0x30
[243339.523772]  ? bpf_convert_filter+0x9e4/0xa50
[243339.522572]  change_page_attr_set_clr+0x2b3/0x470
[243339.521153]  vm_unmap_aliases+0xe9/0x120
[243339.521035]  __purge_vmap_area_lazy+0x4d/0xc0
[243339.520916]  flush_tlb_kernel_range+0x48/0x90
[243339.520815]  on_each_cpu+0x28/0x60
[243339.520705]  ? load_new_mm_cr3+0xe0/0xe0
[243339.520615] Call Trace:
[243339.520398] CR2: 00005613b8017008 CR3: 00000007073fa003 CR4: 00000000000606e0
[243339.520258] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[243339.520075] FS:  00007f915fdf5e80(0000) GS:ffff93817fc80000(0000) knlGS:0000000000000000
[243339.519909] R13: 0000000000000200 R14: ffffffff8e06c7e0 R15: 0000000000000000
[243339.519743] R10: ffff93817fca2448 R11: 0000000000000008 R12: ffff93817fca2448
[243339.519573] RBP: ffff93817fca2488 R08: ffffffffffffffff R09: 000000000000000d
[243339.519407] RDX: ffff93817fc26180 RSI: 0000000000000000 RDI: ffff93817fca2448
[243339.519241] RAX: 0000000000000000 RBX: ffff93817fca2440 RCX: 0000000000000001
[243339.519067] RSP: 0018:ffffa97a07cffc88 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff10
[243339.518934] RIP: 0010:smp_call_function_many+0x22d/0x250
[243339.518784] task: ffff938067d90000 task.stack: ffffa97a07cfc000
[243339.518511] Hardware name: VMware, Inc. VMware7,1/440BX Desktop Reference Platform, BIOS VMW71.00V.0.B64.1801120748 01/12/2018
[243339.518340] CPU: 1 PID: 565 Comm: runc:[2:INIT] Not tainted 4.14.48-coreos-r2 #1
[243339.518168]  vmxnet3 scsi_mod dm_mirror dm_region_hash dm_log dm_mod dax
[243339.516599] Modules linked in: xt_statistic xt_nat xt_recent ipt_REJECT nf_reject_ipv4 ip_set veth xt_comment xt_mark cmac arc4 ecb md4 nls_utf8 cifs ccm fscache nf_conntrack_netlink nfnetlink xfrm_user xfrm_algo xt_addrtype xt_conntrack br_netfilter bridge stp llc iptable_filter ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack libcrc32c vxlan ip6_udp_tunnel udp_tunnel overlay vmw_vsock_vmci_transport vsock nls_ascii nls_cp437 vfat fat mousedev vmw_balloon evdev efi_pstore sb_edac edac_core psmouse efivars i2c_piix4 vmw_vmci i2c_core button sch_fq_codel ext4 crc32c_generic crc16 mbcache jbd2 fscrypto dm_verity dm_bufio sr_mod cdrom sd_mod crc32c_intel aesni_intel aes_x86_64 crypto_simd cryptd glue_helper ata_piix libata vmw_pvscsi
[243339.516362] watchdog: BUG: soft lockup - CPU#1 stuck for 22s! [runc:[2:INIT]:565]
[243314.155852] docker0: port 22(veth5c9e11d) entered forwarding state
[243314.155708] docker0: port 22(veth5c9e11d) entered blocking state
[243314.155497] IPv6: ADDRCONF(NETDEV_UP): veth5c9e11d: link is not ready
[243314.142862] device veth5c9e11d entered promiscuous mode
[243314.142676] docker0: port 22(veth5c9e11d) entered disabled state
[243314.142511] docker0: port 22(veth5c9e11d) entered blocking state
[243313.934229] IPv6: ADDRCONF(NETDEV_UP): veth5649440: link is not ready
[243313.934030] device veth5649440 entered promiscuous mode
[243313.933826] docker0: port 21(veth5649440) entered disabled state
[243313.933625] docker0: port 21(veth5649440) entered blocking state
[243287.850288] docker0: port 20(veth648577f) entered forwarding state
[243287.850142] docker0: port 20(veth648577f) entered blocking state
[243287.849929] IPv6: ADDRCONF(NETDEV_CHANGE): veth648577f: link becomes ready
[243287.845609] eth0: renamed from veth6eb2c07
[243287.622664] docker0: port 20(veth648577f) entered disabled state
[243287.575228] docker0: port 20(veth648577f) entered forwarding state
[243287.575085] docker0: port 20(veth648577f) entered blocking state
[243287.574922] IPv6: ADDRCONF(NETDEV_UP): veth648577f: link is not ready
[243287.574705] device veth648577f entered promiscuous mode
[243287.574497] docker0: port 20(veth648577f) entered disabled state
[243287.574296] docker0: port 20(veth648577f) entered blocking state
[243286.825205] docker0: port 19(veth326c558) entered forwarding state
[243286.825058] docker0: port 19(veth326c558) entered blocking state
[243286.824834] IPv6: ADDRCONF(NETDEV_CHANGE): veth326c558: link becomes ready
[243286.818919] eth0: renamed from vethf09c996
[243286.622676] IPv6: ADDRCONF(NETDEV_UP): veth326c558: link is not ready
[243286.622603] device veth326c558 entered promiscuous mode
[243286.622566] docker0: port 19(veth326c558) entered disabled state
[243286.622563] docker0: port 19(veth326c558) entered blocking state
[243285.820185] docker0: port 18(vethc96923d) entered forwarding state
[243285.820039] docker0: port 18(vethc96923d) entered blocking state
[243285.819845] IPv6: ADDRCONF(NETDEV_CHANGE): vethc96923d: link becomes ready
[243285.811155] eth0: renamed from vethf63159b
[243285.548340] IPv6: ADDRCONF(NETDEV_UP): vethc96923d: link is not ready
[243285.548142] device vethc96923d entered promiscuous mode
[243285.547954] docker0: port 18(vethc96923d) entered disabled state
[243285.547747] docker0: port 18(vethc96923d) entered blocking state
[243285.219237] IPv6: ADDRCONF(NETDEV_CHANGE): veth19e8417: link becomes ready
[243285.214354] eth0: renamed from veth61ef1d1
[243284.952588] docker0: port 17(veth19e8417) entered forwarding state
[243284.952446] docker0: port 17(veth19e8417) entered blocking state
[243284.952288] IPv6: ADDRCONF(NETDEV_UP): veth19e8417: link is not ready
[243284.951578] device veth19e8417 entered promiscuous mode
[243284.951384] docker0: port 17(veth19e8417) entered disabled state
[243284.951194] docker0: port 17(veth19e8417) entered blocking state
[243284.642209] docker0: port 16(vethe9dce91) entered forwarding state
[243284.642064] docker0: port 16(vethe9dce91) entered blocking state
[243284.641860] IPv6: ADDRCONF(NETDEV_CHANGE): vethe9dce91: link becomes ready
[243284.635451] eth0: renamed from veth1d107e7
[243284.313154] IPv6: ADDRCONF(NETDEV_UP): vethe9dce91: link is not ready
[243284.307464] device vethe9dce91 entered promiscuous mode
[243284.307279] docker0: port 16(vethe9dce91) entered disabled state
[243284.307082] docker0: port 16(vethe9dce91) entered blocking state
[243283.292908] IPv6: ADDRCONF(NETDEV_CHANGE): veth3e2e545: link becomes ready
[243283.282044] eth0: renamed from veth92a96d2
[243283.005249] docker0: port 15(veth3e2e545) entered forwarding state
[243283.005105] docker0: port 15(veth3e2e545) entered blocking state
[243283.004950] IPv6: ADDRCONF(NETDEV_UP): veth3e2e545: link is not ready
[243283.004754] device veth3e2e545 entered promiscuous mode
[243283.004546] docker0: port 15(veth3e2e545) entered disabled state
[243283.004344] docker0: port 15(veth3e2e545) entered blocking state
[243282.735695] docker0: port 14(veth33a44ac) entered forwarding state
[243282.735532] docker0: port 14(veth33a44ac) entered blocking state
[243282.735299] IPv6: ADDRCONF(NETDEV_CHANGE): veth33a44ac: link becomes ready
[243282.723449] eth0: renamed from veth0095a17
[243282.498760] IPv6: ADDRCONF(NETDEV_UP): veth33a44ac: link is not ready
[243282.497027] device veth33a44ac entered promiscuous mode
[243282.496838] docker0: port 14(veth33a44ac) entered disabled state
[243282.496630] docker0: port 14(veth33a44ac) entered blocking state
[243281.543868] IPv6: ADDRCONF(NETDEV_CHANGE): vethada3c75: link becomes ready
[243281.538780] eth0: renamed from veth630c5e0
[243281.267890] docker0: port 13(vethada3c75) entered forwarding state
[243281.267745] docker0: port 13(vethada3c75) entered blocking state
[243281.267576] IPv6: ADDRCONF(NETDEV_UP): vethada3c75: link is not ready
[243281.267369] device vethada3c75 entered promiscuous mode
[243281.265912] docker0: port 13(vethada3c75) entered disabled state
[243281.265713] docker0: port 13(vethada3c75) entered blocking state
[243281.032627] docker0: port 12(veth3690d19) entered forwarding state
[243281.032478] docker0: port 12(veth3690d19) entered blocking state
[243281.032105] IPv6: ADDRCONF(NETDEV_CHANGE): veth3690d19: link becomes ready
[243281.026133] eth0: renamed from vetha2a977a
[243280.934437] docker0: port 11(veth7836875) entered forwarding state
[243280.934291] docker0: port 11(veth7836875) entered blocking state
[243280.934098] IPv6: ADDRCONF(NETDEV_CHANGE): veth7836875: link becomes ready
[243280.933890] docker0: port 12(veth3690d19) entered disabled state
[243280.929284] eth0: renamed from vethb13090c
[243280.726958] docker0: port 12(veth3690d19) entered forwarding state
[243280.726811] docker0: port 12(veth3690d19) entered blocking state
[243280.726637] IPv6: ADDRCONF(NETDEV_UP): veth3690d19: link is not ready
[243280.724527] device veth3690d19 entered promiscuous mode
[243280.722930] docker0: port 12(veth3690d19) entered disabled state
[243280.722726] docker0: port 12(veth3690d19) entered blocking state
[243280.657708] docker0: port 11(veth7836875) entered disabled state
[243280.551343] docker0: port 11(veth7836875) entered forwarding state
[243280.551199] docker0: port 11(veth7836875) entered blocking state
[243280.550985] IPv6: ADDRCONF(NETDEV_UP): veth7836875: link is not ready
[243280.545494] device veth7836875 entered promiscuous mode
[243280.545337] docker0: port 11(veth7836875) entered disabled state
[243280.545217] docker0: port 11(veth7836875) entered blocking state
[243280.163355] docker0: port 10(veth63ba84a) entered forwarding state
[243280.163206] docker0: port 10(veth63ba84a) entered blocking state
[243280.162996] IPv6: ADDRCONF(NETDEV_CHANGE): veth63ba84a: link becomes ready
[243280.157413] eth0: renamed from vethd501b40
[243279.837600] docker0: port 9(vethbcc5218) entered forwarding state
[243279.837599] docker0: port 9(vethbcc5218) entered blocking state
[243279.837573] IPv6: ADDRCONF(NETDEV_CHANGE): vethbcc5218: link becomes ready
[243279.837526] docker0: port 10(veth63ba84a) entered disabled state
[243279.825796] eth0: renamed from vethdccae08
[243279.778518] docker0: port 10(veth63ba84a) entered forwarding state
[243279.778367] docker0: port 10(veth63ba84a) entered blocking state
[243279.778192] IPv6: ADDRCONF(NETDEV_UP): veth63ba84a: link is not ready
[243279.774477] device veth63ba84a entered promiscuous mode
[243279.774226] docker0: port 10(veth63ba84a) entered disabled state
[243279.774031] docker0: port 10(veth63ba84a) entered blocking state
[243279.650760] docker0: port 9(vethbcc5218) entered disabled state
[243279.389230] docker0: port 9(vethbcc5218) entered forwarding state
[243279.388586] docker0: port 9(vethbcc5218) entered blocking state
[243279.387914] IPv6: ADDRCONF(NETDEV_UP): vethbcc5218: link is not ready
[243279.386784] device vethbcc5218 entered promiscuous mode
[243279.384784] docker0: port 9(vethbcc5218) entered disabled state
[243279.382640] docker0: port 9(vethbcc5218) entered blocking state
[243279.335705] docker0: port 7(veth78c4261) entered forwarding state
[243279.335022] docker0: port 7(veth78c4261) entered blocking state
[243279.332784] IPv6: ADDRCONF(NETDEV_CHANGE): veth78c4261: link becomes ready
[243279.323089] eth0: renamed from vethb4da3be
[243279.297319] docker0: port 8(veth345c7b7) entered forwarding state
[243279.296469] docker0: port 8(veth345c7b7) entered blocking state
[243279.294261] IPv6: ADDRCONF(NETDEV_CHANGE): veth345c7b7: link becomes ready
[243279.279486] eth0: renamed from vethc232d0f
[243278.925455] docker0: port 6(veth43e0505) entered forwarding state
[243278.924832] docker0: port 6(veth43e0505) entered blocking state
[243278.924150] IPv6: ADDRCONF(NETDEV_CHANGE): veth43e0505: link becomes ready
[243278.923483] docker0: port 8(veth345c7b7) entered disabled state
[243278.921312] docker0: port 7(veth78c4261) entered disabled state
[243278.909824] eth0: renamed from veth210548d
[243278.871511] docker0: port 8(veth345c7b7) entered forwarding state
[243278.870884] docker0: port 8(veth345c7b7) entered blocking state
[243278.870218] IPv6: ADDRCONF(NETDEV_UP): veth345c7b7: link is not ready
[243278.868219] device veth345c7b7 entered promiscuous mode
[243278.865959] docker0: port 8(veth345c7b7) entered disabled state
[243278.863778] docker0: port 8(veth345c7b7) entered blocking state
[243278.682494] docker0: port 7(veth78c4261) entered forwarding state
[243278.681811] docker0: port 7(veth78c4261) entered blocking state
[243278.681080] IPv6: ADDRCONF(NETDEV_UP): veth78c4261: link is not ready
[243278.677350] device veth78c4261 entered promiscuous mode
[243278.667837] docker0: port 7(veth78c4261) entered disabled state
[243278.665653] docker0: port 7(veth78c4261) entered blocking state
[243278.647856] docker0: port 6(veth43e0505) entered disabled state
[243278.250470] docker0: port 6(veth43e0505) entered forwarding state
[243278.249422] docker0: port 6(veth43e0505) entered blocking state
[243278.247398] IPv6: ADDRCONF(NETDEV_UP): veth43e0505: link is not ready
[243278.241195] device veth43e0505 entered promiscuous mode
[243278.237841] docker0: port 6(veth43e0505) entered disabled state
[243278.237634] docker0: port 6(veth43e0505) entered blocking state
[243278.183759] docker0: port 5(veth9af116b) entered forwarding state
[243278.183582] docker0: port 5(veth9af116b) entered blocking state
[243278.183406] IPv6: ADDRCONF(NETDEV_CHANGE): veth9af116b: link becomes ready
[243278.183234] docker0: port 4(veth6ffaed4) entered forwarding state
[243278.183085] docker0: port 4(veth6ffaed4) entered blocking state
[243278.182836] IPv6: ADDRCONF(NETDEV_CHANGE): veth6ffaed4: link becomes ready
[243278.135212] eth0: renamed from vethdecbdb1
[243278.110267] eth0: renamed from vethe0774b0
[243278.034944] docker0: port 3(veth0ff0a23) entered forwarding state
[243278.034798] docker0: port 3(veth0ff0a23) entered blocking state
[243278.034596] IPv6: ADDRCONF(NETDEV_CHANGE): veth0ff0a23: link becomes ready
[243278.034418] docker0: port 5(veth9af116b) entered disabled state
[243278.034144] docker0: port 4(veth6ffaed4) entered disabled state
[243278.029654] eth0: renamed from vethc7437dd
[243277.891355] docker0: port 5(veth9af116b) entered forwarding state
[243277.891212] docker0: port 5(veth9af116b) entered blocking state
[243277.891034] IPv6: ADDRCONF(NETDEV_UP): veth9af116b: link is not ready
[243277.886111] device veth9af116b entered promiscuous mode
[243277.885462] docker0: port 5(veth9af116b) entered disabled state
[243277.885254] docker0: port 5(veth9af116b) entered blocking state
[243277.731739] docker0: port 4(veth6ffaed4) entered forwarding state
[243277.731577] docker0: port 4(veth6ffaed4) entered blocking state
[243277.731423] IPv6: ADDRCONF(NETDEV_UP): veth6ffaed4: link is not ready
[243277.731235] device veth6ffaed4 entered promiscuous mode
[243277.731057] docker0: port 4(veth6ffaed4) entered disabled state
[243277.730863] docker0: port 4(veth6ffaed4) entered blocking state
[243277.637602] IPv6: ADDRCONF(NETDEV_UP): veth0ff0a23: link is not ready
[243277.637262] device veth0ff0a23 entered promiscuous mode
[243277.636991] docker0: port 3(veth0ff0a23) entered disabled state
[243277.636793] docker0: port 3(veth0ff0a23) entered blocking state
[210416.235159] CIFS VFS: Free previous auth_key.response = ffff938161cdfa00
[210416.233813] CIFS VFS: Server has not responded in 120 seconds. Reconnecting...
[169090.706515] docker0: port 24(veth7bbfebf) entered disabled state
[169090.706410] device veth7bbfebf left promiscuous mode
[169090.705467] docker0: port 24(veth7bbfebf) entered disabled state
[169090.681347] veth629e01f: renamed from eth0
[169090.680058] docker0: port 24(veth7bbfebf) entered disabled state
[169090.139791] docker0: port 21(vethf3c0b04) entered disabled state
[169090.139787] device vethf3c0b04 left promiscuous mode
[169090.139101] docker0: port 21(vethf3c0b04) entered disabled state
[169090.092164] vethb2c1650: renamed from eth0
[169090.091887] docker0: port 21(vethf3c0b04) entered disabled state
[169087.251200] docker0: port 8(vethb20a654) entered disabled state
[169087.251196] device vethb20a654 left promiscuous mode
[169087.247933] docker0: port 8(vethb20a654) entered disabled state
[169087.217705] veth6eab0e0: renamed from eth0
[169087.217449] docker0: port 8(vethb20a654) entered disabled state
[169087.069431] docker0: port 22(veth27ecd57) entered disabled state
[169087.069328] device veth27ecd57 left promiscuous mode
[169087.066084] docker0: port 22(veth27ecd57) entered disabled state
[169087.033634] docker0: port 23(veth596ab10) entered disabled state
[169087.033531] device veth596ab10 left promiscuous mode
[169087.032157] docker0: port 23(veth596ab10) entered disabled state
[169087.004058] veth1b2115c: renamed from eth0
[169087.003788] docker0: port 22(veth27ecd57) entered disabled state
[169086.985677] veth77a2a6c: renamed from eth0
[169086.985413] docker0: port 23(veth596ab10) entered disabled state
[169072.555061] vmw_pvscsi: msg: device removed at scsi0:2:0
[169072.554868] vmw_pvscsi: msg type: 0x1 - MSG RING: 10/9 (5) 
[169066.003730] docker0: port 29(veth6b4dafb) entered disabled state
[169066.003549] device veth6b4dafb left promiscuous mode
[169065.991115] docker0: port 29(veth6b4dafb) entered disabled state
[169065.879882] vethfb95e1b: renamed from eth0
[169065.879593] docker0: port 29(veth6b4dafb) entered disabled state
[169064.534545] docker0: port 20(veth8ec635f) entered disabled state
[169064.534542] device veth8ec635f left promiscuous mode
[169064.533250] docker0: port 20(veth8ec635f) entered disabled state
[169064.512612] docker0: port 13(veth4877b5a) entered disabled state
[169064.512608] device veth4877b5a left promiscuous mode
[169064.512150] docker0: port 13(veth4877b5a) entered disabled state
[169064.492805] docker0: port 5(veth4db8725) entered disabled state
[169064.492802] device veth4db8725 left promiscuous mode
[169064.490375] docker0: port 5(veth4db8725) entered disabled state
[169064.469848] docker0: port 19(vethe241df2) entered disabled state
[169064.469707] device vethe241df2 left promiscuous mode
[169064.466039] docker0: port 19(vethe241df2) entered disabled state
[169064.451547] docker0: port 5(veth4db8725) entered disabled state
[169064.436554] veth493e496: renamed from eth0
[169064.420140] veth4853cc9: renamed from eth0
[169064.419892] docker0: port 13(veth4877b5a) entered disabled state
[169064.408692] vetha1fdaeb: renamed from eth0
[169064.408447] docker0: port 20(veth8ec635f) entered disabled state
[169064.382212] veth6f8b610: renamed from eth0
[169064.378298] docker0: port 19(vethe241df2) entered disabled state
[169064.368666] vmw_pvscsi: msg: device removed at scsi0:3:0
[169064.368511] vmw_pvscsi: msg type: 0x1 - MSG RING: 9/8 (5) 
[169063.840280] docker0: port 9(veth1d9cf8c) entered disabled state
[169063.840074] device veth1d9cf8c left promiscuous mode
[169063.822241] docker0: port 9(veth1d9cf8c) entered disabled state
[169063.779743] docker0: port 15(veth26e3270) entered disabled state
[169063.779563] device veth26e3270 left promiscuous mode
[169063.772709] docker0: port 15(veth26e3270) entered disabled state
[169063.716365] docker0: port 3(veth73d792e) entered disabled state
[169063.716213] device veth73d792e left promiscuous mode
[169063.714659] docker0: port 3(veth73d792e) entered disabled state
[169063.651857] docker0: port 16(veth96a51be) entered disabled state
[169063.651853] device veth96a51be left promiscuous mode
[169063.651523] docker0: port 16(veth96a51be) entered disabled state
[169063.625044] docker0: port 7(vetha0b0094) entered disabled state
[169063.624861] device vetha0b0094 left promiscuous mode
[169063.624291] docker0: port 7(vetha0b0094) entered disabled state
[169063.608799] docker0: port 12(veth3a9550f) entered disabled state
[169063.608656] device veth3a9550f left promiscuous mode
[169063.607235] docker0: port 12(veth3a9550f) entered disabled state
[169063.573091] docker0: port 26(veth0eb1e21) entered disabled state
[169063.573087] device veth0eb1e21 left promiscuous mode
[169063.569534] docker0: port 26(veth0eb1e21) entered disabled state
[169063.542553] vethdf2fa32: renamed from eth0
[169063.538518] docker0: port 15(veth26e3270) entered disabled state
[169063.532012] vethf3a8f00: renamed from eth0
[169063.455086] docker0: port 9(veth1d9cf8c) entered disabled state
[169063.454335] docker0: port 26(veth0eb1e21) entered disabled state
[169063.424394] veth746fc3a: renamed from eth0
[169063.395803] veth71efe52: renamed from eth0
[169063.390690] docker0: port 16(veth96a51be) entered disabled state
[169063.390425] docker0: port 7(vetha0b0094) entered disabled state
[169063.380951] veth7320c45: renamed from eth0
[169063.374713] docker0: port 17(vethcb3b61c) entered disabled state
[169063.374572] device vethcb3b61c left promiscuous mode
[169063.373097] docker0: port 17(vethcb3b61c) entered disabled state
[169063.320765] veth88c5ed6: renamed from eth0
[169063.320310] docker0: port 3(veth73d792e) entered disabled state
[169063.306150] docker0: port 27(veth2ef7d19) entered disabled state
[169063.305965] device veth2ef7d19 left promiscuous mode
[169063.300655] docker0: port 27(veth2ef7d19) entered disabled state
[169063.278802] docker0: port 12(veth3a9550f) entered disabled state
[169063.272019] veth5523f5a: renamed from eth0
[169063.253378] veth6a0e846: renamed from eth0
[169063.253129] docker0: port 17(vethcb3b61c) entered disabled state
[169063.239552] docker0: port 18(veth641b2ef) entered disabled state
[169063.239411] device veth641b2ef left promiscuous mode
[169063.234129] docker0: port 18(veth641b2ef) entered disabled state
[169063.192210] docker0: port 30(veth5f34a63) entered disabled state
[169063.192067] device veth5f34a63 left promiscuous mode
[169063.190159] docker0: port 30(veth5f34a63) entered disabled state
[169063.105773] vethfd419aa: renamed from eth0
[169063.105114] docker0: port 27(veth2ef7d19) entered disabled state
[169063.034842] veth9082d3f: renamed from eth0
[169063.034577] docker0: port 18(veth641b2ef) entered disabled state
[169062.931635] docker0: port 28(vethfa21f8a) entered disabled state
[169062.931632] device vethfa21f8a left promiscuous mode
[169062.929781] docker0: port 28(vethfa21f8a) entered disabled state
[169062.849826] vethdd0b2af: renamed from eth0
[169062.849537] docker0: port 30(veth5f34a63) entered disabled state
[169062.799596] docker0: port 28(vethfa21f8a) entered disabled state
[169062.786354] veth5beb1a7: renamed from eth0
[169061.035855] docker0: port 4(veth217e7ec) entered disabled state
[169061.035719] device veth217e7ec left promiscuous mode
[169061.034512] docker0: port 4(veth217e7ec) entered disabled state
[169060.972288] vethbfd49b0: renamed from eth0
[169060.971135] docker0: port 4(veth217e7ec) entered disabled state
[169060.922349] docker0: port 14(veth6a20067) entered disabled state
[169060.922174] device veth6a20067 left promiscuous mode
[169060.914514] docker0: port 14(veth6a20067) entered disabled state
[169060.877171] veth20d5879: renamed from eth0
[169060.875965] docker0: port 14(veth6a20067) entered disabled state
[169060.861541] docker0: port 6(vethcc8744c) entered disabled state
[169060.861405] device vethcc8744c left promiscuous mode
[169060.860578] docker0: port 6(vethcc8744c) entered disabled state
[169060.811763] veth2ee4cc3: renamed from eth0
[169060.811489] docker0: port 6(vethcc8744c) entered disabled state
[169060.421647] docker0: port 11(veth7bc12df) entered disabled state
[169060.421450] device veth7bc12df left promiscuous mode
[169060.404449] docker0: port 11(veth7bc12df) entered disabled state
[169060.341202] vmw_pvscsi: msg: device removed at scsi0:1:0
[169060.341020] vmw_pvscsi: msg type: 0x1 - MSG RING: 8/7 (5) 
[169060.332511] vethc794670: renamed from eth0
[169060.326584] docker0: port 11(veth7bc12df) entered disabled state
[169060.065013] docker0: port 25(vethb7cda73) entered disabled state
[169060.064826] device vethb7cda73 left promiscuous mode
[169060.024715] docker0: port 25(vethb7cda73) entered disabled state
[169059.878266] veth6643644: renamed from eth0
[169059.877444] docker0: port 25(vethb7cda73) entered disabled state
[169059.622318] docker0: port 10(vethe5a92c4) entered disabled state
[169059.622314] device vethe5a92c4 left promiscuous mode
[169059.619118] docker0: port 10(vethe5a92c4) entered disabled state
[169059.595506] veth19d50af: renamed from eth0
[169059.595215] docker0: port 10(vethe5a92c4) entered disabled state
[169004.154858] docker0: port 29(veth6b4dafb) entered forwarding state
[169004.154148] docker0: port 29(veth6b4dafb) entered blocking state
[169004.151861] IPv6: ADDRCONF(NETDEV_CHANGE): veth6b4dafb: link becomes ready
[169004.138811] eth0: renamed from vethfb95e1b
[169004.085225] docker0: port 30(veth5f34a63) entered forwarding state
[169004.084542] docker0: port 30(veth5f34a63) entered blocking state
[169004.082206] IPv6: ADDRCONF(NETDEV_CHANGE): veth5f34a63: link becomes ready
[169004.057601] eth0: renamed from vethdd0b2af
[169003.114405] docker0: port 28(vethfa21f8a) entered forwarding state
[169003.113724] docker0: port 28(vethfa21f8a) entered blocking state
[169003.111202] IPv6: ADDRCONF(NETDEV_CHANGE): vethfa21f8a: link becomes ready
[169003.085676] eth0: renamed from veth5beb1a7
[169002.849852] docker0: port 30(veth5f34a63) entered disabled state
[169002.847571] docker0: port 29(veth6b4dafb) entered disabled state
[169002.468561] docker0: port 30(veth5f34a63) entered forwarding state
[169002.467842] docker0: port 30(veth5f34a63) entered blocking state
[169002.465649] IPv6: ADDRCONF(NETDEV_UP): veth5f34a63: link is not ready
[169002.454433] device veth5f34a63 entered promiscuous mode
[169002.451290] docker0: port 30(veth5f34a63) entered disabled state
[169002.451088] docker0: port 30(veth5f34a63) entered blocking state
[169002.324339] docker0: port 29(veth6b4dafb) entered forwarding state
[169002.324191] docker0: port 29(veth6b4dafb) entered blocking state
[169002.323988] IPv6: ADDRCONF(NETDEV_UP): veth6b4dafb: link is not ready
[169002.320654] device veth6b4dafb entered promiscuous mode
[169002.320440] docker0: port 29(veth6b4dafb) entered disabled state
[169002.320242] docker0: port 29(veth6b4dafb) entered blocking state
[169001.828933] IPv6: ADDRCONF(NETDEV_UP): vethfa21f8a: link is not ready
[169001.828221] device vethfa21f8a entered promiscuous mode
[169001.828023] docker0: port 28(vethfa21f8a) entered disabled state
[169001.827816] docker0: port 28(vethfa21f8a) entered blocking state
[169001.661856] EXT4-fs (sdb): mounted filesystem with ordered data mode. Opts: (null)
[169001.543770] EXT4-fs (sdc): mounted filesystem with ordered data mode. Opts: (null)
[169001.314684] EXT4-fs (sdd): mounted filesystem with ordered data mode. Opts: (null)
[168998.680912] sd 0:0:3:0: [sdd] Attached SCSI disk
[168998.678576] sd 0:0:3:0: [sdd] Assuming drive cache: write through
[168998.678434] sd 0:0:3:0: [sdd] Cache data unavailable
[168998.678414] sd 0:0:3:0: [sdd] Mode Sense: 31 00 00 00
[168998.678288] sd 0:0:3:0: [sdd] Write Protect is off
[168998.678092] sd 0:0:3:0: [sdd] 10485760 512-byte logical blocks: (5.37 GB/5.00 GiB)
[168998.677250] scsi 0:0:3:0: Direct-Access     VMware   Virtual disk     2.0  PQ: 0 ANSI: 6
[168998.676938] vmw_pvscsi: msg: device added at scsi0:3:0
[168998.676748] vmw_pvscsi: msg type: 0x0 - MSG RING: 7/6 (5) 
[168998.327917] sd 0:0:2:0: [sdc] Attached SCSI disk
[168998.325894] sd 0:0:2:0: [sdc] Assuming drive cache: write through
[168998.325766] sd 0:0:2:0: [sdc] Cache data unavailable
[168998.325735] sd 0:0:2:0: [sdc] Mode Sense: 31 00 00 00
[168998.325609] sd 0:0:2:0: [sdc] Write Protect is off
[168998.325389] sd 0:0:2:0: [sdc] 20971520 512-byte logical blocks: (10.7 GB/10.0 GiB)
[168998.324357] scsi 0:0:2:0: Direct-Access     VMware   Virtual disk     2.0  PQ: 0 ANSI: 6
[168998.323996] vmw_pvscsi: msg: device added at scsi0:2:0
[168998.323801] vmw_pvscsi: msg type: 0x0 - MSG RING: 6/5 (5) 
[168996.587662] sd 0:0:1:0: [sdb] Attached SCSI disk
[168996.585119] sd 0:0:1:0: [sdb] Assuming drive cache: write through
[168996.584993] sd 0:0:1:0: [sdb] Cache data unavailable
[168996.584967] sd 0:0:1:0: [sdb] Mode Sense: 31 00 00 00
[168996.584842] sd 0:0:1:0: [sdb] Write Protect is off
[168996.584629] sd 0:0:1:0: [sdb] 62914560 512-byte logical blocks: (32.2 GB/30.0 GiB)
[168996.583572] scsi 0:0:1:0: Direct-Access     VMware   Virtual disk     2.0  PQ: 0 ANSI: 6
[168996.583161] vmw_pvscsi: msg: device added at scsi0:1:0
[168996.582970] vmw_pvscsi: msg type: 0x0 - MSG RING: 5/4 (5) 

[165194.336127] Kernel Offset: 0x34000000 from 0xffffffff81000000 (relocation range: 0xffffffff80000000-0xffffffffbfffffff)
[165194.335328]  ret_from_fork+0x35/0x40
[165194.334673]  ? SyS_exit_group+0x10/0x10
[165194.333898]  ? kthread_create_on_node+0x70/0x70
[165194.333265]  kthread+0x11a/0x130
[165194.330489]  ? process_one_work+0x3d0/0x3d0
[165194.329459]  worker_thread+0x2b/0x3f0
[165194.328086]  process_one_work+0x1da/0x3d0
[165194.327427]  wait_rcu_exp_gp+0x1b/0x30
[165194.326756]  ? cpu_needs_another_gp+0x70/0x70
[165194.326085]  sync_rcu_exp_select_cpus+0x1f6/0x410
[165194.325436]  ? cpumask_next+0x16/0x20
[165194.324766]  ? sync_rcu_exp_select_cpus+0x1f6/0x410
[165194.324086]  ? cpu_needs_another_gp+0x70/0x70
[165194.323360] R13: 000000000000000c R14: 0000000000000001 R15: ffff8a35bfd22240
[165194.322631] R10: ffffb5f90314be38 R11: 0000000000001200 R12: ffffffffb625f1c0
[165194.320369] RBP: ffffb5f90314be10 R08: 0000000000000002 R09: 0000000000000004
[165194.319637] RDX: ffffffffb625f1c0 RSI: ffffffffb50db1f0 RDI: 0000000000000002
[165194.318886] RAX: ffff8a35bfc223c0 RBX: ffffffffb625f1c0 RCX: 0000000000000001
[165194.318114] RSP: 0018:ffffb5f90314bdc0 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff10
[165194.317343] RIP: 0010:smp_call_function_single+0x8e/0x100
[165194.316665]  </IRQ>
[165194.315893]  apic_timer_interrupt+0x7d/0x90
[165194.314836]  smp_apic_timer_interrupt+0x66/0x120
[165194.314063]  hrtimer_interrupt+0xa6/0x1f0
[165194.313265]  __hrtimer_run_queues+0xde/0x230
[165194.312334]  ? watchdog+0x30/0x30
[165194.310060]  watchdog_timer_fn+0x20e/0x220
[165194.309223]  panic+0xe4/0x252
[165194.308356]  dump_stack+0x5c/0x85
[165194.307516]  <IRQ>
[165194.306664] Call Trace:
[165194.305772] Workqueue: events wait_rcu_exp_gp
[165194.303963] Hardware name: VMware, Inc. VMware7,1/440BX Desktop Reference Platform, BIOS VMW71.00V.0.B64.1801120748 01/12/2018
[165194.303042] CPU: 0 PID: 14546 Comm: kworker/0:3 Tainted: G             L  4.14.48-coreos-r2 #1
[165194.301532] Kernel panic - not syncing: softlockup: hung tasks
[165194.298755] Code: 73 0c 9c 58 66 66 90 66 90 f6 c4 02 74 75 85 c9 75 4e 48 c7 c0 c0 23 02 00 65 48 03 05 2c 40 f1 4a 8b 48 18 83 e1 01 74 0a f3 90 <8b> 48 18 83 e1 01 75 f6 83 48 18 01 48 89 d1 48 89 f2 48 89 c6 
[165194.297953]  ret_from_fork+0x35/0x40
[165194.297150]  ? SyS_exit_group+0x10/0x10
[165194.296343]  ? kthread_create_on_node+0x70/0x70
[165194.295556]  kthread+0x11a/0x130
[165194.294740]  ? process_one_work+0x3d0/0x3d0
[165194.293915]  worker_thread+0x2b/0x3f0
[165194.293086]  process_one_work+0x1da/0x3d0
[165194.292104]  wait_rcu_exp_gp+0x1b/0x30
[165194.289744]  ? cpu_needs_another_gp+0x70/0x70
[165194.288886]  sync_rcu_exp_select_cpus+0x1f6/0x410
[165194.288037]  ? cpumask_next+0x16/0x20
[165194.287156]  ? sync_rcu_exp_select_cpus+0x1f6/0x410
[165194.286269] Call Trace:
[165194.284534] CR2: 000055ba3ead6ff0 CR3: 00000003f320a005 CR4: 00000000000606f0
[165194.284392] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[165194.284208] FS:  0000000000000000(0000) GS:ffff8a35bfc00000(0000) knlGS:0000000000000000
[165194.284040] R13: 000000000000000c R14: 0000000000000001 R15: ffff8a35bfd22240
[165194.283873] R10: ffffb5f90314be38 R11: 0000000000001200 R12: ffffffffb625f1c0
[165194.283706] RBP: ffffb5f90314be10 R08: 0000000000000002 R09: 0000000000000004
[165194.283536] RDX: ffffffffb625f1c0 RSI: ffffffffb50db1f0 RDI: 0000000000000002
[165194.283368] RAX: ffff8a35bfc223c0 RBX: ffffffffb625f1c0 RCX: 0000000000000001
[165194.283192] RSP: 0018:ffffb5f90314bdc0 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff10
[165194.283057] RIP: 0010:smp_call_function_single+0x8e/0x100
[165194.282909] task: ffff8a3175155a00 task.stack: ffffb5f903148000
[165194.282792] Workqueue: events wait_rcu_exp_gp
[165194.282509] Hardware name: VMware, Inc. VMware7,1/440BX Desktop Reference Platform, BIOS VMW71.00V.0.B64.1801120748 01/12/2018
[165194.282321] CPU: 0 PID: 14546 Comm: kworker/0:3 Not tainted 4.14.48-coreos-r2 #1
[165194.282146]  vmxnet3 scsi_mod dm_mirror dm_region_hash dm_log dm_mod dax
[165168.260729] eth0: renamed from veth98f846c
[165168.062442] docker0: port 25(veth6509fe7) entered disabled state
[165168.061943] docker0: port 25(veth6509fe7) entered forwarding state
[165168.061800] docker0: port 25(veth6509fe7) entered blocking state
[165168.061643] IPv6: ADDRCONF(NETDEV_UP): veth6509fe7: link is not ready
[165168.061347] device veth6509fe7 entered promiscuous mode
[165168.051124] docker0: port 25(veth6509fe7) entered disabled state
[165168.050926] docker0: port 25(veth6509fe7) entered blocking state
[165167.733705] docker0: port 23(veth24b1442) entered forwarding state
[165167.733557] docker0: port 23(veth24b1442) entered blocking state
[165167.733353] IPv6: ADDRCONF(NETDEV_CHANGE): veth24b1442: link becomes ready
[165167.733024] docker0: port 24(vethf543f8d) entered disabled state
[165167.623423] eth0: renamed from veth47284da
[165167.322035] docker0: port 24(vethf543f8d) entered forwarding state
[165167.321892] docker0: port 24(vethf543f8d) entered blocking state
[165167.321736] IPv6: ADDRCONF(NETDEV_UP): vethf543f8d: link is not ready
[165167.321530] device vethf543f8d entered promiscuous mode
[165167.321344] docker0: port 24(vethf543f8d) entered disabled state
[165167.321127] docker0: port 24(vethf543f8d) entered blocking state
[165166.551385] docker0: port 21(veth1e03adf) entered forwarding state
[165166.551239] docker0: port 21(veth1e03adf) entered blocking state
[165166.551034] IPv6: ADDRCONF(NETDEV_CHANGE): veth1e03adf: link becomes ready
[165166.550858] docker0: port 23(veth24b1442) entered disabled state
[165166.550614] docker0: port 22(veth9da0379) entered disabled state
[165166.543756] eth0: renamed from veth38a6d91
[165166.505313] docker0: port 23(veth24b1442) entered forwarding state
[165166.505157] docker0: port 23(veth24b1442) entered blocking state
[165166.504986] IPv6: ADDRCONF(NETDEV_UP): veth24b1442: link is not ready
[165166.503841] device veth24b1442 entered promiscuous mode
[165166.503643] docker0: port 23(veth24b1442) entered disabled state
[165166.503439] docker0: port 23(veth24b1442) entered blocking state
[165166.352123] docker0: port 22(veth9da0379) entered forwarding state
[165166.351978] docker0: port 22(veth9da0379) entered blocking state
[165166.351813] IPv6: ADDRCONF(NETDEV_UP): veth9da0379: link is not ready
[165166.350714] device veth9da0379 entered promiscuous mode
[165166.350520] docker0: port 22(veth9da0379) entered disabled state
[165166.350323] docker0: port 22(veth9da0379) entered blocking state
[165165.297667] docker0: port 20(veth837ebbe) entered forwarding state
[165165.297522] docker0: port 20(veth837ebbe) entered blocking state
[165165.297329] IPv6: ADDRCONF(NETDEV_CHANGE): veth837ebbe: link becomes ready
[165165.297104] docker0: port 21(veth1e03adf) entered disabled state
[165165.291545] eth0: renamed from vethf0f7b66
[165165.246653] docker0: port 21(veth1e03adf) entered forwarding state
[165165.246508] docker0: port 21(veth1e03adf) entered blocking state
[165165.246336] IPv6: ADDRCONF(NETDEV_UP): veth1e03adf: link is not ready
[165165.243965] device veth1e03adf entered promiscuous mode
[165165.242426] docker0: port 21(veth1e03adf) entered disabled state
[165165.242205] docker0: port 21(veth1e03adf) entered blocking state
[165164.857660] docker0: port 19(vethd141602) entered forwarding state
[165164.856937] docker0: port 19(vethd141602) entered blocking state
[165164.854412] IPv6: ADDRCONF(NETDEV_CHANGE): vethd141602: link becomes ready
[165164.837558] eth0: renamed from vethc418832
[165164.793399] docker0: port 7(vethb34b84c) entered forwarding state
[165164.792629] docker0: port 7(vethb34b84c) entered blocking state
[165164.790383] IPv6: ADDRCONF(NETDEV_CHANGE): vethb34b84c: link becomes ready
[165164.771595] eth0: renamed from vethb4157ef
[165164.615270] docker0: port 14(veth7f9e04d) entered forwarding state
[165164.613207] docker0: port 14(veth7f9e04d) entered blocking state
[165164.613013] IPv6: ADDRCONF(NETDEV_CHANGE): veth7f9e04d: link becomes ready
[165164.612761] docker0: port 20(veth837ebbe) entered disabled state
[165164.595891] eth0: renamed from veth4451b21
[165164.460306] docker0: port 20(veth837ebbe) entered forwarding state
[165164.460148] docker0: port 20(veth837ebbe) entered blocking state
[165164.459939] IPv6: ADDRCONF(NETDEV_UP): veth837ebbe: link is not ready
[165164.406407] device veth837ebbe entered promiscuous mode
[165164.402088] docker0: port 20(veth837ebbe) entered disabled state
[165164.401888] docker0: port 20(veth837ebbe) entered blocking state
[165163.734543] docker0: port 19(vethd141602) entered disabled state
[165163.734282] docker0: port 14(veth7f9e04d) entered disabled state
[165163.725556] IPv6: ADDRCONF(NETDEV_CHANGE): vethd9d897c: link becomes ready
[165163.719484] eth0: renamed from vethaf5cabf
[165163.559973] docker0: port 19(vethd141602) entered forwarding state
[165163.559829] docker0: port 19(vethd141602) entered blocking state
[165163.559672] IPv6: ADDRCONF(NETDEV_UP): vethd141602: link is not ready
[165163.559466] device vethd141602 entered promiscuous mode
[165163.559083] docker0: port 19(vethd141602) entered disabled state
[165163.558887] docker0: port 19(vethd141602) entered blocking state
[165163.246119] docker0: port 14(veth7f9e04d) entered forwarding state
[165163.245974] docker0: port 14(veth7f9e04d) entered blocking state
[165163.245802] IPv6: ADDRCONF(NETDEV_UP): veth7f9e04d: link is not ready
[165163.243290] device veth7f9e04d entered promiscuous mode
[165163.243087] docker0: port 14(veth7f9e04d) entered disabled state
[165163.242886] docker0: port 14(veth7f9e04d) entered blocking state
[165163.125424] docker0: port 11(vethd9d897c) entered forwarding state
[165163.125278] docker0: port 11(vethd9d897c) entered blocking state
[165163.125103] IPv6: ADDRCONF(NETDEV_UP): vethd9d897c: link is not ready
[165163.124400] device vethd9d897c entered promiscuous mode
[165163.124193] docker0: port 11(vethd9d897c) entered disabled state
[165163.123986] docker0: port 11(vethd9d897c) entered blocking state
[165162.978014] IPv6: ADDRCONF(NETDEV_UP): vethb34b84c: link is not ready
[165162.977816] device vethb34b84c entered promiscuous mode
[165162.977627] docker0: port 7(vethb34b84c) entered disabled state
[165162.977432] docker0: port 7(vethb34b84c) entered blocking state
[165118.648733] docker0: port 7(vethc5160ef) entered disabled state
[165118.648729] device vethc5160ef left promiscuous mode
[165118.648062] docker0: port 7(vethc5160ef) entered disabled state
[165118.626112] vethdd8cad7: renamed from eth0
[165118.625758] docker0: port 7(vethc5160ef) entered disabled state
[165084.882321] docker0: port 7(vethc5160ef) entered forwarding state
[165084.882175] docker0: port 7(vethc5160ef) entered blocking state
[165084.881967] IPv6: ADDRCONF(NETDEV_CHANGE): vethc5160ef: link becomes ready
[165084.876886] eth0: renamed from vethdd8cad7
[165084.484845] docker0: port 7(vethc5160ef) entered disabled state
[165084.484295] docker0: port 7(vethc5160ef) entered forwarding state
[165084.484154] docker0: port 7(vethc5160ef) entered blocking state
[165084.483997] IPv6: ADDRCONF(NETDEV_UP): vethc5160ef: link is not ready
[165084.483799] device vethc5160ef entered promiscuous mode
[165084.483560] docker0: port 7(vethc5160ef) entered disabled state
[165084.483361] docker0: port 7(vethc5160ef) entered blocking state
[164988.084574] docker0: port 7(veth96b5a39) entered disabled state
[164988.084473] device veth96b5a39 left promiscuous mode
[164988.079981] docker0: port 7(veth96b5a39) entered disabled state
[164988.057193] docker0: port 7(veth96b5a39) entered disabled state
[164988.042964] vethd04de33: renamed from eth0
[164954.293788] docker0: port 7(veth96b5a39) entered forwarding state
[164954.293643] docker0: port 7(veth96b5a39) entered blocking state
[164954.293440] IPv6: ADDRCONF(NETDEV_CHANGE): veth96b5a39: link becomes ready
[164954.288579] eth0: renamed from vethd04de33
[164953.979629] IPv6: ADDRCONF(NETDEV_UP): veth96b5a39: link is not ready
[164953.979425] device veth96b5a39 entered promiscuous mode
[164953.978913] docker0: port 7(veth96b5a39) entered disabled state
[164953.978721] docker0: port 7(veth96b5a39) entered blocking state
[164860.162989] docker0: port 7(vethfc7256e) entered disabled state
[164860.162985] device vethfc7256e left promiscuous mode
[164860.161705] docker0: port 7(vethfc7256e) entered disabled state
[164860.149460] docker0: port 7(vethfc7256e) entered disabled state
[164860.133904] veth7ff9578: renamed from eth0
[164826.580614] docker0: port 7(vethfc7256e) entered forwarding state
[164826.580467] docker0: port 7(vethfc7256e) entered blocking state
[164826.580261] IPv6: ADDRCONF(NETDEV_CHANGE): vethfc7256e: link becomes ready
[164826.573182] eth0: renamed from veth7ff9578
[164826.250877] docker0: port 7(vethfc7256e) entered disabled state
[164826.250222] docker0: port 7(vethfc7256e) entered forwarding state
[164826.250079] docker0: port 7(vethfc7256e) entered blocking state
[164826.249922] IPv6: ADDRCONF(NETDEV_UP): vethfc7256e: link is not ready
[164826.249537] device vethfc7256e entered promiscuous mode
[164826.249288] docker0: port 7(vethfc7256e) entered disabled state
[164826.249118] docker0: port 7(vethfc7256e) entered blocking state
[164652.680015] docker0: port 7(vethf60725a) entered disabled state
[164652.680011] device vethf60725a left promiscuous mode
[164652.679350] docker0: port 7(vethf60725a) entered disabled state
[164652.667600] docker0: port 7(vethf60725a) entered disabled state
[164652.657304] veth3318939: renamed from eth0
[164619.081486] docker0: port 7(vethf60725a) entered forwarding state
[164619.081342] docker0: port 7(vethf60725a) entered blocking state
[164619.081145] IPv6: ADDRCONF(NETDEV_CHANGE): vethf60725a: link becomes ready
[164619.077771] eth0: renamed from veth3318939
[164618.705036] IPv6: ADDRCONF(NETDEV_UP): vethf60725a: link is not ready
[164618.704653] device vethf60725a entered promiscuous mode
[164618.704403] docker0: port 7(vethf60725a) entered disabled state
[164618.704209] docker0: port 7(vethf60725a) entered blocking state
[164518.709157] docker0: port 7(veth4c56f89) entered disabled state
[164518.709054] device veth4c56f89 left promiscuous mode
[164518.706180] docker0: port 7(veth4c56f89) entered disabled state
[164518.683107] veth8ba0a7d: renamed from eth0
[164518.682848] docker0: port 7(veth4c56f89) entered disabled state
[164484.575460] docker0: port 7(veth4c56f89) entered forwarding state
[164484.575315] docker0: port 7(veth4c56f89) entered blocking state
[164484.575119] IPv6: ADDRCONF(NETDEV_CHANGE): veth4c56f89: link becomes ready
[164484.570403] eth0: renamed from veth8ba0a7d
[164484.292816] IPv6: ADDRCONF(NETDEV_UP): veth4c56f89: link is not ready
[164484.291774] device veth4c56f89 entered promiscuous mode
[164484.291566] docker0: port 7(veth4c56f89) entered disabled state
[164484.291409] docker0: port 7(veth4c56f89) entered blocking state
[164393.312556] docker0: port 7(veth775da5b) entered disabled state
[164393.312365] device veth775da5b left promiscuous mode
[164393.297326] docker0: port 7(veth775da5b) entered disabled state
[164393.285573] docker0: port 7(veth775da5b) entered disabled state
[164393.261337] veth84cdf3d: renamed from eth0
[164358.908959] docker0: port 7(veth775da5b) entered forwarding state
[164358.908813] docker0: port 7(veth775da5b) entered blocking state
[164358.908595] IPv6: ADDRCONF(NETDEV_CHANGE): veth775da5b: link becomes ready
[164358.902306] eth0: renamed from veth84cdf3d
[164358.441156] IPv6: ADDRCONF(NETDEV_UP): veth775da5b: link is not ready
[164358.440952] device veth775da5b entered promiscuous mode
[164358.440728] docker0: port 7(veth775da5b) entered disabled state
[164358.440520] docker0: port 7(veth775da5b) entered blocking state
[164258.296499] docker0: port 7(vethd8d1a97) entered disabled state
[164258.296391] device vethd8d1a97 left promiscuous mode
[164258.293966] docker0: port 7(vethd8d1a97) entered disabled state
[164258.269876] vethf117b3f: renamed from eth0
[164258.269304] docker0: port 7(vethd8d1a97) entered disabled state
[164224.491473] docker0: port 7(vethd8d1a97) entered forwarding state
[164224.491326] docker0: port 7(vethd8d1a97) entered blocking state
[164224.491130] IPv6: ADDRCONF(NETDEV_CHANGE): vethd8d1a97: link becomes ready
[164224.484087] eth0: renamed from vethf117b3f
[164224.044962] docker0: port 7(vethd8d1a97) entered disabled state
[164224.044664] docker0: port 7(vethd8d1a97) entered forwarding state
[164224.044521] docker0: port 7(vethd8d1a97) entered blocking state
[164224.044366] IPv6: ADDRCONF(NETDEV_UP): vethd8d1a97: link is not ready
[164224.044168] device vethd8d1a97 entered promiscuous mode
[164224.043984] docker0: port 7(vethd8d1a97) entered disabled state
[164224.043775] docker0: port 7(vethd8d1a97) entered blocking state
[164128.386421] docker0: port 7(veth39215de) entered disabled state
[164128.386302] device veth39215de left promiscuous mode
[164128.385312] docker0: port 7(veth39215de) entered disabled state
[164128.364538] vethae00d25: renamed from eth0
[164128.362267] docker0: port 7(veth39215de) entered disabled state
[164094.635662] docker0: port 7(veth39215de) entered forwarding state
[164094.635502] docker0: port 7(veth39215de) entered blocking state
[164094.635255] IPv6: ADDRCONF(NETDEV_CHANGE): veth39215de: link becomes ready
[164094.623979] eth0: renamed from vethae00d25
[164094.308179] IPv6: ADDRCONF(NETDEV_UP): veth39215de: link is not ready
[164094.307267] device veth39215de entered promiscuous mode
[164094.306305] docker0: port 7(veth39215de) entered disabled state
[164094.306108] docker0: port 7(veth39215de) entered blocking state
[164008.844958] docker0: port 7(vethaad1d66) entered disabled state
[164008.844852] device vethaad1d66 left promiscuous mode
[164008.837624] docker0: port 7(vethaad1d66) entered disabled state
[164008.796203] vethca716ce: renamed from eth0
[164008.795359] docker0: port 7(vethaad1d66) entered disabled state
[163974.619433] docker0: port 7(vethaad1d66) entered forwarding state
[163974.619287] docker0: port 7(vethaad1d66) entered blocking state
[163974.619050] IPv6: ADDRCONF(NETDEV_CHANGE): vethaad1d66: link becomes ready
[163974.611098] eth0: renamed from vethca716ce
[163974.193444] docker0: port 7(vethaad1d66) entered disabled state
[163974.192879] docker0: port 7(vethaad1d66) entered forwarding state
[163974.192734] docker0: port 7(vethaad1d66) entered blocking state
[163974.192568] IPv6: ADDRCONF(NETDEV_UP): vethaad1d66: link is not ready
[163974.191970] device vethaad1d66 entered promiscuous mode
[163974.191776] docker0: port 7(vethaad1d66) entered disabled state
[163974.191579] docker0: port 7(vethaad1d66) entered blocking state
[163800.915814] docker0: port 7(veth1765e6d) entered disabled state
[163800.915714] device veth1765e6d left promiscuous mode
[163800.915313] docker0: port 7(veth1765e6d) entered disabled state
[163800.886485] veth170eb5e: renamed from eth0
[163800.886225] docker0: port 7(veth1765e6d) entered disabled state
[163767.187809] docker0: port 7(veth1765e6d) entered forwarding state
[163767.187662] docker0: port 7(veth1765e6d) entered blocking state
[163767.187457] IPv6: ADDRCONF(NETDEV_CHANGE): veth1765e6d: link becomes ready
[163767.182089] eth0: renamed from veth170eb5e
[163766.550246] IPv6: ADDRCONF(NETDEV_UP): veth1765e6d: link is not ready
[163766.547305] device veth1765e6d entered promiscuous mode
[163766.545662] docker0: port 7(veth1765e6d) entered disabled state
[163766.545451] docker0: port 7(veth1765e6d) entered blocking state
[163666.400891] docker0: port 7(veth680572b) entered disabled state
[163666.400888] device veth680572b left promiscuous mode
[163666.400203] docker0: port 7(veth680572b) entered disabled state
[163666.384260] veth0233df3: renamed from eth0
[163666.384016] docker0: port 7(veth680572b) entered disabled state
[163632.549887] docker0: port 7(veth680572b) entered forwarding state
[163632.549742] docker0: port 7(veth680572b) entered blocking state
[163632.549493] IPv6: ADDRCONF(NETDEV_CHANGE): veth680572b: link becomes ready
[163632.537375] eth0: renamed from veth0233df3
[163632.090503] IPv6: ADDRCONF(NETDEV_UP): veth680572b: link is not ready
[163632.090289] device veth680572b entered promiscuous mode
[163632.089881] docker0: port 7(veth680572b) entered disabled state
[163632.089684] docker0: port 7(veth680572b) entered blocking state
[163546.989276] docker0: port 7(veth20f1f38) entered disabled state
[163546.989175] device veth20f1f38 left promiscuous mode
[163546.988808] docker0: port 7(veth20f1f38) entered disabled state
[163546.979964] docker0: port 7(veth20f1f38) entered disabled state
[163546.960522] veth1573bc3: renamed from eth0
[163512.654529] docker0: port 7(veth20f1f38) entered forwarding state
[163512.654383] docker0: port 7(veth20f1f38) entered blocking state
[163512.654158] IPv6: ADDRCONF(NETDEV_CHANGE): veth20f1f38: link becomes ready
[163512.649755] eth0: renamed from veth1573bc3
[163512.078640] IPv6: ADDRCONF(NETDEV_UP): veth20f1f38: link is not ready
[163512.059173] device veth20f1f38 entered promiscuous mode
[163512.058920] docker0: port 7(veth20f1f38) entered disabled state
[163512.058717] docker0: port 7(veth20f1f38) entered blocking state
[163418.250216] docker0: port 7(veth9be2cd6) entered disabled state
[163418.250029] device veth9be2cd6 left promiscuous mode
[163418.241830] docker0: port 7(veth9be2cd6) entered disabled state
[163418.195740] docker0: port 7(veth9be2cd6) entered disabled state
[163418.187216] veth8d6bd13: renamed from eth0
[163384.311830] docker0: port 7(veth9be2cd6) entered forwarding state
[163384.311686] docker0: port 7(veth9be2cd6) entered blocking state
[163384.311470] IPv6: ADDRCONF(NETDEV_CHANGE): veth9be2cd6: link becomes ready
[163384.302486] eth0: renamed from veth8d6bd13
[163383.790230] IPv6: ADDRCONF(NETDEV_UP): veth9be2cd6: link is not ready
[163383.785722] device veth9be2cd6 entered promiscuous mode
[163383.785471] docker0: port 7(veth9be2cd6) entered disabled state
[163383.785270] docker0: port 7(veth9be2cd6) entered blocking state
[163202.163985] docker0: port 7(veth40602a7) entered disabled state
[163202.163805] device veth40602a7 left promiscuous mode
[163202.146869] docker0: port 7(veth40602a7) entered disabled state
[163202.088532] veth61be9f9: renamed from eth0
[163202.088262] docker0: port 7(veth40602a7) entered disabled state
[163168.475823] docker0: port 7(veth40602a7) entered forwarding state
[163168.475677] docker0: port 7(veth40602a7) entered blocking state
[163168.475483] IPv6: ADDRCONF(NETDEV_CHANGE): veth40602a7: link becomes ready
[163168.470819] eth0: renamed from veth61be9f9
[163168.091141] docker0: port 7(veth40602a7) entered disabled state
[163168.082163] docker0: port 7(veth40602a7) entered forwarding state
[163168.082019] docker0: port 7(veth40602a7) entered blocking state
[163168.081842] IPv6: ADDRCONF(NETDEV_UP): veth40602a7: link is not ready
[163168.080713] device veth40602a7 entered promiscuous mode
[163168.080521] docker0: port 7(veth40602a7) entered disabled state
[163168.080357] docker0: port 7(veth40602a7) entered blocking state
[163076.807085] docker0: port 7(vethf273140) entered disabled state
[163076.806907] device vethf273140 left promiscuous mode
[163076.803874] docker0: port 7(vethf273140) entered disabled state
[163076.775198] veth56d78ce: renamed from eth0
[163076.774944] docker0: port 7(vethf273140) entered disabled state
[163042.534179] docker0: port 7(vethf273140) entered forwarding state
[163042.534034] docker0: port 7(vethf273140) entered blocking state
[163042.533809] IPv6: ADDRCONF(NETDEV_CHANGE): vethf273140: link becomes ready
[163042.527866] eth0: renamed from veth56d78ce
[163042.060717] docker0: port 7(vethf273140) entered disabled state
[163042.060238] docker0: port 7(vethf273140) entered forwarding state
[163042.060094] docker0: port 7(vethf273140) entered blocking state
[163042.059930] IPv6: ADDRCONF(NETDEV_UP): vethf273140: link is not ready
[163042.059715] device vethf273140 entered promiscuous mode
[163042.059528] docker0: port 7(vethf273140) entered disabled state
[163042.059333] docker0: port 7(vethf273140) entered blocking state
[162944.796918] docker0: port 7(vethe19c363) entered disabled state
[162944.796819] device vethe19c363 left promiscuous mode
[162944.796433] docker0: port 7(vethe19c363) entered disabled state
[162944.767634] veth4ab18b3: renamed from eth0
[162944.767361] docker0: port 7(vethe19c363) entered disabled state
[162911.086119] docker0: port 7(vethe19c363) entered forwarding state
[162911.085974] docker0: port 7(vethe19c363) entered blocking state
[162911.085779] IPv6: ADDRCONF(NETDEV_CHANGE): vethe19c363: link becomes ready
[162911.078370] eth0: renamed from veth4ab18b3
[162910.749492] docker0: port 7(vethe19c363) entered disabled state
[162910.734533] docker0: port 7(vethe19c363) entered forwarding state
[162910.734391] docker0: port 7(vethe19c363) entered blocking state
[162910.734234] IPv6: ADDRCONF(NETDEV_UP): vethe19c363: link is not ready
[162910.734035] device vethe19c363 entered promiscuous mode
[162910.733848] docker0: port 7(vethe19c363) entered disabled state
[162910.733652] docker0: port 7(vethe19c363) entered blocking state
[162819.445979] docker0: port 7(veth1a8d257) entered disabled state
[162819.445846] device veth1a8d257 left promiscuous mode
[162819.442556] docker0: port 7(veth1a8d257) entered disabled state
[162819.398233] veth84e77b5: renamed from eth0
[162819.397962] docker0: port 7(veth1a8d257) entered disabled state
[162785.290378] docker0: port 7(veth1a8d257) entered forwarding state
[162785.290224] docker0: port 7(veth1a8d257) entered blocking state
[162785.290010] IPv6: ADDRCONF(NETDEV_CHANGE): veth1a8d257: link becomes ready
[162785.282388] eth0: renamed from veth84e77b5
[162784.840166] IPv6: ADDRCONF(NETDEV_UP): veth1a8d257: link is not ready
[162784.835833] device veth1a8d257 entered promiscuous mode
[162784.835632] docker0: port 7(veth1a8d257) entered disabled state
[162784.835428] docker0: port 7(veth1a8d257) entered blocking state
[162691.775949] docker0: port 7(veth45f0026) entered disabled state
[162691.775945] device veth45f0026 left promiscuous mode
[162691.772524] docker0: port 7(veth45f0026) entered disabled state
[162691.754582] docker0: port 7(veth45f0026) entered disabled state
[162691.746103] veth676642d: renamed from eth0
[162658.098938] docker0: port 7(veth45f0026) entered forwarding state
[162658.098777] docker0: port 7(veth45f0026) entered blocking state
[162658.098550] IPv6: ADDRCONF(NETDEV_CHANGE): veth45f0026: link becomes ready
[162658.088996] eth0: renamed from veth676642d
[162657.774274] IPv6: ADDRCONF(NETDEV_UP): veth45f0026: link is not ready
[162657.774072] device veth45f0026 entered promiscuous mode
[162657.773871] docker0: port 7(veth45f0026) entered disabled state
[162657.773664] docker0: port 7(veth45f0026) entered blocking state
[162475.850748] docker0: port 7(veth206f8ab) entered disabled state
[162475.850582] device veth206f8ab left promiscuous mode
[162475.844803] docker0: port 7(veth206f8ab) entered disabled state
[162475.792790] veth34a1190: renamed from eth0
[162475.792508] docker0: port 7(veth206f8ab) entered disabled state
[162442.005461] docker0: port 7(veth206f8ab) entered forwarding state
[162442.005314] docker0: port 7(veth206f8ab) entered blocking state
[162442.005116] IPv6: ADDRCONF(NETDEV_CHANGE): veth206f8ab: link becomes ready
[162441.998204] eth0: renamed from veth34a1190
[162441.482896] docker0: port 7(veth206f8ab) entered disabled state
[162441.482287] docker0: port 7(veth206f8ab) entered forwarding state
[162441.482136] docker0: port 7(veth206f8ab) entered blocking state
[162441.481949] IPv6: ADDRCONF(NETDEV_UP): veth206f8ab: link is not ready
[162441.481709] device veth206f8ab entered promiscuous mode
[162441.481527] docker0: port 7(veth206f8ab) entered disabled state
[162441.481327] docker0: port 7(veth206f8ab) entered blocking state
[162386.463642] docker0: port 7(veth24db96b) entered disabled state
[162386.463638] device veth24db96b left promiscuous mode
[162386.463077] docker0: port 7(veth24db96b) entered disabled state
[162386.455311] docker0: port 7(veth24db96b) entered disabled state
[162386.444430] vethd631864: renamed from eth0
[162371.488830] docker0: port 9(veth0e96763) entered forwarding state
[162371.488677] docker0: port 9(veth0e96763) entered blocking state
[162371.488475] IPv6: ADDRCONF(NETDEV_CHANGE): veth0e96763: link becomes ready
[162371.484628] eth0: renamed from veth5dd417c
[162371.173397] IPv6: ADDRCONF(NETDEV_UP): veth0e96763: link is not ready
[162371.173182] device veth0e96763 entered promiscuous mode
[162371.173000] docker0: port 9(veth0e96763) entered disabled state
[162371.172801] docker0: port 9(veth0e96763) entered blocking state
[162368.484768] docker0: port 11(vethff6a8d1) entered disabled state
[162368.484765] device vethff6a8d1 left promiscuous mode
[162368.484223] docker0: port 11(vethff6a8d1) entered disabled state
[162368.475832] docker0: port 11(vethff6a8d1) entered disabled state
[162368.459183] vethf2b3de5: renamed from eth0
[162352.494967] docker0: port 7(veth24db96b) entered forwarding state
[162352.494820] docker0: port 7(veth24db96b) entered blocking state
[162352.494588] IPv6: ADDRCONF(NETDEV_CHANGE): veth24db96b: link becomes ready
[162352.479323] eth0: renamed from vethd631864
[162352.149613] docker0: port 7(veth24db96b) entered disabled state
[162352.149409] docker0: port 7(veth24db96b) entered forwarding state
[162352.149254] docker0: port 7(veth24db96b) entered blocking state
[162352.149093] IPv6: ADDRCONF(NETDEV_UP): veth24db96b: link is not ready
[162352.148889] device veth24db96b entered promiscuous mode
[162352.148695] docker0: port 7(veth24db96b) entered disabled state
[162352.148498] docker0: port 7(veth24db96b) entered blocking state
[162170.880641] docker0: port 7(veth7b262b7) entered disabled state
[162170.880540] device veth7b262b7 left promiscuous mode
[162170.880074] docker0: port 7(veth7b262b7) entered disabled state
[162170.862102] docker0: port 7(veth7b262b7) entered disabled state
[162170.854380] vethb598573: renamed from eth0
[162136.798967] docker0: port 7(veth7b262b7) entered forwarding state
[162136.798822] docker0: port 7(veth7b262b7) entered blocking state
[162136.798619] IPv6: ADDRCONF(NETDEV_CHANGE): veth7b262b7: link becomes ready
[162136.789702] eth0: renamed from vethb598573
[162136.439362] IPv6: ADDRCONF(NETDEV_UP): veth7b262b7: link is not ready
[162136.438952] device veth7b262b7 entered promiscuous mode
[162136.438554] docker0: port 7(veth7b262b7) entered disabled state
[162136.438344] docker0: port 7(veth7b262b7) entered blocking state
[162033.988688] docker0: port 7(vethf3c6a21) entered disabled state
[162033.988587] device vethf3c6a21 left promiscuous mode
[162033.987848] docker0: port 7(vethf3c6a21) entered disabled state
[162033.961452] vethdf700b2: renamed from eth0
[162033.961187] docker0: port 7(vethf3c6a21) entered disabled state
[162000.294505] docker0: port 7(vethf3c6a21) entered forwarding state
[162000.294359] docker0: port 7(vethf3c6a21) entered blocking state
[162000.294148] IPv6: ADDRCONF(NETDEV_CHANGE): vethf3c6a21: link becomes ready
[162000.287951] eth0: renamed from vethdf700b2
[161999.973005] IPv6: ADDRCONF(NETDEV_UP): vethf3c6a21: link is not ready
[161999.972644] device vethf3c6a21 entered promiscuous mode
[161999.972402] docker0: port 7(vethf3c6a21) entered disabled state
[161999.972204] docker0: port 7(vethf3c6a21) entered blocking state
[161989.260400] docker0: port 9(veth5978a90) entered disabled state
[161989.260297] device veth5978a90 left promiscuous mode
[161989.259913] docker0: port 9(veth5978a90) entered disabled state
[161989.241456] docker0: port 9(veth5978a90) entered disabled state
[161989.226000] vethafd4d10: renamed from eth0
[161977.896992] docker0: port 7(vetha308ecb) entered disabled state
[161977.896989] device vetha308ecb left promiscuous mode
[161977.896416] docker0: port 7(vetha308ecb) entered disabled state
[161977.874381] vetha2ad6ab: renamed from eth0
[161977.873196] docker0: port 7(vetha308ecb) entered disabled state
[161968.324104] docker0: port 12(vethc54ef91) entered forwarding state
[161968.323958] docker0: port 12(vethc54ef91) entered blocking state
[161968.323737] IPv6: ADDRCONF(NETDEV_CHANGE): vethc54ef91: link becomes ready
[161968.317646] eth0: renamed from veth52875ae
[161967.883559] docker0: port 12(vethc54ef91) entered disabled state
[161967.883046] docker0: port 12(vethc54ef91) entered forwarding state
[161967.882895] docker0: port 12(vethc54ef91) entered blocking state
[161967.882710] IPv6: ADDRCONF(NETDEV_UP): vethc54ef91: link is not ready
[161967.882458] device vethc54ef91 entered promiscuous mode
[161967.882208] docker0: port 12(vethc54ef91) entered disabled state

In between we upgraded to the new CoreOS stable release 1800.4.0 with the hope that there reboots won't happen, however still the same.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment