Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Error when joining the node to the cluster, when using both 1GB and 2MB huge-page sizes are enabled on the node #82544

Open
A1xsmith opened this issue Sep 10, 2019 · 1 comment

Comments

@A1xsmith
Copy link

commented Sep 10, 2019

What happened:
Node failed to join the cluster when both 1GB and 2Mb huge-page table are enabled on the node

What you expected to happen:
Node to join the cluster

How to reproduce it (as minimally and precisely as possible):

Enable 16Gi in the 1GB huge-page table, if Numa is enabled 8 on each node
Enable 16Gi in the 2MB huge-page table, if Numa is enabled 8 on each node
Kubeadm join xxxxx

kubeadm join 192.168.211.226:6443 --token ea1g9s.gsli4aevgc304u04 \

--discovery-token-ca-cert-hash sha256:65c6dda82eb3a54f4285e31cde4352869b66b070d29011b6faca583acca12e39 

[preflight] Running pre-flight checks
[WARNING IsDockerSystemdCheck]: detected "cgroupfs" as the Docker cgroup driver. The recommended driver is "systemd". Please follow the guide at https://kubernetes.io/docs/setup/cri/
[preflight] Reading configuration from the cluster...
[preflight] FYI: You can look at this config file with 'kubectl -n kube-system get cm kubeadm-config -oyaml'
[kubelet-start] Downloading configuration for the kubelet from the "kubelet-config-1.15" ConfigMap in the kube-system namespace
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Activating the kubelet service
[kubelet-start] Waiting for the kubelet to perform the TLS Bootstrap...
[kubelet-check] Initial timeout of 40s passed.
error execution phase kubelet-start: error uploading crisocket: timed out waiting for the condition

systemctl status kubelet

● kubelet.service - kubelet: The Kubernetes Node Agent
Loaded: loaded (/lib/systemd/system/kubelet.service; enabled; vendor preset: enabled)
Drop-In: /etc/systemd/system/kubelet.service.d
└─10-kubeadm.conf
Active: active (running) since Tue 2019-09-10 08:53:11 PDT; 3min 39s ago
Docs: https://kubernetes.io/docs/home/
Main PID: 3909 (kubelet)
Tasks: 49
Memory: 51.4M
CPU: 4.984s
CGroup: /system.slice/kubelet.service
└─3909 /usr/bin/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --kubeconfig=/etc/kubernetes/kubelet.conf --config=/var/lib/kubelet/config.yaml --cgroup-driver=cgroupfs -

Sep 10 08:56:50 ubuntu-211224 kubelet[3909]: E0910 08:56:50.388436 3909 kubelet.go:2248] node "ubuntu-211224" not found
Sep 10 08:56:50 ubuntu-211224 kubelet[3909]: E0910 08:56:50.488606 3909 kubelet.go:2248] node "ubuntu-211224" not found
Sep 10 08:56:50 ubuntu-211224 kubelet[3909]: E0910 08:56:50.588746 3909 kubelet.go:2248] node "ubuntu-211224" not found
Sep 10 08:56:50 ubuntu-211224 kubelet[3909]: E0910 08:56:50.688999 3909 kubelet.go:2248] node "ubuntu-211224" not found
Sep 10 08:56:50 ubuntu-211224 kubelet[3909]: E0910 08:56:50.789222 3909 kubelet.go:2248] node "ubuntu-211224" not found
Sep 10 08:56:50 ubuntu-211224 kubelet[3909]: E0910 08:56:50.889406 3909 kubelet.go:2248] node "ubuntu-211224" not found
Sep 10 08:56:50 ubuntu-211224 kubelet[3909]: E0910 08:56:50.989603 3909 kubelet.go:2248] node "ubuntu-211224" not found
Sep 10 08:56:51 ubuntu-211224 kubelet[3909]: E0910 08:56:51.089823 3909 kubelet.go:2248] node "ubuntu-211224" not found
Sep 10 08:56:51 ubuntu-211224 kubelet[3909]: E0910 08:56:51.190042 3909 kubelet.go:2248] node "ubuntu-211224" not found
Sep 10 08:56:51 ubuntu-211224 kubelet[3909]: E0910 08:56:51.290255 3909 kubelet.go:2248] node "ubuntu-211224" not found
lines 1-23/23 @(END)

Anything else we need to know?:

Environment:

  • Kubernetes version (use kubectl version):
    Client Version: version.Info{Major:"1", Minor:"15", GitVersion:"v1.15.3", GitCommit:"2d3c76f9091b6bec110a5e63777c332469e0cba2", GitTreeState:"clean", BuildDate:"2019-08-19T11:13:54Z", GoVersion:"go1.12.9", Compiler:"gc", Platform:"linux/amd64"}
  • Cloud provider or hardware configuration:

lshw -short

H/W path Device Class Description

system AX3530 (To be filled by O.E.M.)
/0 bus To be filled by O.E.M.
/0/0 memory 64KiB BIOS
/0/4 processor Intel(R) Xeon(R) CPU E5-2680 v2 @ 2.80GHz
/0/4/5 memory 640KiB L1 cache
/0/4/6 memory 2560KiB L2 cache
/0/4/7 memory 25MiB L3 cache
/0/6 processor Intel(R) Xeon(R) CPU E5-2680 v2 @ 2.80GHz
/0/6/9 memory 640KiB L1 cache
/0/6/a memory 2560KiB L2 cache
/0/6/b memory 25MiB L3 cache
/0/2c memory System Memory
/0/2c/0 memory 16GiB DIMM DDR3 1600 MHz (0.6 ns)
/0/2c/1 memory DIMM Synchronous [empty]
/0/2c/2 memory 16GiB DIMM DDR3 1600 MHz (0.6 ns)
/0/2c/3 memory DIMM Synchronous [empty]
/0/2c/4 memory 16GiB DIMM DDR3 1600 MHz (0.6 ns)
/0/2c/5 memory DIMM Synchronous [empty]
/0/2c/6 memory 16GiB DIMM DDR3 1600 MHz (0.6 ns)
/0/2c/7 memory DIMM Synchronous [empty]
/0/3e memory System Memory
/0/3e/0 memory 16GiB DIMM DDR3 1600 MHz (0.6 ns)
/0/3e/1 memory DIMM Synchronous [empty]
/0/3e/2 memory 16GiB DIMM DDR3 1600 MHz (0.6 ns)
/0/3e/3 memory DIMM Synchronous [empty]
/0/3e/4 memory 16GiB DIMM DDR3 1600 MHz (0.6 ns)
/0/3e/5 memory DIMM Synchronous [empty]
/0/3e/6 memory 16GiB DIMM DDR3 1600 MHz (0.6 ns)
/0/3e/7 memory DIMM Synchronous [empty]
/0/7 memory
/0/9 memory
/0/100 bridge Xeon E7 v2/Xeon E5 v2/Core i7 DMI2
/0/100/1 bridge Xeon E7 v2/Xeon E5 v2/Core i7 PCI Express Root Port 1a
/0/100/1/0 eth18 network 82599ES 10-Gigabit SFI/SFP+ Network Connection
/0/100/1/0.1 eth17 network 82599ES 10-Gigabit SFI/SFP+ Network Connection
/0/100/2 bridge Xeon E7 v2/Xeon E5 v2/Core i7 PCI Express Root Port 2a
/0/100/2/0 eth16 network 82599ES 10-Gigabit SFI/SFP+ Network Connection
/0/100/2/0.1 eth15 network 82599ES 10-Gigabit SFI/SFP+ Network Connection
/0/100/2.2 bridge Xeon E7 v2/Xeon E5 v2/Core i7 PCI Express Root Port 2c
/0/100/2.2/0 eth14 network 82599ES 10-Gigabit SFI/SFP+ Network Connection
/0/100/2.2/0.1 network 82599ES 10-Gigabit SFI/SFP+ Network Connection
/0/100/3 bridge Xeon E7 v2/Xeon E5 v2/Core i7 PCI Express Root Port 3a
/0/100/3/0 generic Cavium, Inc.
/0/100/3.1 bridge Xeon E7 v2/Xeon E5 v2/Core i7 PCI Express Root Port 3b
/0/100/3.2 bridge Xeon E7 v2/Xeon E5 v2/Core i7 PCI Express Root Port 3c
/0/100/3.3 bridge Xeon E7 v2/Xeon E5 v2/Core i7 PCI Express Root Port 3d
/0/100/3.3/0 generic Cavium, Inc.
/0/100/4 generic Xeon E7 v2/Xeon E5 v2/Core i7 Crystal Beach DMA Channel 0
/0/100/4.1 generic Xeon E7 v2/Xeon E5 v2/Core i7 Crystal Beach DMA Channel 1
/0/100/4.2 generic Xeon E7 v2/Xeon E5 v2/Core i7 Crystal Beach DMA Channel 2
/0/100/4.3 generic Xeon E7 v2/Xeon E5 v2/Core i7 Crystal Beach DMA Channel 3
/0/100/4.4 generic Xeon E7 v2/Xeon E5 v2/Core i7 Crystal Beach DMA Channel 4
/0/100/4.5 generic Xeon E7 v2/Xeon E5 v2/Core i7 Crystal Beach DMA Channel 5
/0/100/4.6 generic Xeon E7 v2/Xeon E5 v2/Core i7 Crystal Beach DMA Channel 6
/0/100/4.7 generic Xeon E7 v2/Xeon E5 v2/Core i7 Crystal Beach DMA Channel 7
/0/100/5 generic Xeon E7 v2/Xeon E5 v2/Core i7 VTd/Memory Map/Misc
/0/100/5.2 generic Xeon E7 v2/Xeon E5 v2/Core i7 IIO RAS
/0/100/5.4 generic Xeon E7 v2/Xeon E5 v2/Core i7 IOAPIC
/0/100/11 bridge C600/X79 series chipset PCI Express Virtual Root Port
/0/100/16 communication C600/X79 series chipset MEI Controller #1
/0/100/1c bridge C600/X79 series chipset PCI Express Root Port 1
/0/100/1c/0 eth4 network 82576 Gigabit Network Connection
/0/100/1c/0.1 eth3 network 82576 Gigabit Network Connection
/0/100/1c.2 bridge C600/X79 series chipset PCI Express Root Port 3
/0/100/1c.2/0 eth6 network 82576 Gigabit Network Connection
/0/100/1c.2/0.1 eth5 network 82576 Gigabit Network Connection
/0/100/1c.4 bridge C600/X79 series chipset PCI Express Root Port 5
/0/100/1c.4/0 eth2 network 82576 Gigabit Network Connection
/0/100/1c.4/0.1 eth1 network 82576 Gigabit Network Connection
/0/100/1c.6 bridge C600/X79 series chipset PCI Express Root Port 7
/0/100/1c.6/0 eth0 network 82574L Gigabit Network Connection
/0/100/1c.7 bridge C600/X79 series chipset PCI Express Root Port 8
/0/100/1c.7/0 bridge AST1150 PCI-to-PCI Bridge
/0/100/1c.7/0/0 display ASPEED Graphics Family
/0/100/1d bus C600/X79 series chipset USB2 Enhanced Host Controller #1
/0/100/1d/1 usb1 bus EHCI Host Controller
/0/100/1d/1/1 bus Integrated Rate Matching Hub
/0/100/1d/1/1/4 bus Virtual Hub
/0/100/1d/1/1/4/1 input Virtual Keyboard and Mouse
/0/100/1d/1/1/4/2 scsi6 storage Virtual Cdrom Device
/0/100/1d/1/1/4/2/0.0.0 /dev/cdrom disk SCSI CD-ROM
/0/100/1d/1/1/4/3 scsi7 storage Virtual Floppy Device
/0/100/1d/1/1/4/3/0.0.0 /dev/sdb disk SCSI Disk
/0/100/1d/1/1/4/4 scsi8 storage Virtual HardDisk Device
/0/100/1d/1/1/4/4/0.0.0 /dev/sdc disk SCSI Disk
/0/100/1e bridge 82801 PCI Bridge
/0/100/1f bridge C600/X79 series chipset LPC Controller
/0/100/1f.2 storage C600/X79 series chipset 6-Port SATA AHCI Controller
/0/100/1f.3 bus C600/X79 series chipset SMBus Host Controller
/0/100/1f.6 generic C600/X79 series chipset Thermal Management Controller
/0/a generic Xeon E7 v2/Xeon E5 v2/Core i7 QPI Link 0
/0/b generic Xeon E7 v2/Xeon E5 v2/Core i7 QPI Link 1
/0/c generic Xeon E7 v2/Xeon E5 v2/Core i7 Power Control Unit 0
/0/d generic Xeon E7 v2/Xeon E5 v2/Core i7 Power Control Unit 1
/0/e generic Xeon E7 v2/Xeon E5 v2/Core i7 Power Control Unit 2
/0/f generic Xeon E7 v2/Xeon E5 v2/Core i7 Power Control Unit 3
/0/10 generic Xeon E7 v2/Xeon E5 v2/Core i7 UBOX Registers
/0/11 generic Xeon E7 v2/Xeon E5 v2/Core i7 UBOX Registers
/0/12 generic Xeon E7 v2/Xeon E5 v2/Core i7 Unicast Registers
/0/13 generic Xeon E7 v2/Xeon E5 v2/Core i7 Unicast Registers
/0/14 generic Xeon E7 v2/Xeon E5 v2/Core i7 Unicast Registers
/0/15 generic Xeon E7 v2/Xeon E5 v2/Core i7 Unicast Registers
/0/16 generic Xeon E7 v2/Xeon E5 v2/Core i7 Unicast Registers
/0/17 generic Xeon E7 v2/Xeon E5 v2/Core i7 Unicast Registers
/0/18 generic Xeon E7 v2/Xeon E5 v2/Core i7 Unicast Registers
/0/19 generic Xeon E7 v2/Xeon E5 v2/Core i7 Unicast Registers
/0/1a generic Xeon E7 v2/Xeon E5 v2/Core i7 Unicast Registers
/0/1b generic Xeon E7 v2/Xeon E5 v2/Core i7 Unicast Registers
/0/1c generic Xeon E7 v2/Xeon E5 v2/Core i7 Home Agent 0
/0/1d generic Xeon E7 v2/Xeon E5 v2/Core i7 Home Agent 0
/0/1e generic Xeon E7 v2/Xeon E5 v2/Core i7 Integrated Memory Controller 0 Target Address/Thermal Registers
/0/1f generic Xeon E7 v2/Xeon E5 v2/Core i7 Integrated Memory Controller 0 RAS Registers
/0/20 generic Xeon E7 v2/Xeon E5 v2/Core i7 Integrated Memory Controller 0 Channel Target Address Decoder Registers
/0/21 generic Xeon E7 v2/Xeon E5 v2/Core i7 Integrated Memory Controller 0 Channel Target Address Decoder Registers
/0/22 generic Xeon E7 v2/Xeon E5 v2/Core i7 Integrated Memory Controller 0 Channel Target Address Decoder Registers
/0/23 generic Xeon E7 v2/Xeon E5 v2/Core i7 Integrated Memory Controller 0 Channel Target Address Decoder Registers
/0/24 generic Xeon E7 v2/Xeon E5 v2/Core i7 Integrated Memory Controller 1 Channel 0-3 Thermal Control 0
/0/25 generic Xeon E7 v2/Xeon E5 v2/Core i7 Integrated Memory Controller 1 Channel 0-3 Thermal Control 1
/0/26 generic Xeon E7 v2/Xeon E5 v2/Core i7 Integrated Memory Controller 1 Channel 0-3 ERROR Registers 0
/0/27 generic Xeon E7 v2/Xeon E5 v2/Core i7 Integrated Memory Controller 1 Channel 0-3 ERROR Registers 1
/0/28 generic Xeon E7 v2/Xeon E5 v2/Core i7 Integrated Memory Controller 1 Channel 0-3 Thermal Control 2
/0/29 generic Xeon E7 v2/Xeon E5 v2/Core i7 Integrated Memory Controller 1 Channel 0-3 Thermal Control 3
/0/2a generic Xeon E7 v2/Xeon E5 v2/Core i7 Integrated Memory Controller 1 Channel 0-3 ERROR Registers 2
/0/2b generic Xeon E7 v2/Xeon E5 v2/Core i7 Integrated Memory Controller 1 Channel 0-3 ERROR Registers 3
/0/2d generic Xeon E7 v2/Xeon E5 v2/Core i7 R2PCIe
/0/2e generic Xeon E7 v2/Xeon E5 v2/Core i7 R2PCIe
/0/2f generic Xeon E7 v2/Xeon E5 v2/Core i7 QPI Ring Registers
/0/30 generic Xeon E7 v2/Xeon E5 v2/Core i7 QPI Ring Performance Ring Monitoring
/0/31 generic Xeon E7 v2/Xeon E5 v2/Core i7 System Address Decoder
/0/32 generic Xeon E7 v2/Xeon E5 v2/Core i7 Broadcast Registers
/0/33 generic Xeon E7 v2/Xeon E5 v2/Core i7 Broadcast Registers
/0/101 bridge Xeon E7 v2/Xeon E5 v2/Core i7 PCI Express Root Port in DMI2 Mode
/0/1 bridge Xeon E7 v2/Xeon E5 v2/Core i7 PCI Express Root Port 1a
/0/1/0 eth12 network 82599ES 10-Gigabit SFI/SFP+ Network Connection
/0/1/0.1 eth11 network 82599ES 10-Gigabit SFI/SFP+ Network Connection
/0/2 bridge Xeon E7 v2/Xeon E5 v2/Core i7 PCI Express Root Port 2a
/0/2/0 generic Cavium, Inc.
/0/2.1 bridge Xeon E7 v2/Xeon E5 v2/Core i7 PCI Express Root Port 2b
/0/2.2 bridge Xeon E7 v2/Xeon E5 v2/Core i7 PCI Express Root Port 2c
/0/2.3 bridge Xeon E7 v2/Xeon E5 v2/Core i7 PCI Express Root Port 2d
/0/2.3/0 generic Cavium, Inc.
/0/3 bridge Xeon E7 v2/Xeon E5 v2/Core i7 PCI Express Root Port 3a
/0/3/0 eth10 network 82599ES 10-Gigabit SFI/SFP+ Network Connection
/0/3/0.1 eth9 network 82599ES 10-Gigabit SFI/SFP+ Network Connection
/0/3.2 bridge Xeon E7 v2/Xeon E5 v2/Core i7 PCI Express Root Port 3c
/0/3.2/0 eth8 network 82599ES 10-Gigabit SFI/SFP+ Network Connection
/0/3.2/0.1 eth7 network 82599ES 10-Gigabit SFI/SFP+ Network Connection
/0/34 generic Xeon E7 v2/Xeon E5 v2/Core i7 Crystal Beach DMA Channel 0
/0/4.1 generic Xeon E7 v2/Xeon E5 v2/Core i7 Crystal Beach DMA Channel 1
/0/4.2 generic Xeon E7 v2/Xeon E5 v2/Core i7 Crystal Beach DMA Channel 2
/0/4.3 generic Xeon E7 v2/Xeon E5 v2/Core i7 Crystal Beach DMA Channel 3
/0/4.4 generic Xeon E7 v2/Xeon E5 v2/Core i7 Crystal Beach DMA Channel 4
/0/4.5 generic Xeon E7 v2/Xeon E5 v2/Core i7 Crystal Beach DMA Channel 5
/0/4.6 generic Xeon E7 v2/Xeon E5 v2/Core i7 Crystal Beach DMA Channel 6
/0/4.7 generic Xeon E7 v2/Xeon E5 v2/Core i7 Crystal Beach DMA Channel 7
/0/5 generic Xeon E7 v2/Xeon E5 v2/Core i7 VTd/Memory Map/Misc
/0/5.2 generic Xeon E7 v2/Xeon E5 v2/Core i7 IIO RAS
/0/5.4 generic Xeon E7 v2/Xeon E5 v2/Core i7 IOAPIC
/0/8 generic Xeon E7 v2/Xeon E5 v2/Core i7 QPI Link 0
/0/35 generic Xeon E7 v2/Xeon E5 v2/Core i7 QPI Link 1
/0/36 generic Xeon E7 v2/Xeon E5 v2/Core i7 Power Control Unit 0
/0/37 generic Xeon E7 v2/Xeon E5 v2/Core i7 Power Control Unit 1
/0/38 generic Xeon E7 v2/Xeon E5 v2/Core i7 Power Control Unit 2
/0/39 generic Xeon E7 v2/Xeon E5 v2/Core i7 Power Control Unit 3
/0/3a generic Xeon E7 v2/Xeon E5 v2/Core i7 UBOX Registers
/0/3b generic Xeon E7 v2/Xeon E5 v2/Core i7 UBOX Registers
/0/3c generic Xeon E7 v2/Xeon E5 v2/Core i7 Unicast Registers
/0/3d generic Xeon E7 v2/Xeon E5 v2/Core i7 Unicast Registers
/0/3f generic Xeon E7 v2/Xeon E5 v2/Core i7 Unicast Registers
/0/40 generic Xeon E7 v2/Xeon E5 v2/Core i7 Unicast Registers
/0/41 generic Xeon E7 v2/Xeon E5 v2/Core i7 Unicast Registers
/0/42 generic Xeon E7 v2/Xeon E5 v2/Core i7 Unicast Registers
/0/43 generic Xeon E7 v2/Xeon E5 v2/Core i7 Unicast Registers
/0/44 generic Xeon E7 v2/Xeon E5 v2/Core i7 Unicast Registers
/0/45 generic Xeon E7 v2/Xeon E5 v2/Core i7 Unicast Registers
/0/46 generic Xeon E7 v2/Xeon E5 v2/Core i7 Unicast Registers
/0/47 generic Xeon E7 v2/Xeon E5 v2/Core i7 Home Agent 0
/0/48 generic Xeon E7 v2/Xeon E5 v2/Core i7 Home Agent 0
/0/49 generic Xeon E7 v2/Xeon E5 v2/Core i7 Integrated Memory Controller 0 Target Address/Thermal Registers
/0/4a generic Xeon E7 v2/Xeon E5 v2/Core i7 Integrated Memory Controller 0 RAS Registers
/0/4b generic Xeon E7 v2/Xeon E5 v2/Core i7 Integrated Memory Controller 0 Channel Target Address Decoder Registers
/0/4c generic Xeon E7 v2/Xeon E5 v2/Core i7 Integrated Memory Controller 0 Channel Target Address Decoder Registers
/0/4d generic Xeon E7 v2/Xeon E5 v2/Core i7 Integrated Memory Controller 0 Channel Target Address Decoder Registers
/0/4e generic Xeon E7 v2/Xeon E5 v2/Core i7 Integrated Memory Controller 0 Channel Target Address Decoder Registers
/0/4f generic Xeon E7 v2/Xeon E5 v2/Core i7 Integrated Memory Controller 1 Channel 0-3 Thermal Control 0
/0/50 generic Xeon E7 v2/Xeon E5 v2/Core i7 Integrated Memory Controller 1 Channel 0-3 Thermal Control 1
/0/51 generic Xeon E7 v2/Xeon E5 v2/Core i7 Integrated Memory Controller 1 Channel 0-3 ERROR Registers 0
/0/52 generic Xeon E7 v2/Xeon E5 v2/Core i7 Integrated Memory Controller 1 Channel 0-3 ERROR Registers 1
/0/53 generic Xeon E7 v2/Xeon E5 v2/Core i7 Integrated Memory Controller 1 Channel 0-3 Thermal Control 2
/0/54 generic Xeon E7 v2/Xeon E5 v2/Core i7 Integrated Memory Controller 1 Channel 0-3 Thermal Control 3
/0/55 generic Xeon E7 v2/Xeon E5 v2/Core i7 Integrated Memory Controller 1 Channel 0-3 ERROR Registers 2
/0/56 generic Xeon E7 v2/Xeon E5 v2/Core i7 Integrated Memory Controller 1 Channel 0-3 ERROR Registers 3
/0/57 generic Xeon E7 v2/Xeon E5 v2/Core i7 R2PCIe
/0/58 generic Xeon E7 v2/Xeon E5 v2/Core i7 R2PCIe
/0/59 generic Xeon E7 v2/Xeon E5 v2/Core i7 QPI Ring Registers
/0/5a generic Xeon E7 v2/Xeon E5 v2/Core i7 QPI Ring Performance Ring Monitoring
/0/5b generic Xeon E7 v2/Xeon E5 v2/Core i7 System Address Decoder
/0/5c generic Xeon E7 v2/Xeon E5 v2/Core i7 Broadcast Registers
/0/5d generic Xeon E7 v2/Xeon E5 v2/Core i7 Broadcast Registers
/0/5e scsi1 storage
/0/5e/0.0.0 /dev/sda disk 400GB INTEL SSDSC2BA40
/0/5e/0.0.0/1 /dev/sda1 volume 244GiB EXT4 volume
/0/5e/0.0.0/2 /dev/sda2 volume 127GiB Extended partition
/0/5e/0.0.0/2/5 /dev/sda5 volume 127GiB Linux swap / Solaris partition
/1 power To Be Filled By O.E.M.
/2 virbr0-nic network Ethernet interface

  • OS (e.g: cat /etc/os-release):
    Linux ubuntu-211224 4.4.0-87-generic #110-Ubuntu SMP Tue Jul 18 12:55:35 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux
  • Kernel (e.g. uname -a):
    Linux ubuntu-211224 4.4.0-87-generic #110-Ubuntu SMP Tue Jul 18 12:55:35 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux
  • Install tools:
  • Network plugin and version (if this is a network-related bug):
  • Others:

/sig node

@odinuge

This comment has been minimized.

Copy link
Member

commented Sep 13, 2019

Hi!

We do currently support multiple huge page sizes on node level, but only allow one of them to have pre allocated pages. This is issue is tracked in #77251, and awaiting more feedback from sig-node.

Not sure why kubeadm join times out (without reading the full log of kubelet), but I guess it is becuase kubelet fails to start due to the node validation as a result of pre allocated huge pages with different sizes.

If you run: grep -R "" /sys/kernel/mm/hugepages/ /proc/sys/vm/*huge* and more than one size has nr_hugepages > 0, that is the cause.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
3 participants
You can’t perform that action at this time.