Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

cannot create Kubernetes v1.17.17 cluster on cgroups v2 host #2295

Closed
ermalguni opened this issue Jun 2, 2021 · 2 comments
Closed

cannot create Kubernetes v1.17.17 cluster on cgroups v2 host #2295

ermalguni opened this issue Jun 2, 2021 · 2 comments
Assignees
Labels
kind/external upstream bugs

Comments

@ermalguni
Copy link

What happened: Cannot create multi node cluster of older kubernetes version v1.17.17.

What you expected to happen: Multi node cluster gets created succesfully

How to reproduce it (as minimally and precisely as possible):

kind: Cluster
apiVersion: kind.x-k8s.io/v1alpha4
name: pe-test
nodes:
- role: control-plane
  image: kindest/node:v1.17.17@sha256:66f1d0d91a88b8a001811e2f1054af60eef3b669a9a74f9b6db871f2f1eeed00
  extraPortMappings:
  - containerPort: 80
    hostPort: 18080
    protocol: TCP
  - containerPort: 443
    hostPort: 18443
    protocol: TCP
- role: worker
  image: kindest/node:v1.17.17@sha256:66f1d0d91a88b8a001811e2f1054af60eef3b669a9a74f9b6db871f2f1eeed00
- role: worker
  image: kindest/node:v1.17.17@sha256:66f1d0d91a88b8a001811e2f1054af60eef3b669a9a74f9b6db871f2f1eeed00

Anything else we need to know?:

Environment:

  • kind version: (use kind version): 0.11.1
  • Kubernetes version: (use kubectl version):
Client Version: version.Info{Major:"1", Minor:"21", GitVersion:"v1.21.0", GitCommit:"cb303e613a121a29364f75cc67d3d580833a7479", GitTreeState:"clean", BuildDate:"2021-04-08T16:31:21Z", GoVersion:"go1.16.1", Compiler:"gc", Platform:"linux/amd64"}
  • Docker version: (use docker info):
Client:
 Context:    default
 Debug Mode: false
 Plugins:
  app: Docker App (Docker Inc., v0.9.1-beta3)
  buildx: Build with BuildKit (Docker Inc., v0.5.1-tp-docker)

Server:
 Containers: 1
  Running: 0
  Paused: 0
  Stopped: 1
 Images: 4
 Server Version: 20.10.6
 Storage Driver: overlay2
  Backing Filesystem: extfs
  Supports d_type: true
  Native Overlay Diff: false
  userxattr: false
 Logging Driver: json-file
 Cgroup Driver: systemd
 Cgroup Version: 2
 Plugins:
  Volume: local
  Network: bridge host ipvlan macvlan null overlay
  Log: awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog
 Swarm: inactive
 Runtimes: io.containerd.runc.v2 io.containerd.runtime.v1.linux runc
 Default Runtime: runc
 Init Binary: docker-init
 containerd version: 36cc874494a56a253cd181a1a685b44b58a2e34a.m
 runc version: b9ee9c6314599f1b4a7f497e1f1f856fe433d3b7
 init version: de40ad0
 Security Options:
  seccomp
   Profile: default
  cgroupns
 Kernel Version: 5.12.8-arch1-1
 Operating System: Arch Linux
 OSType: linux
 Architecture: x86_64
 CPUs: 8
 Total Memory: 31.04GiB
 Name: pe
 ID: EBSG:MAJK:HEPA:U5X3:ALVG:QI7S:6SRS:6H5F:DSJX:WY5J:M52Q:KGRX
 Docker Root Dir: /var/lib/docker
 Debug Mode: false
 Username: ermalguni
 Registry: https://index.docker.io/v1/
 Labels:
 Experimental: false
 Insecure Registries:
  127.0.0.0/8
 Live Restore Enabled: false

WARNING: No kernel memory limit support
WARNING: No oom kill disable support
@ermalguni ermalguni added the kind/bug Categorizes issue or PR as related to a bug. label Jun 2, 2021
@BenTheElder
Copy link
Member

It's not that it's multi-node, it's that you're on cgroups v2 and Kubernetes doesn't support cgroups v2 before 1.19.

Cgroup Version: 2

kindest/node:v1.17.17

We can't do anything about that. It's a large patch that will not be backported upstream and versions older than 1.19 are also not supported by Kubernetes upstream anymore and won't receive any patches.

https://kind.sigs.k8s.io/docs/user/known-issues/#failure-to-create-cluster-with-cgroups-v2

https://kubernetes.io/releases/patch-releases

@BenTheElder BenTheElder changed the title Multi-Node cluster cannot be created for image v1.17.17 cannot create Kubernetes v1.17.17 cluster on cgroups v2 host Jun 2, 2021
@BenTheElder BenTheElder added kind/external upstream bugs and removed kind/bug Categorizes issue or PR as related to a bug. labels Jun 2, 2021
@BenTheElder BenTheElder self-assigned this Jun 2, 2021
@ermalguni
Copy link
Author

Thank you. For future readers: after switching to cgroups v1 the cluster did start.

This issue was closed.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
kind/external upstream bugs
Projects
None yet
Development

No branches or pull requests

2 participants