-
Notifications
You must be signed in to change notification settings - Fork 2.3k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Support cgroups v2 #900
Comments
rc9 still doesn't really support cgroup2, especially still lacks support for device controller |
Bummer. Ok well I suppose there is nothing k3s can really do to move that along so feel free to close this issue if you wish. |
https://github.com/containers/crun is a good drop in for runc and has full cgroupv2 support. Not a trivial change but crun seems better than runc in every way. |
I'm hitting the same issue on k3 master on fedora 31. As a workaround I've added |
Running this command from the Fedora wiki worked:
|
i'm sorry i'm kind of confused. what are the main things k3s depends on that need to gain cgroup v2 support? here's some tickets for various projects. i'm not sure which of these we are going to need.
also enjoying a ~nov 1 post from @AkihiroSuda, The current adoption status of cgroup v2 in containers, which helped me understand some of this all. |
Here is my understanding: k3s uses containerd which uses runc which only supports cgroup v1. crun is an alternative to runc that supports cgroup v2. If containerd supports crun then containerd will support cgroup v2 inherently and so too will k3s. |
The biggest missing part is kubelet |
crio already supports crun, for a minimalist kubernetes deployment crio would be simpler than containerd, containerd has a lot of baggage and currently the main blocker for 1370. Edit: open issue for cgroup v2 support in containerd containerd/containerd#3726 the work to resolve runc is partly being done by porting across what crun has already done. |
Wrong. containerd already supports cgroup v2. |
is there any plan to support cgroup v2? |
Kubelet now support Cgroup V2 |
Every linked issues on this thread is closed. |
cgroup2 PR for k3s is here #2584 |
Great contribution! 🎉
…On Fri, 27 Nov 2020 at 02:22, Akihiro Suda ***@***.***> wrote:
cgroup2 PR for k3s is here #2584
<#2584>
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
<#900 (comment)>, or
unsubscribe
<https://github.com/notifications/unsubscribe-auth/ACVCFZVVH4HS4FUPOPD2B5DSR4EMPANCNFSM4JA5VWHA>
.
|
❤️ @AkihiroSuda Stunning work. I saw your Kubecon talk and hoped this might be on the horizon. I see rootless is coming up afterwards from the PR description. That is fantastic to hear! 🍻 |
Based on that error I think we need some additional changes on both the server and agent side: |
Does it work if you run |
No it doesn't. I tried it in a fresh setup, running as root, but got the same error. |
Hi. I don't want to put any pressure on anyone, I just want to set some expectations. We are planning to release v1.20.0+k3s1 not any later than December 16th. Our due date to get things in is pretty much today, Monday the 14th is kind of a stretch. If we can't verify this is working I will need to be moving this to our next milestone, which is slated for a January 13th release (when upstream will deliver next set of patches). I will be moving this issue to the next Milestone for January next year if it looks like this requires much more effort. |
We need some more time to resolve the problems Max outlined. I've bumped this to our next planned release in Mid-January. |
Is anyone working? |
@AkihiroSuda not at the moment; if you have cycles to dig into this we'd all be very grateful ;) |
PR: #2844 |
This has been validated as working. Validated using commit |
I just want to call out that hybrid mode is only supported if the required cgroup controllers are in v1. If v2 has claimed them we will not check there for them in hybrid mode. |
k3s-agent
is failing to run on Fedora 31. I suspect this is due to cgroups v2 being the default on Fedora 31, but can't quite figure out how to see which version of runc is shipping with k3s (runc recently landed support for cgroups v2)Version:
k3s version v0.9.1 (755bd1c6)
Describe the bug
k3s-agent exits 1 and dies repeatedly with the following log output:
To Reproduce
Start up a k3s agent on Fedora 31 Server
Expected behavior
Should start
Actual behavior
Doesn't and poops out the logs above
Additional context
Again, I think this is related to the cgroups v2 change, but couldn't figure out which version of runc is getting packaged with k3s right now to confirm. The most recent version of runc (1.0.0-rc9) is required for cgroups v2 to function.
The text was updated successfully, but these errors were encountered: