Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Question] How to enable cgroups v1 in AKS 1.25+? #3580

Closed
maxkt opened this issue Mar 30, 2023 · 6 comments
Closed

[Question] How to enable cgroups v1 in AKS 1.25+? #3580

maxkt opened this issue Mar 30, 2023 · 6 comments
Labels
action-required Needs Attention 👋 Issues needs attention/assignee/owner question

Comments

@maxkt
Copy link

maxkt commented Mar 30, 2023

Describe scenario
We use AKS to orchestrate Docker containers that serve as isolated envrionments for on-the-go code evaluation in different languages. Inside Docker containers we apply one more isolation level via a sandbox library called isolate. This library is built on cgroups v1 API.

AKS version 1.25 includes update to Ubuntu 22 which has cgroups v1 API disabled by default and replaced by cgroups v2. Isolate library doesn't support cgroups v2 yet. While in general one may configure the OS to stay on cgroups v1 in Ubuntu 22, I don't see a documented way to to it in AKS.

AKS version 1.24 still works on lower Ubuntu version that has cgroups v1 enabled, but this AKS version is going to be depreacted in a couple of months.

Question
Can we somehow configure Ubuntu nodes in 1.25+ AKS cluster to use cgroups v1? If we don't do it, we may need to stay on the deprecated AKS version and that's not good, obviously.

@maxkt maxkt added the question label Mar 30, 2023
@ghost ghost added the action-required label Apr 24, 2023
@daalse
Copy link

daalse commented Apr 26, 2023

Hi maxkt,
Please check this: https://github.com/Azure/AKS/tree/master/examples/cgroups.

It might address your issue

@ghost
Copy link

ghost commented May 1, 2023

Action required from @Azure/aks-pm

@ghost ghost added the Needs Attention 👋 Issues needs attention/assignee/owner label May 1, 2023
@ghost
Copy link

ghost commented May 16, 2023

Issue needing attention of @Azure/aks-leads

1 similar comment
@ghost
Copy link

ghost commented Jun 1, 2023

Issue needing attention of @Azure/aks-leads

@aritraghosh
Copy link
Contributor

@seocho2360
Copy link

seocho2360 commented Jun 27, 2023

https://github.com/Azure/AKS/tree/master/examples/cgroups
@aritraghosh
@daalse

hello.
I was getting node out of memory error after upgrading AKS version from 1.24.X to 1.26.3.

However, after reading "https://github.com/Azure/AKS/tree/master/examples/cgroups" and setting cgroup v1, stable memory is being used.

I plan to use cgroup v2 again by upgrading the java version in the future. Can I get a yaml file that changes cgroup v1 -> v2?
please I kindly ask for a quick reply.
Thanks you

@ghost ghost locked as resolved and limited conversation to collaborators Jul 27, 2023
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
action-required Needs Attention 👋 Issues needs attention/assignee/owner question
Projects
None yet
Development

No branches or pull requests

4 participants