Multiple Node Pool Support

[derekperkins]

This is a tracking issue for node pool support as mentioned by @slack in #79. Node pools are shown in the UI, but without a way to add new ones. I'm wanting to add some L series nodes to my cluster to run a database, but keep using D series machines for the bulk of my workers. When are multiple node pools expected to be supported?

[sauryadas]

In the roadmap, about 6 months

[derekperkins]

Thanks for the heads up.

[ghost]

We are planning to move our cloudservices to a container environment. I was very impressed with the ease of use of AKS while testing it. However, the impossibility to scale the size of the VMs is a blocker at the moment (#79).

Do I understand it correctly that with the future possibility of adding different nodepools it would be possible to add a new nodepool and then delete the old one without service interruption?

[ghost]

@sauryadas Could you tell us if it will be possible to remove Nodepools?
thank you!

[sauryadas]

There is only one node pool support today . You cannot delete that node pool. You will need to delete the cluster itself. When we have support for multiple node pools , you will be able to delete a node pool when you have more than one node pool. Thanks Saurya

…

________________________________ From: lawgorht <notifications@github.com> Sent: Tuesday, May 15, 2018 5:15:42 AM To: Azure/AKS Cc: Saurya Das; Mention Subject: Re: [Azure/AKS] Add Node Pool Support (#287) @sauryadas<https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fsauryadas&data=02%7C01%7Csaudas%40microsoft.com%7C9771e9c166cf4458b8fd08d5ba5d9578%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C636619833463752659&sdata=6TsvbX6cHa6vpYTIE10hLj6wAzzp%2Fe4eKCPE%2BMAnztM%3D&reserved=0> Could you tell us if it will be possible to remove Nodepools? thank you! — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub<https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FAzure%2FAKS%2Fissues%2F287%23issuecomment-389145228&data=02%7C01%7Csaudas%40microsoft.com%7C9771e9c166cf4458b8fd08d5ba5d9578%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C636619833463752659&sdata=3oIMpPCFV52Gj1aj3r9U47hiAfsVPJG1n3HEaV%2BIqq0%3D&reserved=0>, or mute the thread<https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fnotifications%2Funsubscribe-auth%2FAOrMb22DOsrqQSOEgbe-chpQvoEqg56Vks5tysbugaJpZM4TF8XM&data=02%7C01%7Csaudas%40microsoft.com%7C9771e9c166cf4458b8fd08d5ba5d9578%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C636619833463762663&sdata=%2FdSyg9dtgq7euV1%2Bhlu%2FDH9obspVxIEqn8cw4o0arv8%3D&reserved=0>.

[judy-zz]

+1 for this. I'm also interested in using different node pools for security reasons, like single tenancy for Vault.

[ellieayla]

Cross reference https://feedback.azure.com/forums/914020-azure-kubernetes-service-aks/suggestions/34917127-support-multiple-node-pool

[marcel-dempers]

Hi all, any update on this ? Based on this thread we are 2 months away from node pool support ?

[agolomoodysaada]

This is a deal breaker for us as we require running most workloads on standard VMs while CPU intensive workloads require special CPU hardware like the F series VMs.
It's also critical for migrating to VMs with larger OS disks. Otherwise, when disks are too small, the kubelet starts evicting pods due to the nodefs.available signal.

[agolomoodysaada]

Can we at least open up preview versions? 😭

[kvolkovich-sc]

I made a manual temporary hack)

Just change single node size manually to increase RAM (need more for one pod).

Looks like it works normally.

But I don't know what to expect after next time horizontal scaling.

[agolomoodysaada]

@kvolkovich-sc that doesn't work with horizontal scaling unfortunately. I tried asking Azure support for help but they said we have to wait for node pool support for this to work

[ellieayla]

It also doesn't work for mixing node types (eg, one node pool has GPUs).

[gabrielmcf]

Any new on this issue? Is there a beta version already? Still planned to october?

[kitgary]

Any update on this? I really need it for production.

[sauryadas]

End of Oct is still the ETA .. Thanks for your patience.

[ormico]

T - 36 days and counting

[ormico]

cool. k8 v1.12 released with Azure Scale Set support. must be getting close.
https://kubernetes.io/blog/2018/09/27/kubernetes-1.12-kubelet-tls-bootstrap-and-azure-virtual-machine-scale-sets-vmss-move-to-general-availability/

[jmajoor]

Will support for multiple node pools also include the ability to have one pool of Linux nodes and another pool of Windows nodes. Currently the only option for windows containers on AKS is through virtual-kubelets, which uses ACI. There are too many limitations in using ACI and windows containers. These restrictions shouldn't be necessary if you can setup a pool of windows nodes.

[sauryadas]

the eventual goal is to support hybrid clusters but there is no ETA yet for windows support in AKS. Sorry.

[arwkmd]

There is a problem with iteration over pools in all templates used to generate ARM templates. See Azure/acs-engine#3102. AKS uses ACS-Engine under hood.

[btok]

Hi @sauryadas ! Can you please give us current status of the ETA of node pools ?
Would REALLY appriciate planning according to ETA on my end as its an urgent update for production env.
Thanks a lot !

[sauryadas]

node pools has been delayed by a quarter and will now come in the 1st quarter of 2019. Apologies for the delay. I will keep you posted if we get it in earlier.

[przemolb]

@sauryadas can you please tell us what is the reason to delay it ?

[sauryadas]

@przemolb Currently we are focused on fixing any existing issues and keep the QoS high before we roll out new features ...

[przemolb]

@sauryadas hire more people ;-)

[jnoller]

Multiple node pools are now in public preview: https://github.com/Azure/AKS/blob/master/previews.md#multiple-node-pools

[jluk]

This feature is set to GA in Q4CY19.

[jluk]

This feature is now generally available, thank you everyone for your patience and feedback on this important feature. Documentation can be found at aka.ms/aks/nodepools. Closing.