how can i create inference clusters ?

[yogidosalwar]

Hi @setuc , I want to create inference cluster, i.e. Deploy model to the Azure Kubernetes Service for large scale inferencing. How can I create a compute inference cluster?

Thank you

[setuc]

We have tackled the deployment to the AKS cluster and it is not planned for the upcoming release.

You can follow the docs to link AKS to azure ml workspace.

https://learn.microsoft.com/en-us/azure/machine-learning/how-to-attach-kubernetes-to-workspace

The deployment script can be modified to deploy the endpoint to AkS cluster.

To create a cluster you can use this

https://azure.github.io/AKS-Construction/