Unable to re-deploy when agent pool uses managed disks

[sjdweb]

Is this a request for help?:
Yes

Is this a BUG REPORT or FEATURE REQUEST? (choose one):
Bug

We're using managed disks mainly for the disk encryption that comes for free and requires no key management.

The deployment template has various other things in them, and we tend to redeploy often - we may add a new subscription to a Azure Service Bus topic for example.

We're not even trying to scale the cluster in any way.

Currently this bug will block the deployment.

Orchestrator and version (e.g. Kubernetes, DC/OS, Swarm)
Kubernetes

What happened:

Deployment failed. {
  "status": "Failed",
  "error": {
    "code": "ResourceDeploymentFailure",
    "message": "The resource operation completed with terminal provisioning state 'Failed'.",
    "details": [
      {
        "code": "OperationNotAllowed",
        "message": "Scaling a cluster with an agent pool(s) with managed disks is unsupported"
      }
    ]
  }
}

What you expected to happen:
If we're not trying to scale the agent pool (as the error says) - the deployment should pass.

How to reproduce it (as minimally and precisely as possible):
Deploy a new azure cluster service with managed disks for your agent pool. Immediately re-deploy, you'll see the error.

Anything else we need to know:
No.

[rjtsdl]

@sjdweb thanks for reporting. we are tracking this.

[rjtsdl]

@sjdweb wondering how do you do the deployment? Can you give detail steps?

When you say, you will need to add a new subscription to a Azure Service Bus topic. Do you actually change the ARM template?

[rjtsdl]

I tried using az cli to re-deploy right after the initial deployment succeed. It doesn't throw any error. I guess, there is some change in your re-deploy, which get the 're-deploy' is classified as an update on the existing cluster.

Note, we don't support any update scenario except for scaling. For managed disks agents, apparently, we don't support any kind update for now.

[JackQuincy]

On a side note ACS-Engine now supports scaling down with managed disks so we can just remove our check and start supporting it as well.

[rjtsdl]

@JackQuincy , how about scaling up with managed disks?

[JackQuincy]

Yes, that was always supported. Get Outlook for iOS<https://aka.ms/o0ukef>

…

________________________________ From: Jingtao Ren <notifications@github.com> Sent: Tuesday, September 5, 2017 5:13:36 PM To: Azure/ACS Cc: Jack Quincy; Mention Subject: Re: [Azure/ACS] Unable to re-deploy when agent pool uses managed disks (#62) @JackQuincy<https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fjackquincy&data=02%7C01%7Cjaquincy%40microsoft.com%7C95c6e5181e8d4070ff6008d4f4bc1ecf%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C636402536189715745&sdata=a%2FynVf%2FFUyT6boy%2B4NRbHjEoNLq%2FNpm1Rf3mOW%2F8wLQ%3D&reserved=0> , how about scaling up with managed disks? — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub<https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FAzure%2FACS%2Fissues%2F62%23issuecomment-327337805&data=02%7C01%7Cjaquincy%40microsoft.com%7C95c6e5181e8d4070ff6008d4f4bc1ecf%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C636402536189715745&sdata=QL50OwEYvvTM4yMo4x2%2BPhjQYAy0d8dEmCqVhedsn1Q%3D&reserved=0>, or mute the thread<https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fnotifications%2Funsubscribe-auth%2FAUBiNH1hOd__ypzQYVQxTBGO95wXllxrks5sfeOwgaJpZM4PLsys&data=02%7C01%7Cjaquincy%40microsoft.com%7C95c6e5181e8d4070ff6008d4f4bc1ecf%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C636402536189715745&sdata=49O%2BhgrKMmzPkDL1N9i9nuUvLz4eesukGcD62yHGq1o%3D&reserved=0>.

[sjdweb]

@rjtsdl Hi, thanks for getting back. I can consistently reproduce the error by redeploying the ARM template with no changes, straight after an initial deployment.

Has there been an update recently? I am running azure-cli 2.0.14 and deploying to UkSouth.

When you say, you will need to add a new subscription to a Azure Service Bus topic. Do you actually change the ARM template?

Yes, to the Service Bus section of resources - this is the reason behind needing to redeploy, but I see the error even without any change to the ARM file.

[rjtsdl]

@sjdweb , as @JackQuincy pointed out, we are going to remove the scaling gate for managedDisks agent with k8s. I will update this thread later.

[sjdweb]

hi @rjtsdl was this resolved? seems to be working (on a new cluster) as of today.

[weinong]

yes it is. Closing the issue.