Add compute VM and VMSS create/update commands with smart workload-based defaults by haagha · Pull Request #1705 · microsoft/mcp

haagha · 2026-02-11T19:55:12Z

Summary

Addresses tools from #1452

This PR adds four new compute commands for creating and updating Azure Virtual Machines (VMs) and Virtual Machine Scale Sets (VMSS):

azmcp compute vm create - Create a new virtual machine
azmcp compute vm update - Update an existing virtual machine
azmcp compute vmss create - Create a new virtual machine scale set
azmcp compute vmss update - Update an existing virtual machine scale set

Command Parameters

`compute vm create`

Parameter	Description
`--vm-name`	Name of the VM (required)
`--resource-group`	Resource group name (required)
`--subscription`	Subscription ID or name (required)
`--location`	Azure region
`--vm-size`	VM size (e.g., Standard_D2s_v5)
`--image`	OS image (e.g., Ubuntu2204, Win2022)
`--admin-username`	Admin username
`--admin-password`	Admin password (Windows or Linux without SSH)
`--ssh-public-key`	SSH public key (Linux)
`--workload`	Workload type for smart defaults (development, web, database, compute, memory, gpu, general)
`--os-type`	OS type (Linux, Windows)
`--virtual-network`	Existing VNet name
`--subnet`	Existing subnet name
`--public-ip-address`	Public IP address name
`--network-security-group`	NSG name
`--no-public-ip`	Create without public IP
`--zone`	Availability zone
`--os-disk-size-gb`	OS disk size in GB
`--os-disk-type`	OS disk type (Premium_LRS, Standard_LRS)

`compute vm update`

Parameter	Description
`--vm-name`	Name of the VM (required)
`--resource-group`	Resource group name (required)
`--subscription`	Subscription ID or name (required)
`--vm-size`	Resize VM
`--tags`	Add/update tags (key=value,key2=value2)
`--license-type`	Enable/disable Azure Hybrid Benefit
`--boot-diagnostics`	Enable/disable boot diagnostics (true/false)
`--user-data`	Update base64-encoded user data

`compute vmss create`

Parameter	Description
`--vmss-name`	Name of the VMSS (required)
`--resource-group`	Resource group name (required)
`--subscription`	Subscription ID or name (required)
`--location`	Azure region
`--vm-size`	VM size
`--image`	OS image
`--admin-username`	Admin username
`--admin-password`	Admin password
`--ssh-public-key`	SSH public key (Linux)
`--workload`	Workload type for smart defaults
`--os-type`	OS type (Linux, Windows)
`--virtual-network`	Existing VNet name
`--subnet`	Existing subnet name
`--instance-count`	Initial number of instances
`--upgrade-policy`	Upgrade policy (Automatic, Manual, Rolling)
`--zone`	Availability zone
`--os-disk-size-gb`	OS disk size in GB
`--os-disk-type`	OS disk type

`compute vmss update`

Parameter	Description
`--vmss-name`	Name of the VMSS (required)
`--resource-group`	Resource group name (required)
`--subscription`	Subscription ID or name (required)
`--vm-size`	Resize VMs
`--capacity`	Scale out/in instance count
`--upgrade-policy`	Change upgrade policy (Automatic, Manual, Rolling)
`--overprovision`	Enable/disable overprovisioning
`--enable-auto-os-upgrade`	Enable/disable automatic OS upgrades
`--scale-in-policy`	Set scale-in policy (Default, OldestVM, NewestVM)
`--tags`	Add/update tags (key=value,key2=value2)

Changes

Documentation

Updated azmcp-commands.md with full command documentation
Added 25+ test prompts to e2eTestPrompts.md
Updated consolidated-tools.json with tool groupings
Updated README.md with example prompts

Tests

Unit Tests: 98 tests covering all commands
Live Tests: 11 recorded tests (7 get + 4 update tests)

Changelog

Added changelog entry for the new commands

ToolDescriptionEvaluator Results

43 prompts tested for compute tools:

Metric	Result
Top Choice Success	97.7% (42/43) ✅
Acceptable Confidence (≥0.4)	97.7% (42/43) ✅

Testing

✅ All 98 unit tests pass
✅ All 11 live tests recorded and pass in playback mode
✅ Recordings pushed to Azure/azure-sdk-assets with tag Azure.Mcp.Tools.Compute.LiveTests_8c431d915f
✅ ToolDescriptionEvaluator: 97.7% top choice success
✅ Spelling check passes
✅ Build succeeds

## Tool Selection Analysis Results Summary

Total Prompts Tested: 46
Analysis Execution Time: 7.9322877s

Success Rate Metrics

Top Choice Success: 97.8% (45/46 tests)

Confidence Level Distribution

💪 Very High Confidence (≥0.8): 0.0% (0/46 tests)
🎯 High Confidence (≥0.7): 4.3% (2/46 tests)
✅ Good Confidence (≥0.6): 34.8% (16/46 tests)
👍 Fair Confidence (≥0.5): 87.0% (40/46 tests)
👌 Acceptable Confidence (≥0.4): 100.0% (46/46 tests)
❌ Low Confidence (<0.4): 0.0% (0/46 tests)

Top Choice + Confidence Combinations

💪 Top Choice + Very High Confidence (≥0.8): 0.0% (0/46 tests)
🎯 Top Choice + High Confidence (≥0.7): 4.3% (2/46 tests)
✅ Top Choice + Good Confidence (≥0.6): 34.8% (16/46 tests)
👍 Top Choice + Fair Confidence (≥0.5): 84.8% (39/46 tests)
👌 Top Choice + Acceptable Confidence (≥0.4): 97.8% (45/46 tests)

Success Rate Analysis

🟢 Excellent - The tool selection system is performing exceptionally well.

⚠️ Recommendation: Tool descriptions need improvement to better match user intent (targets: ≥0.6 good, ≥0.7 high).

…up, VmName, and VmssName

- Created assets.json for test asset configuration. - Added Azure.Mcp.Tools.Compute.UnitTests project file. - Implemented VmGetCommandTests to validate VM retrieval commands. - Developed PowerShell script for post-deployment resource checks. - Created Bicep template for resource provisioning in tests. - Added JSON deployment template for resource management.

…nce ID and VMSS name; update JSON serialization and error handling for improved clarity and flexibility.

…get-operations

- Removed unused ListVmSizesAsync method from IComputeService. - Updated ComputeCommandTests to reflect changes in VM and VMSS naming conventions. - Adjusted test resources to deploy a single VM and VMSS with updated sizes. - Added new unit tests for VMSS get operations, including validation and error handling. - Updated changelog to document the addition of VMSS get operations.

…anitization; update assets.json with tag value.

- Updated the description for VmGetCommand to clarify the behavior based on parameters and streamline the information provided. - Revised the description for VmssGetCommand to enhance clarity on the retrieval of VMSS and their instances, focusing on the details returned. - Removed outdated specialized resource collection patterns from new-command.md to simplify documentation.

- Implemented VmCreateCommand to facilitate the creation of Azure VMs. - Introduced VmCreateResult model to encapsulate the results of VM creation. - Enhanced ComputeOptionDefinitions with new options for VM creation, including size, image, and workload. - Created VmCreateOptions class to manage input parameters for VM creation. - Updated ComputeService to handle VM creation logic, including network and security group setup. - Added workload configurations to suggest optimal VM sizes based on workload type. - Implemented unit tests for VmCreateCommand to ensure correct behavior and validation of inputs.

…ements and SSH key discovery

- Removed SSH key auto-discovery from ~/.ssh/ (problematic for remote MCP servers) - Require explicit --ssh-public-key or --admin-password for Linux VMs - Updated tool description with clear instructions for SSH key workflow - Added helpful validation error message guiding users to read SSH public key first

- Add VmUpdateCommand for updating VM properties (size, tags, license type, boot diagnostics, user data) - Add VmssCreateCommand for creating VMSS with smart workload defaults - Add VmssUpdateCommand for updating VMSS properties (capacity, upgrade policy, overprovision, auto-os-upgrade, scale-in-policy, tags) - Add corresponding Options, Result models, and service implementations - Register new commands in ComputeSetup and JSON serialization context

…create/update commands

… haagha/vm-create

haagha · 2026-03-02T18:03:18Z

@g2vinay resolved the changes and added tool description analysis in the description:

Tool Selection Analysis Results Summary

Total Prompts Tested: 46
Analysis Execution Time: 7.9322877s

Success Rate Metrics

Top Choice Success: 97.8% (45/46 tests)

Confidence Level Distribution

💪 Very High Confidence (≥0.8): 0.0% (0/46 tests)
🎯 High Confidence (≥0.7): 4.3% (2/46 tests)
✅ Good Confidence (≥0.6): 34.8% (16/46 tests)
👍 Fair Confidence (≥0.5): 87.0% (40/46 tests)
👌 Acceptable Confidence (≥0.4): 100.0% (46/46 tests)
❌ Low Confidence (<0.4): 0.0% (0/46 tests)

Top Choice + Confidence Combinations

💪 Top Choice + Very High Confidence (≥0.8): 0.0% (0/46 tests)
🎯 Top Choice + High Confidence (≥0.7): 4.3% (2/46 tests)
✅ Top Choice + Good Confidence (≥0.6): 34.8% (16/46 tests)
👍 Top Choice + Fair Confidence (≥0.5): 84.8% (39/46 tests)
👌 Top Choice + Acceptable Confidence (≥0.4): 97.8% (45/46 tests)

Success Rate Analysis

🟢 Excellent - The tool selection system is performing exceptionally well.

⚠️ Recommendation: Tool descriptions need improvement to better match user intent (targets: ≥0.6 good, ≥0.7 high).

KarishmaGhiya

Please address the other feedback. Also what kind of secrets do the create commands emit?

…ress-prefix, fix GUIDs, improve error handling and validation

haagha · 2026-03-04T17:21:16Z

All feedback has been addressed. The secret emitted by the create commands is the admin password (--admin-password), which is why they're marked Secret = true.

…ing resources when missing

…matic networking provisioning

…sed defaults (microsoft#1705)

Haider Agha added 18 commits January 12, 2026 16:57

adding first commit

d9c4f5c

Refactor option binding to use updated property names for ResourceGro…

55ad41e

…up, VmName, and VmssName

Refactor code structure for improved readability and maintainability

f5c2e98

Add test projects and update test assertions for VM and VMSS details

53d0bd2

Enhance VMSS command functionality with optional parameters for insta…

12c4388

…nce ID and VMSS name; update JSON serialization and error handling for improved clarity and flexibility.

Merge branch 'main' of https://github.com/microsoft/mcp into vm-vmss-…

e626f39

…get-operations

Refactor ComputeCommandTests to use resource base names and improve s…

4d3c7d3

…anitization; update assets.json with tag value.

Update CODEOWNERS to add additional owners for Compute tools

4053d07

Update CODEOWNERS to correct ServiceLabel for Compute tools

a2654b4

Remove changelog entry for Azure Compute VM operations

86540c8

feat: Enhance VM creation command with detailed authentication requir…

39eadcb

…ements and SSH key discovery

Add documentation, unit tests, live tests, and changelog for VM/VMSS …

ceec41f

…create/update commands

Copilot AI review requested due to automatic review settings February 11, 2026 19:55

haagha requested review from a team and g2vinay as code owners February 11, 2026 19:55

haagha requested review from jairmyree, jongio, joshfree, saikoumudi, tmeschter and wbreza February 11, 2026 19:55

github-project-automation Bot added this to Azure MCP Server Feb 11, 2026

Merge branch 'haagha/vm-create' of https://github.com/haagha/mcp into…

b69ead0

… haagha/vm-create

haagha requested a review from g2vinay March 2, 2026 18:03