Skip to content

Update azuremigrate namespace description#2043

Merged
vcolin7 merged 3 commits intomainfrom
vcolin7/fix-azure-migrate
Mar 14, 2026
Merged

Update azuremigrate namespace description#2043
vcolin7 merged 3 commits intomainfrom
vcolin7/fix-azure-migrate

Conversation

@vcolin7
Copy link
Copy Markdown
Contributor

@vcolin7 vcolin7 commented Mar 13, 2026

What does this PR do?

Enhance the description for the azuremigrate tool namespace to improve LLM selection accuracy.

GitHub issue number?

Fixes #1998

Pre-merge Checklist

  • Required for All PRs
    • Read contribution guidelines
    • PR title clearly describes the change
    • Commit history is clean with descriptive messages (cleanup guide)
    • Added comprehensive tests for new/modified functionality
    • Updated servers/Azure.Mcp.Server/CHANGELOG.md and/or servers/Fabric.Mcp.Server/CHANGELOG.md for product changes (features, bug fixes, UI/UX, updated dependencies)
  • For MCP tool changes:
    • One tool per PR: This PR adds or modifies only one MCP tool for faster review cycles
    • Updated servers/Azure.Mcp.Server/README.md and/or servers/Fabric.Mcp.Server/README.md documentation
    • Validate README.md changes using script at eng/scripts/Process-PackageReadMe.ps1. See Package README
    • Updated command list in /servers/Azure.Mcp.Server/docs/azmcp-commands.md and/or /docs/fabric-commands.md
    • Run .\eng\scripts\Update-AzCommandsMetadata.ps1 to update tool metadata in azmcp-commands.md (required for CI)
    • For new or modified tool descriptions, ran ToolDescriptionEvaluator and obtained a score of 0.4 or more and a top 3 ranking for all related test prompts
    • For tools with new names, including new tools or renamed tools, update consolidated-tools.json
    • For new tools associated with Azure services or publicly available tools/APIs/products, add URL to documentation in the PR description
  • Extra steps for Azure MCP Server tool changes:
    • Updated test prompts in /servers/Azure.Mcp.Server/docs/e2eTestPrompts.md
    • 👉 For Community (non-Microsoft team member) PRs:
      • Security review: Reviewed code for security vulnerabilities, malicious code, or suspicious activities before running tests (crypto mining, spam, data exfiltration, etc.)
      • Manual tests run: added comment /azp run mcp - pullrequest - live to run Live Test Pipeline

@vcolin7
Copy link
Copy Markdown
Contributor Author

vcolin7 commented Mar 13, 2026

Succeeded in calling Azure Migrate tools with the following prompts using Claude Sonnet 4.5:


How can I disable a policy in my Platform Landing Zone?

Screenshot 2026-03-13 163107

Show me how to modify network topology in my Landing Zone

Screenshot 2026-03-13 164643

@vcolin7 vcolin7 enabled auto-merge (squash) March 13, 2026 23:54
Comment thread eng/tools/ToolDescriptionEvaluator/prompts/namespace-tools.json
@vcolin7 vcolin7 merged commit 70a7530 into main Mar 14, 2026
27 checks passed
@vcolin7 vcolin7 deleted the vcolin7/fix-azure-migrate branch March 14, 2026 01:28
@github-project-automation github-project-automation Bot moved this from Untriaged to Done in Azure MCP Server Mar 14, 2026
colbytimm pushed a commit to colbytimm/microsoft-mcp that referenced this pull request Apr 20, 2026
* Updated description for the "azuremigrate" namespace

* Updated namespace tools JSON

* Added changelog entry YAML
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

Status: Done

Development

Successfully merging this pull request may close these issues.

[Namespace mode] E2E test prompts in Azure Migrate do not trigger corresponding MCP tools

2 participants