Skip to content

[Tool Description] Improve Subscription tool description for better LLM selection #262

@alzimmermsft

Description

@alzimmermsft

Problem

The current Subscription tool description lacks the detail and clarity needed for optimal LLM tool selection, resulting in an estimated confidence score of ~0.2-0.3 (below target of ≥0.5).

Current Description Issues:

  • Very brief - only mentions listing and managing without specifics
  • Missing usage guidance (when to use vs when not to use)
  • Limited context about Azure subscription hierarchy and management
  • Poor parameter explanation
  • Missing specific subscription management operations
  • Formatting issues (missing space after period)
  • No mention of billing, governance, or subscription scope context

Current Description

Azure subscription operations - Commands for listing and managing Azure subscriptions accessible to your account.This tool is a hierarchical MCP command router. Sub commands are routed to MCP servers that require specific fields inside the "parameters" object. To invoke a command, set "command" and wrap its args in "parameters". Set "learn=true" to discover available sub commands.

Suggested Improvement

Azure subscription operations - Commands for listing and managing Azure subscriptions that serve as billing and administrative boundaries for Azure resources and services. Use this tool when you need to list available subscriptions, check subscription details and status, manage subscription settings, view billing information, or work with subscription-level configurations and policies. This tool provides visibility into the subscription scope of Azure resource hierarchy and helps with multi-subscription scenarios. Do not use this tool for resource group operations, individual resource management, billing account administration, or tenant-level Azure Active Directory operations - this tool focuses specifically on subscription-level information and management. This tool is a hierarchical MCP command router where sub-commands are routed to MCP servers that require specific fields inside the "parameters" object. To invoke a command, set "command" and wrap its arguments in "parameters". Set "learn=true" to discover available sub-commands for different subscription management and information operations. Note that this tool will only show subscriptions accessible to the authenticated user based on their Azure permissions and subscription access rights.

Acceptance Criteria

  • Update tool description to include clear usage guidance
  • Explain Azure subscription hierarchy and billing boundary context
  • Clarify when NOT to use this tool (vs resource groups, tenant operations)
  • Detail the specific subscription management operations available
  • Mention subscription scope and multi-subscription scenarios
  • Fix formatting issues
  • Achieve confidence score ≥0.5 in tool selection testing

Related: Tool description review for improved LLM selection accuracy

Metadata

Metadata

Assignees

Labels

bugSomething isn't workingserver-Azure.McpAzure.Mcp.Servertools-ARMARM Resource Management Group

Type

No type

Projects

Status

Done

Milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions