Skip to content

[Tool Description] Improve Marketplace tool description for better LLM selection #255

@alzimmermsft

Description

@alzimmermsft

Problem

The current Marketplace tool description lacks the detail and clarity needed for optimal LLM tool selection, resulting in an estimated confidence score of ~0.15 (well below target of ≥0.5).

Current Description Issues:

  • Extremely vague purpose ("managing and accessing")
  • Missing context about what Azure Marketplace contains
  • No usage guidance (when to use vs when not to use)
  • Poor parameter explanation
  • Missing operations detail (browsing, purchasing, etc.)
  • Formatting issues (missing space after period)
  • Too brief for a complex service

Current Description

Marketplace operations - Commands for managing and accessing Azure Marketplace products and offers.This tool is a hierarchical MCP command router. Sub commands are routed to MCP servers that require specific fields inside the "parameters" object. To invoke a command, set "command" and wrap its args in "parameters". Set "learn=true" to discover available sub commands.

Suggested Improvement

Marketplace operations - Commands for browsing, searching, and managing Azure Marketplace products including virtual machine images, SaaS applications, containers, and solution templates from Microsoft and third-party publishers. Use this tool when you need to search for marketplace offerings, view product details and pricing, browse available VM images, check software solutions, or explore deployment templates and applications available for Azure deployment. This tool helps discover and evaluate marketplace products for Azure infrastructure and application needs. Do not use this tool for purchasing/billing operations, managing existing deployed resources, or Azure resource management - this tool focuses on marketplace product discovery and information rather than resource deployment or management. This tool is a hierarchical MCP command router where sub-commands are routed to MCP servers that require specific fields inside the "parameters" object. To invoke a command, set "command" and wrap its arguments in "parameters". Set "learn=true" to discover available sub-commands for different marketplace browsing and product discovery operations. Note that this tool provides product information and may require appropriate Azure permissions to view certain marketplace offerings.

Acceptance Criteria

  • Update tool description to include clear usage guidance
  • Explain Azure Marketplace's product catalog context
  • Clarify when NOT to use this tool (vs resource management, billing)
  • Detail the specific marketplace discovery operations available
  • Fix formatting issues
  • Achieve confidence score ≥0.5 in tool selection testing

Related: Tool description review for improved LLM selection accuracy

Metadata

Metadata

Type

No type

Projects

Status

Done

Milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions