Adds ToolArea and ToolName to single mode telemetry.#952
Merged
vcolin7 merged 5 commits intomicrosoft:mainfrom Oct 24, 2025
Merged
Adds ToolArea and ToolName to single mode telemetry.#952vcolin7 merged 5 commits intomicrosoft:mainfrom
vcolin7 merged 5 commits intomicrosoft:mainfrom
Conversation
conniey
requested review from
KarishmaGhiya,
Copilot,
g2vinay,
hallipr,
jongio,
sandeep-sen and
tmeschter
Contributor
There was a problem hiding this comment.
Pull Request Overview
This PR enhances telemetry in single mode by capturing tool area and tool name information when tools are invoked. The changes ensure that telemetry activities are tagged with ToolArea in learn mode and both ToolArea and ToolName in command execution mode.
Key Changes:
- Added telemetry tags for tool area and tool name in single proxy tool loader
- Improved error message clarity in registry tool loader
- Added XML documentation for existing private methods
Reviewed Changes
Copilot reviewed 2 out of 2 changed files in this pull request and generated 1 comment.
| File | Description |
|---|---|
| SingleProxyToolLoader.cs | Added telemetry tags for ToolArea and ToolName, reorganized Activity.Current calls for better tag assignment, and added XML documentation to private methods |
| RegistryToolLoader.cs | Enhanced error message to be more specific when a tool is not found |
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
alzimmermsft
approved these changes
Oct 24, 2025
github-project-automation
Bot
moved this from Untriaged
to In Progress
in Azure MCP Server
vcolin7
reviewed
Oct 24, 2025
vcolin7
approved these changes
Oct 24, 2025
vcolin7
pushed a commit
that referenced
this pull request
Oct 25, 2025
* Make registry error message more descriptive. * Set ToolArea and ToolName in single proxy mode. * Update CHANGELOG. * Apply suggestion from @Copilot Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> * Update CHANGELOG --------- Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
vcolin7
added a commit
that referenced
this pull request
Oct 25, 2025
* Add instructions on when to not use azd init (#942) * Add instrunctions on when to not use azd init * Update CHANGELOG * Address review feedback * Refactored ToolDescriptionEvaluator code and added more options (#899) * Renamed --validate to --test-single-tool * Refactored Program.cs to remove duplicated tool loading logic * Updated error message logic * Refactored error handling and updated exceptions thrown * Added new --server and --server-exe args and enhanced error handling for missing files and invalid arguments * Updated docs * Fixed syntax errors * Removed azmcp_ prefix from e2eTestPrompts.md * Fixed more issues * Ran TDE * Fixed parameter validation * Updated more usre-facing messages * Updated docs and --help command info * Small doc update * Removed file added by accident. * Renamed header in README * Applied some PR feedback * Applied more PR feedback * Updated logs * Fixed formatting * Merge release branch after `0.9.8` release (#948) * Updated CHANGELOGs for 0.9.8 release * Increment version after release (#946) * Increment package version after release * Add release branch to pull request pipeline --------- Co-authored-by: Wes Haggard <weshaggard@users.noreply.github.com> --------- Co-authored-by: Azure SDK Bot <53356347+azure-sdk@users.noreply.github.com> Co-authored-by: Wes Haggard <weshaggard@users.noreply.github.com> * Adds ToolArea and ToolName to single mode telemetry. (#952) * Make registry error message more descriptive. * Set ToolArea and ToolName in single proxy mode. * Update CHANGELOG. * Apply suggestion from @Copilot Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> * Update CHANGELOG --------- Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> * Updated CHANGELOGs for 0.9.9 release --------- Co-authored-by: Fan Yang <52458914+fanyang-mono@users.noreply.github.com> Co-authored-by: Azure SDK Bot <53356347+azure-sdk@users.noreply.github.com> Co-authored-by: Wes Haggard <weshaggard@users.noreply.github.com> Co-authored-by: Connie Yau <conniey@microsoft.com> Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
vcolin7
added a commit
that referenced
this pull request
Oct 28, 2025
* Add instructions on when to not use azd init (#942) * Add instrunctions on when to not use azd init * Update CHANGELOG * Address review feedback * Refactored ToolDescriptionEvaluator code and added more options (#899) * Renamed --validate to --test-single-tool * Refactored Program.cs to remove duplicated tool loading logic * Updated error message logic * Refactored error handling and updated exceptions thrown * Added new --server and --server-exe args and enhanced error handling for missing files and invalid arguments * Updated docs * Fixed syntax errors * Removed azmcp_ prefix from e2eTestPrompts.md * Fixed more issues * Ran TDE * Fixed parameter validation * Updated more usre-facing messages * Updated docs and --help command info * Small doc update * Removed file added by accident. * Renamed header in README * Applied some PR feedback * Applied more PR feedback * Updated logs * Fixed formatting * Merge release branch after `0.9.8` release (#948) * Updated CHANGELOGs for 0.9.8 release * Increment version after release (#946) * Increment package version after release * Add release branch to pull request pipeline --------- Co-authored-by: Wes Haggard <weshaggard@users.noreply.github.com> --------- Co-authored-by: Azure SDK Bot <53356347+azure-sdk@users.noreply.github.com> Co-authored-by: Wes Haggard <weshaggard@users.noreply.github.com> * Adds ToolArea and ToolName to single mode telemetry. (#952) * Make registry error message more descriptive. * Set ToolArea and ToolName in single proxy mode. * Update CHANGELOG. * Apply suggestion from @Copilot Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> * Update CHANGELOG --------- Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> * Adding CELA approved warnings in README (#955) * Adding CELA approved warnings * Update servers/Azure.Mcp.Server/README.md Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> * removing localization in docs link --------- Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> * Updating ToC of Azure MCP readme (#968) * Adding CELA approved warnings * Update servers/Azure.Mcp.Server/README.md Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> * removing localization in docs link * Updating ToC on Readme --------- Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> * Fix broken links in README (#979) * Add installation GIF for Azure MCP Server extension in README (2nd attempt) (#978) * Add installation GIF for Azure MCP Server extension in README * Update servers/Azure.Mcp.Server/README.md Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> * Fix typo in remove-section markers in Azure.Mcp.Server README --------- Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> * Re-enable smoke tests (#981) Enable smoke tests * Prepare `1.0.0` release * Fix README image reference and rename the gif (#983) Add the install_azure_mcp_server_extension.gif asset and update README to reference the new filename (use underscores instead of dashes). --------- Co-authored-by: Fan Yang <52458914+fanyang-mono@users.noreply.github.com> Co-authored-by: Azure SDK Bot <53356347+azure-sdk@users.noreply.github.com> Co-authored-by: Wes Haggard <weshaggard@users.noreply.github.com> Co-authored-by: Connie Yau <conniey@microsoft.com> Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> Co-authored-by: Sandeep Sen <sandeepsen@microsoft.com> Co-authored-by: Vinay Gera <vigera@microsoft.com> Co-authored-by: Chris Harris <charris@microsoft.com>
weshaggard
added a commit
that referenced
this pull request
Oct 29, 2025
* Updated CHANGELOGs for 0.9.8 release * Increment version after release (#946) * Increment package version after release * Add release branch to pull request pipeline --------- Co-authored-by: Wes Haggard <weshaggard@users.noreply.github.com> * Prepare version `0.9.9` release (#956) * Add instructions on when to not use azd init (#942) * Add instrunctions on when to not use azd init * Update CHANGELOG * Address review feedback * Refactored ToolDescriptionEvaluator code and added more options (#899) * Renamed --validate to --test-single-tool * Refactored Program.cs to remove duplicated tool loading logic * Updated error message logic * Refactored error handling and updated exceptions thrown * Added new --server and --server-exe args and enhanced error handling for missing files and invalid arguments * Updated docs * Fixed syntax errors * Removed azmcp_ prefix from e2eTestPrompts.md * Fixed more issues * Ran TDE * Fixed parameter validation * Updated more usre-facing messages * Updated docs and --help command info * Small doc update * Removed file added by accident. * Renamed header in README * Applied some PR feedback * Applied more PR feedback * Updated logs * Fixed formatting * Merge release branch after `0.9.8` release (#948) * Updated CHANGELOGs for 0.9.8 release * Increment version after release (#946) * Increment package version after release * Add release branch to pull request pipeline --------- Co-authored-by: Wes Haggard <weshaggard@users.noreply.github.com> --------- Co-authored-by: Azure SDK Bot <53356347+azure-sdk@users.noreply.github.com> Co-authored-by: Wes Haggard <weshaggard@users.noreply.github.com> * Adds ToolArea and ToolName to single mode telemetry. (#952) * Make registry error message more descriptive. * Set ToolArea and ToolName in single proxy mode. * Update CHANGELOG. * Apply suggestion from @Copilot Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> * Update CHANGELOG --------- Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> * Updated CHANGELOGs for 0.9.9 release --------- Co-authored-by: Fan Yang <52458914+fanyang-mono@users.noreply.github.com> Co-authored-by: Azure SDK Bot <53356347+azure-sdk@users.noreply.github.com> Co-authored-by: Wes Haggard <weshaggard@users.noreply.github.com> Co-authored-by: Connie Yau <conniey@microsoft.com> Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> * Increment version after release (#957) Increment package version after release * update README (#977) * Prepare `1.0.0` release (#984) * Add instructions on when to not use azd init (#942) * Add instrunctions on when to not use azd init * Update CHANGELOG * Address review feedback * Refactored ToolDescriptionEvaluator code and added more options (#899) * Renamed --validate to --test-single-tool * Refactored Program.cs to remove duplicated tool loading logic * Updated error message logic * Refactored error handling and updated exceptions thrown * Added new --server and --server-exe args and enhanced error handling for missing files and invalid arguments * Updated docs * Fixed syntax errors * Removed azmcp_ prefix from e2eTestPrompts.md * Fixed more issues * Ran TDE * Fixed parameter validation * Updated more usre-facing messages * Updated docs and --help command info * Small doc update * Removed file added by accident. * Renamed header in README * Applied some PR feedback * Applied more PR feedback * Updated logs * Fixed formatting * Merge release branch after `0.9.8` release (#948) * Updated CHANGELOGs for 0.9.8 release * Increment version after release (#946) * Increment package version after release * Add release branch to pull request pipeline --------- Co-authored-by: Wes Haggard <weshaggard@users.noreply.github.com> --------- Co-authored-by: Azure SDK Bot <53356347+azure-sdk@users.noreply.github.com> Co-authored-by: Wes Haggard <weshaggard@users.noreply.github.com> * Adds ToolArea and ToolName to single mode telemetry. (#952) * Make registry error message more descriptive. * Set ToolArea and ToolName in single proxy mode. * Update CHANGELOG. * Apply suggestion from @Copilot Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> * Update CHANGELOG --------- Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> * Adding CELA approved warnings in README (#955) * Adding CELA approved warnings * Update servers/Azure.Mcp.Server/README.md Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> * removing localization in docs link --------- Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> * Updating ToC of Azure MCP readme (#968) * Adding CELA approved warnings * Update servers/Azure.Mcp.Server/README.md Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> * removing localization in docs link * Updating ToC on Readme --------- Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> * Fix broken links in README (#979) * Add installation GIF for Azure MCP Server extension in README (2nd attempt) (#978) * Add installation GIF for Azure MCP Server extension in README * Update servers/Azure.Mcp.Server/README.md Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> * Fix typo in remove-section markers in Azure.Mcp.Server README --------- Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> * Re-enable smoke tests (#981) Enable smoke tests * Prepare `1.0.0` release * Fix README image reference and rename the gif (#983) Add the install_azure_mcp_server_extension.gif asset and update README to reference the new filename (use underscores instead of dashes). --------- Co-authored-by: Fan Yang <52458914+fanyang-mono@users.noreply.github.com> Co-authored-by: Azure SDK Bot <53356347+azure-sdk@users.noreply.github.com> Co-authored-by: Wes Haggard <weshaggard@users.noreply.github.com> Co-authored-by: Connie Yau <conniey@microsoft.com> Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> Co-authored-by: Sandeep Sen <sandeepsen@microsoft.com> Co-authored-by: Vinay Gera <vigera@microsoft.com> Co-authored-by: Chris Harris <charris@microsoft.com> * Fix NPM and NuGet smoke tests and updated VS Code plugin to NOT be a preview (#986) * Fix NPM smoke test * Fixed where NPM packages are looked up * Changed the VS Code extension to not be marked as a preview * Increment version after release (#988) Increment package version after release --------- Co-authored-by: Azure SDK Bot <53356347+azure-sdk@users.noreply.github.com> Co-authored-by: Wes Haggard <weshaggard@users.noreply.github.com> Co-authored-by: Fan Yang <52458914+fanyang-mono@users.noreply.github.com> Co-authored-by: Connie Yau <conniey@microsoft.com> Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> Co-authored-by: Vinay Gera <vigera@microsoft.com> Co-authored-by: Sandeep Sen <sandeepsen@microsoft.com> Co-authored-by: Chris Harris <charris@microsoft.com>
colbytimm
pushed a commit
to colbytimm/microsoft-mcp
that referenced
this pull request
Dec 8, 2025
* Make registry error message more descriptive. * Set ToolArea and ToolName in single proxy mode. * Update CHANGELOG. * Apply suggestion from @Copilot Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> * Update CHANGELOG --------- Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
colbytimm
pushed a commit
to colbytimm/microsoft-mcp
that referenced
this pull request
Dec 8, 2025
* Updated CHANGELOGs for 0.9.8 release * Increment version after release (microsoft#946) * Increment package version after release * Add release branch to pull request pipeline --------- Co-authored-by: Wes Haggard <weshaggard@users.noreply.github.com> * Prepare version `0.9.9` release (microsoft#956) * Add instructions on when to not use azd init (microsoft#942) * Add instrunctions on when to not use azd init * Update CHANGELOG * Address review feedback * Refactored ToolDescriptionEvaluator code and added more options (microsoft#899) * Renamed --validate to --test-single-tool * Refactored Program.cs to remove duplicated tool loading logic * Updated error message logic * Refactored error handling and updated exceptions thrown * Added new --server and --server-exe args and enhanced error handling for missing files and invalid arguments * Updated docs * Fixed syntax errors * Removed azmcp_ prefix from e2eTestPrompts.md * Fixed more issues * Ran TDE * Fixed parameter validation * Updated more usre-facing messages * Updated docs and --help command info * Small doc update * Removed file added by accident. * Renamed header in README * Applied some PR feedback * Applied more PR feedback * Updated logs * Fixed formatting * Merge release branch after `0.9.8` release (microsoft#948) * Updated CHANGELOGs for 0.9.8 release * Increment version after release (microsoft#946) * Increment package version after release * Add release branch to pull request pipeline --------- Co-authored-by: Wes Haggard <weshaggard@users.noreply.github.com> --------- Co-authored-by: Azure SDK Bot <53356347+azure-sdk@users.noreply.github.com> Co-authored-by: Wes Haggard <weshaggard@users.noreply.github.com> * Adds ToolArea and ToolName to single mode telemetry. (microsoft#952) * Make registry error message more descriptive. * Set ToolArea and ToolName in single proxy mode. * Update CHANGELOG. * Apply suggestion from @Copilot Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> * Update CHANGELOG --------- Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> * Updated CHANGELOGs for 0.9.9 release --------- Co-authored-by: Fan Yang <52458914+fanyang-mono@users.noreply.github.com> Co-authored-by: Azure SDK Bot <53356347+azure-sdk@users.noreply.github.com> Co-authored-by: Wes Haggard <weshaggard@users.noreply.github.com> Co-authored-by: Connie Yau <conniey@microsoft.com> Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> * Increment version after release (microsoft#957) Increment package version after release * update README (microsoft#977) * Prepare `1.0.0` release (microsoft#984) * Add instructions on when to not use azd init (microsoft#942) * Add instrunctions on when to not use azd init * Update CHANGELOG * Address review feedback * Refactored ToolDescriptionEvaluator code and added more options (microsoft#899) * Renamed --validate to --test-single-tool * Refactored Program.cs to remove duplicated tool loading logic * Updated error message logic * Refactored error handling and updated exceptions thrown * Added new --server and --server-exe args and enhanced error handling for missing files and invalid arguments * Updated docs * Fixed syntax errors * Removed azmcp_ prefix from e2eTestPrompts.md * Fixed more issues * Ran TDE * Fixed parameter validation * Updated more usre-facing messages * Updated docs and --help command info * Small doc update * Removed file added by accident. * Renamed header in README * Applied some PR feedback * Applied more PR feedback * Updated logs * Fixed formatting * Merge release branch after `0.9.8` release (microsoft#948) * Updated CHANGELOGs for 0.9.8 release * Increment version after release (microsoft#946) * Increment package version after release * Add release branch to pull request pipeline --------- Co-authored-by: Wes Haggard <weshaggard@users.noreply.github.com> --------- Co-authored-by: Azure SDK Bot <53356347+azure-sdk@users.noreply.github.com> Co-authored-by: Wes Haggard <weshaggard@users.noreply.github.com> * Adds ToolArea and ToolName to single mode telemetry. (microsoft#952) * Make registry error message more descriptive. * Set ToolArea and ToolName in single proxy mode. * Update CHANGELOG. * Apply suggestion from @Copilot Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> * Update CHANGELOG --------- Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> * Adding CELA approved warnings in README (microsoft#955) * Adding CELA approved warnings * Update servers/Azure.Mcp.Server/README.md Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> * removing localization in docs link --------- Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> * Updating ToC of Azure MCP readme (microsoft#968) * Adding CELA approved warnings * Update servers/Azure.Mcp.Server/README.md Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> * removing localization in docs link * Updating ToC on Readme --------- Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> * Fix broken links in README (microsoft#979) * Add installation GIF for Azure MCP Server extension in README (2nd attempt) (microsoft#978) * Add installation GIF for Azure MCP Server extension in README * Update servers/Azure.Mcp.Server/README.md Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> * Fix typo in remove-section markers in Azure.Mcp.Server README --------- Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> * Re-enable smoke tests (microsoft#981) Enable smoke tests * Prepare `1.0.0` release * Fix README image reference and rename the gif (microsoft#983) Add the install_azure_mcp_server_extension.gif asset and update README to reference the new filename (use underscores instead of dashes). --------- Co-authored-by: Fan Yang <52458914+fanyang-mono@users.noreply.github.com> Co-authored-by: Azure SDK Bot <53356347+azure-sdk@users.noreply.github.com> Co-authored-by: Wes Haggard <weshaggard@users.noreply.github.com> Co-authored-by: Connie Yau <conniey@microsoft.com> Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> Co-authored-by: Sandeep Sen <sandeepsen@microsoft.com> Co-authored-by: Vinay Gera <vigera@microsoft.com> Co-authored-by: Chris Harris <charris@microsoft.com> * Fix NPM and NuGet smoke tests and updated VS Code plugin to NOT be a preview (microsoft#986) * Fix NPM smoke test * Fixed where NPM packages are looked up * Changed the VS Code extension to not be marked as a preview * Increment version after release (microsoft#988) Increment package version after release --------- Co-authored-by: Azure SDK Bot <53356347+azure-sdk@users.noreply.github.com> Co-authored-by: Wes Haggard <weshaggard@users.noreply.github.com> Co-authored-by: Fan Yang <52458914+fanyang-mono@users.noreply.github.com> Co-authored-by: Connie Yau <conniey@microsoft.com> Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> Co-authored-by: Vinay Gera <vigera@microsoft.com> Co-authored-by: Sandeep Sen <sandeepsen@microsoft.com> Co-authored-by: Chris Harris <charris@microsoft.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
What does this PR do?
When running in single mode, try to set the "ToolArea" and "ToolName" if provided by the LLM.
GitHub issue number?
https://github.com/microsoft/mcp-pr/issues/130
Pre-merge Checklist
servers/Azure.Mcp.Server/CHANGELOG.mdand/orservers/Fabric.Mcp.Server/CHANGELOG.mdfor product changes (features, bug fixes, UI/UX, updated dependencies)servers/Azure.Mcp.Server/README.mdand/orservers/Fabric.Mcp.Server/README.mddocumentationeng/scripts/Process-PackageReadMe.ps1. See Package README/servers/Azure.Mcp.Server/docs/azmcp-commands.mdand/or/docs/fabric-commands.md.\eng\scripts\Update-AzCommandsMetadata.ps1to update tool metadata in azmcp-commands.md (required for CI)ToolDescriptionEvaluatorand obtained a score of0.4or more and a top 3 ranking for all related test prompts/servers/Azure.Mcp.Server/docs/e2eTestPrompts.mdcrypto mining, spam, data exfiltration, etc.)/azp run mcp - pullrequest - liveto run Live Test Pipeline