Skip to content

[CONSOLIDATED] evaluate_azure_ai_foundry_agents tool was not activated by test prompt #1068

@Menghua1

Description

@Menghua1

Description:
In consolidated mode, entering Evaluate the full query and response I got from my agent for task_adherence prompt did not trigger the MCP tool evaluate_azure_ai_foundry_agents, as shown below:
Image
Image

Steps to Reproduce:

  1. Start mcp server in consolidated mode.
  2. Open GitHub Copilot in VS Code and switch to Agent mode.
  3. Click Refresh on the tools list, and select the Built-in, Extension: Github Copilot for Azure, github MCP server and MCP Server: Azure MCP.
  4. Enter test prompts Evaluate the full query and response I got from my agent for task_adherence.

Environment:

  • OS: Windows.
  • Vscode Version: 1.105.1
  • GitHub Copilot Chat Version: 0.32.4
  • Large Language Model: Claude Sonnet 4.5
  • Virtual Tool: On
  • Azure MCP Server: 1.0.0

Expected Behavior:
These prompts can successfully trigger the expected evaluate_azure_ai_foundry_agents tool.

@joshfree for notification

Metadata

Metadata

Assignees

Labels

server-Azure.McpAzure.Mcp.Servertools-CoreAZMCP Core functionality that all other tools build on top of

Type

No type

Projects

Status

Not Started

Milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions