Skip to content

[AI Evaluation] Introduce IntentResolution, ToolCallAcuracy and TaskAdherence evaluators for agentic workflows #6350

@shyamnamboodiripad

Description

@shyamnamboodiripad

Corresponding evaluators are available in the Azure AI Python SDK. These evaluators need tool definitions and tool calls to be included as part of the evaluation prompts (in a JSON format). We should be able to leverage the existing abstractions in Microsoft.Extensions.AI.Abstractions such as AIFunction and FunctionCallContent for this.

Metadata

Metadata

Labels

area-ai-evalMicrosoft.Extensions.AI.Evaluation and related

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions