Skip to content

docs(evaluation): Connectors concept#728

Merged
khushalsonawat merged 5 commits into
docs/evaluation-revampfrom
docs/eval-connectors
Jul 10, 2026
Merged

docs(evaluation): Connectors concept#728
khushalsonawat merged 5 commits into
docs/evaluation-revampfrom
docs/eval-connectors

Conversation

@YashMohan23

@YashMohan23 YashMohan23 commented Jul 9, 2026

Copy link
Copy Markdown

The Connectors concept page (/docs/evaluation/concepts/connectors).

  • A connector is an external tool you attach to an eval so the evaluator can use it while it judges
  • Built-in tools (e.g. URL checker) plus custom MCP connectors, managed under the model
  • Agent-Evaluator only (LLM-as-Judge and Code Eval do not use connectors)
  • Includes an annotated screenshot of where connectors live

External tools you attach to an eval so an Agent Evaluator can use them while it
judges: built-in tools like the URL checker, plus custom MCP connectors, managed
under the model. Connectors are Agent-Evaluator only. Includes an annotated PNG
(white oval + vertical arrow per annotation-conventions.md) of where connectors live.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
@YashMohan23 YashMohan23 marked this pull request as ready for review July 9, 2026 11:10
Open directly at 'What a connector is' with no lead paragraph and shorten the
description. Keeps the annotated screenshot; no diagram (a flow read as forced).

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>

@khushalsonawat khushalsonawat left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This isn't a how-to guide. Don't show arrows and annotated images. You can keep the image to be used in a future guide. It needs a concept and a mental model. Hence, did not read the content

Add the tool-use mental model (response -> Agent Evaluator -> connector -> verdict)
and remove the annotated screenshot, which is how-to material and belongs in the
Configure connectors guide, not the concept.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
@khushalsonawat khushalsonawat merged commit 249cb90 into docs/evaluation-revamp Jul 10, 2026
@khushalsonawat khushalsonawat deleted the docs/eval-connectors branch July 10, 2026 09:20
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants