Skip to content

docs: sharpen WebMCP eval guidance - #10

Merged
TueJon merged 1 commit into
mainfrom
feature/webmcpify-state-of-art-20260829
Aug 29, 2026
Merged

docs: sharpen WebMCP eval guidance#10
TueJon merged 1 commit into
mainfrom
feature/webmcpify-state-of-art-20260829

Conversation

@TueJon

@TueJon TueJon commented Aug 29, 2026

Copy link
Copy Markdown
Owner

Summary

  • separate deterministic WebMCP smoke checks from probabilistic agent evals
  • add direct, ambiguous, and multi-tool journey dataset guidance
  • diagnose failures from webmcp-evals 0.0.4 trajectories when available
  • date Puppeteer's Chrome 151+ WebMCP harness requirement

Evidence

Verification

  • npm run check (19/19 tests)

@TueJon TueJon added documentation Improvements or additions to documentation webmcp WebMCP agent surface labels Aug 29, 2026
@TueJon TueJon self-assigned this Aug 29, 2026

@TueJon TueJon left a comment

Copy link
Copy Markdown
Owner Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

No blocking or non-blocking findings.
The new eval and Puppeteer guidance matches the upstream v0.0.4/Chrome 151 contracts, and the exact-head repository checks pass (19 tests).

@TueJon
TueJon merged commit 4701929 into main Aug 29, 2026
2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

documentation Improvements or additions to documentation webmcp WebMCP agent surface

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant