Skip to content

test(agents): add SEP-2640 Skills conformance harness - #1655

Draft
groupthinking wants to merge 2 commits into
mainfrom
codex/mcp-skills-conformance-1640
Draft

test(agents): add SEP-2640 Skills conformance harness#1655
groupthinking wants to merge 2 commits into
mainfrom
codex/mcp-skills-conformance-1640

Conversation

@groupthinking

Copy link
Copy Markdown
Owner

Summary

Activates the pre-authorized TEST trigger in #1640 after SEP-2640 was accepted and official MCP Inspector support merged.

This is a fixture-only host conformance harness for Agent Factory. It does not enable remote skills in production or load external skill content.

What it tests

  • extension and Resources capability negotiation
  • skills/list, skills/get, resources/read, and gated resources/directory/read request shapes
  • compound identity (host-assigned server identity, URI)
  • same-name collision receipts without silent substitution
  • complete manifest, digest, byte-size, path-containment, 512-file, and 16 MiB checks
  • non-skill:// URI support as permitted by the extension
  • exact SKILL.md frontmatter reconciliation
  • explicit content-bound approval and revocation on manifest drift
  • origin-bound resource reads and dynamic-manifest denial
  • separate explicit per-skill permission for execution tools
  • durable in-memory verification and denial receipt shapes for later adapter wiring

Sources

Verification

  • Python syntax compilation: passed
  • dependency-light manual discovery/approval/digest/traversal smoke: passed
  • local pytest: unavailable in the automation runtime; repository CI is authoritative

Safety boundary

Draft only. No runtime registration, remote server connection, skill loading, tool execution, deployment, billing action, or production mutation is included. A later runtime adapter must preserve explicit approval and origin binding.

Advances #1640.

@vercel

vercel Bot commented Sep 6, 2026

Copy link
Copy Markdown
Contributor

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated
v0-uvai Canceled Canceled v0 Sep 6, 2026 7:33am UTC

@coderabbitai

coderabbitai Bot commented Sep 6, 2026

Copy link
Copy Markdown
Contributor

Important

Draft PR not reviewed

Draft PRs are not automatically reviewed by default.

  • Trigger a manual review

To automatically review draft PRs, update your CodeRabbit configuration:

reviews:
  auto_review:
    drafts: true

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands.

@github-actions

github-actions Bot commented Sep 6, 2026

Copy link
Copy Markdown

🔍 PR Validation

⚠️ Large PR detected (674 lines changed)

@github-actions github-actions Bot added the python label Sep 6, 2026
@github-actions

github-actions Bot commented Sep 6, 2026

Copy link
Copy Markdown

Dependency Review

✅ No vulnerabilities or license issues or OpenSSF Scorecard issues found.

Snapshot Warnings

⚠️: No snapshots were found for the head SHA 8821ff0.
Ensure that dependencies are being submitted on PR branches and consider enabling retry-on-snapshot-warnings. See the documentation for more information and troubleshooting advice.

Scanned Files

None

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant