eval: prove content-addressed catalog admission - #39
Draft
schickling-assistant wants to merge 1 commit into
Draft
Conversation
agent-session-id: cdd15622-c01a-4731-bbfe-ab8cce0cad54 agent-tool: Codex CLI agent-tool-version: 0.145.0 agent-model: unknown agent-runtime-profile: /nix/store/ph8rlhdj25mg71v81jsfzy6dq4xpcs9m-coding-agent-runtime-profile/share/coding-agents/profile.json agent-skills-manifest: /nix/store/lsykz8x5481xrpbgk280xh3pypk1c5jy-agent-skills-corpus/share/agent-skills/manifest.json tooling-profile: dotfiles@3649b53
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Why
The Agent Spec catalog proposal needs portable product-conformance evidence,
not a green reference shim. This draft adds model-free cells that invoke the
real experimental st2 API from the companion prototype.
Tracks #37 and compoundingtech/st2#52.
What
Add the hierarchical
agent-spec-lifecycle-catalog-*family:prepare- exact-byte idempotent import without catalog visibility;publish-cas- explicit staging, replay, manager fencing, ABA rejection,and no root movement;
root-atomicity- stale-root CAS, invalid-join rejection, atomic multi-seatadmission, old/new-only reads, mixed-manager preservation, and corruption
fail-closed.
The cells use ordinary team-less folder evals and shell/typed JSON judges. No
runner path, model seat, paid judge, or embedded catalog implementation was
added.
The VRS records typed-resource admission and public crash-boundary injection as
future discriminators; this first family does not claim those unsupported
properties and does not update the accepted
AGENT-SPEC.mdpin.Exact prototype under test
16ee7eb953508801a4603edd056ab32f28986601Validation
Directly against that st2 binary:
5 PASS / 0 FAIL6 PASS / 0 FAIL8 PASS / 0 FAILFree corpus checks:
shell syntax, diff checks, and exact model-free harness exclusions pass.
The repository-wide harness-contract command still encounters the existing
synthetic Git identity policy rejection (
seed@localversus the assistantidentity); the new three-cell exclusion coverage is independently exact.
Merge boundary
Keep this PR draft and do not promote the cells to accepted evidence until the
st2 API is accepted and the repository intentionally updates its global st2
pin. The current draft is executable incubation evidence.
Posted on behalf of @schickling
agent_nameagent_session_idagent_toolagent_tool_versionagent_runtimeagent_modelruntime_profileskills_manifestworktreemachinetooling_profile