Skip to content

v1.0.0 — First release: Meta-Skill + SES, WP-13, final remediation

Choose a tag to compare

@nxl801 nxl801 released this 23 Jul 07:53

v1.0.0 — First release

The first tagged release of Skill Optimizer · Meta-Skill with the
Skill Evolution System (SES) system layer. This bundles the full
Champion/Challenger optimization pipeline, the WP-13 Darwin/SkillLens/SkillOpt
alignment work, and the Round 12 final remediation that closed every
previously-deferred reliability gap.

What this release is

A Meta-Skill (a skill that optimizes other skills) that drives an
auditable, fail-closed, crash-recoverable optimization loop against a real
Human Reference Usage Set:

test → evaluate → diagnose → patch → retest → regression → validation → certified release

Headline features

Meta-Skill (the optimization protocol)

  • 🔁 Closed loop with 3-layer evaluation: Hard Assertions (veto) → Quality
    Rubric (scored) → Pairwise Blind (head-to-head).
  • 🛡️ Anti-overfitting: hardcoding detection, 70/30 Optimization/Validation
    split, gold-free diagnosis.
  • 🌐 Cross-agent: open SKILL.md + standard-library Python; binds to no SDK/MCP.
  • Regression suite: 121 passed, 70 subtests (standard library, offline).

Skill Evolution System (the system layer) — ses package

  • Explicit, fail-closed state machine (26 states, 105 transitions) with a
    tamper-evident hash-chained audit log and content-addressed evidence.
  • Certifying sandbox isolation, independent Hidden-Holdout trust domain,
    and a GitHub-SHA-pinned promotion gate.
  • Real cross-process crash recovery — a crashed process resumes from a
    verified checkpoint without rerunning the baseline, recreating candidates,
    or duplicating bridge steps.

WP-13 alignment (Darwin / SkillLens / SkillOpt)

  • T1 deterministic skill-quality checks (failure-mechanism, actionable-
    specificity, high-risk-action blacklist).
  • T2 configurable, auditable early stop ("stop when gains vanish").
  • T3 independent variant-review judge pool — ≥2 certified Reviewers per
    round with conservative aggregation and cross-round session isolation.
  • T4 dry-run reliability gate — blocks a round whose Runner dry-run
    ratio exceeds the frozen threshold, before the Holdout is consumed.
  • T5 destructive-command / rollback-safety guard.
  • T6 SkillOpt alignment ADR (research-only; do-not-adopt conclusion).

Round 12 final remediation (all gaps closed)

  • Global-best candidate selection (KEEP/REVERT per round; finalization restores
    the selected attempt, not the final attempt).
  • finalize_failed terminal semantics; verified checkpoint-hash recovery;
    real cross-process recovery; accurate per-attempt candidate status.

Verification

Check Result
Full SES suite 847 passed, 5 skipped
Meta-Skill native regression 121 passed, 70 subtests
ruff / mypy / compileall All passed
scripts/acceptance.sh ALL OFFLINE ACCEPTANCE CHECKS PASSED
git whitespace (diff --check) clean
External production certification NOT EXECUTED (no Docker / GitHub Enterprise / production-model credentials)

Full evidence: docs/skill-evolution-system/wp-13-final-remediation-acceptance-report.md.

Getting started

git clone git@github.com:nxl801/skill-optimizer.git
cd skill-optimizer
python3 -m venv .venv-ses && .venv-ses/bin/pip install 'pydantic>=2' fastapi 'uvicorn[standard]' httpx pytest ruff mypy
make ci          # tests + lint + preflight
make demo        # offline E2E demo

The skill lives at .agents/skills/optimizing-skills-from-human-usage/.
Review reports/final-report.md and ship only optimized-skill/.

Known limitations

  • External certification is NOT EXECUTED. Docker image build/digest
    verification, GitHub Enterprise protected-branch workflow, and production
    RuntimeBroker dispatch are environmental steps not run in this release.
  • Output is text-first. The contract evaluates one UTF-8 text deliverable
    per execution; multi-file/binary artifacts need a deterministic textual
    comparison artifact.
  • Host isolation is external to the skill format; this package specifies
    and validates the protocol. A host that cannot enforce role boundaries must
    emit SAFETY_BLOCKED, not a lower-integrity single-agent run.

Tag: v1.0.0 · Commit: 777e5a0 · Branch: main