Skip to content

v1.0.1

Choose a tag to compare

@kenjudy kenjudy released this 17 Jul 18:05
a60b7e2

Internal eval-harness and CI reliability improvements; no user-facing prompt changes.

Install via Claude UI

  1. Download pdca-framework.skill below
  2. Go to claude.ai → Customize → Skills → Add Skill
  3. Upload the file and toggle it on

Commits in this release

  • Merge pull request #15 from kenjudy/14-refine-eval-process-to-establish-a-reasonable-baseline
  • Establish eval baseline: all 15 scenarios passing with majority-vote retry
  • Remove Status: must_contain from 3-todos-remaining scenario
  • Refine STOP CONDITION: list search targets, do not fabricate findings
  • Add STOP CONDITION guard against hallucinated codebase searches
  • Constrain 1a output: no library recommendations without codebase evidence
  • Fix rubric_1a: score vague-input clarifying questions as 1.0
  • Remove called_shot_required from 2-first-step; GEval covers it
  • Add skip_geval flag and fix 2-first-step must_not_contain
  • Strengthen rubric_2 Process Police exception to be evaluated first
  • Simulate post-approval state in Phase 2 eval scenarios
  • Fix run-evals.sh to respect test path arguments
  • Make run-evals.sh executable
  • Skip test_evals.py collection in CI to fix ModuleNotFoundError
  • Fix Phase 2 eval scenarios with missing session context
  • Upgrade astral-sh/setup-uv to v7 for Node.js 24 compatibility
  • Upgrade astral-sh/setup-uv to v6 for Node.js 24 compatibility
  • Remove paraphraseable must_contain checks from eval scenarios
  • Fix syntax error in run eval shell script
  • Add rich file-based output to eval harness
  • Update BUILD.md release instructions to reflect automated workflow
  • Add release Action and direct download link in README

See the README for full documentation.