Skip to content

v0.1.1 — patch: model ID + demo path + factors README + SQS-1 honesty

Choose a tag to compare

@hoainho hoainho released this 29 May 08:11
· 57 commits to main since this release

Patch release bundling four follow-up commits since v0.1.0.

Fixes

  • spawn.sh: default model ID changed to anthropic/claude-3-5-haiku-latest. v0.1.0's claude-haiku-3-5 was rejected by opencode 1.15.10 with "Model not found." Every real run now resolves. (commit 144c8e1)
  • tests/regression_inject.sh: demo skill path resolves from multiple candidate roots, so npm test works after npm install -g (not just inside a repo clone). (commit dffdc99)

Documentation

  • README: new sections — "What this harness scores" (5 check kinds + 4 attribution fields), "The review workflow" (Mermaid flowcharts for pre-push + sync-publish gates), "How to verify the harness is actually running these factors." (commit 2e8de78)
  • standards/skill-quality-v1.md: SQS-1 re-framed as draft heuristic with honest 13🟢 / 7🟡 / 10🔴 tier split per check. (commit 8c6412c)

No API changes

run, baseline, accept, status, promote, trend all unchanged. Same case YAML schema. Same 6-field FAIL output. Same exit codes (0 / 12 / 13). Pure patch release.

Upgrade

npm install -g @nano-step/eval-harness@latest

See CHANGELOG.md for full notes.