Skip to content

v0.7.2 — evals add-case skill docs

Choose a tag to compare

View all tags
@cliftonc cliftonc released this 30 Jun 04:44
· 758 commits to main since this release
v0.7.2
This tag was signed with the committer’s verified signature.
cliftonc Clifton Cunningham
SSH Key Fingerprint: wuvZ2x+0ixMuI6QPlzVQ0TasBcc1KDJs2Gtrb5j5SUs
Verified
Learn about vigilant mode.
0b49adf
This commit was signed with the committer’s verified signature.
cliftonc Clifton Cunningham
SSH Key Fingerprint: wuvZ2x+0ixMuI6QPlzVQ0TasBcc1KDJs2Gtrb5j5SUs
Verified
Learn about vigilant mode.

Docs

  • lastlight-evals skill → v1.2.0: documents add-case. Adds guidance for the lastlight-evals add-case --pr/--issue subcommand — author a code-fix eval case from a real GitHub PR (git-source: base/head commits, held-out test_patch, auto-detected FAIL_TO_PASS/PASS_TO_PASS) or a triage case from an issue (problem statement, applied labels, reviewer comments). Includes the new git-source case flavor (test_cmd/setup_cmd/head_commit) in instance-schema.md and a new authoring-from-pr.md how-to. (aa88f5d)

These ship in the npm package + via lastlight skills install, so lastlight-evals consumers pick them up on update.

Full changelog: v0.7.1...v0.7.2

Assets 2
Loading