Skip to content

v0.2.0

Choose a tag to compare

View all tags
@matedev01 matedev01 released this 03 Jul 00:35
· 814 commits to main since this release
v0.2.0
4d37db6
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

Second release of vanguarstew — the SN74 repo-maintainer agent and its GitHub-history replay benchmark. Everything below landed since v0.1.0.

Scoring & judging

  • The pairwise judge now weighs the decision process (inferred maintainer philosophy + reasoning), not just trajectory match.
  • Robust judge parsing, tolerant of truncated/verbose model output (found via live verification against a real model).
  • Selectable reference baselines for the judge — a deterministic heuristic opponent alongside empty, via --baseline (thanks @real-venus).
  • Maintainer-philosophy inference now uses few-shot examples for steadier, evidence-based output (thanks @real-venus).

Benchmark & leakage

  • Leakage hardening: forward-reference scrubbing (issue/PR back-refs, GitHub links, SHAs — including release names) and recent-window + deterministic rotation for freeze-point selection.
  • GitHub issue/PR context now paginates back to the freeze time T, with a truncation flag.

Project & CI

  • Trustable contribution pipeline: a published review/scoring rubric (REVIEW.md), a PR-integrity check, CODEOWNERS routing, and a CI coverage floor.
  • Auto-label workflow (organizational area/type labels) and CI split into focused lint / validate / test jobs.

Thanks to first-time contributors @real-venus and @galuis116.

Contributors

galuis116 and real-venus
Assets 2
Loading