Skip to content

v5.1.0 — 7 Reference-Inspired Improvements

Choose a tag to compare

@raphaelchristi raphaelchristi released this 03 Apr 04:26
· 93 commits to main since this release

What's New

7 improvements from deep analysis of the 9 references in the README.

Tier 1 — High Impact

Full History Archive (Meta-Harness: 2x improvement with trace access)
New tools/archive.py saves ALL candidates (winners + losers) — diffs, proposals, scores — to evolution_archive/. Proposers can grep prior approaches for cross-iteration causal reasoning.

Pairwise Evaluation (LangSmith, Context Engineering)
read_results.py --pairwise "exp_a,exp_b" compares candidates head-to-head by per-example win count. Triggered when top 2 are within 5%. More reliable than independent scoring.

Archive Branching (DGM, AlphaEvolve)
New archive_branch lens lets proposers fork from non-winning ancestors. Prevents premature convergence by preserving diverse stepping stones.

Tier 2 — Medium Impact

Wave-Based Proposers (Self-Organizing Agents: +14%)
Proposers split into 2 waves: critical/high lenses run first, medium/open see wave 1 results before starting. Research shows +14% quality when agents observe prior outputs.

Failure-to-Regression-Gate (Traces Loop)
regression_tracker.py --auto-guard-failures adds currently-failing examples as "known hard" guards. Every fix becomes a permanent regression test.

Few-Shot Evaluator (LangSmith)
Evaluator agent loads human corrections from LangSmith as calibration examples. Scoring accuracy improves over time without code changes.

MAP-Elites Diversity Grid (AlphaEvolve)
read_results.py comparison now includes a diversity grid — best candidate per approach category. Preserves diversity even when one approach dominates in score.

Tests

12/12 passing (added test_archive).

Install

npx harness-evolver@latest

🤖 Generated with Claude Code