Solidify RLE as a harness x model benchmark: scoring 1.2, swappable harness plugins, zero-Felix core, RimAPI MCP server - #52

Merged

jkbennitt merged 8 commits into

cursor/harness-benchmark-solidify-c7cd

Sep 4, 2026

Commits on Sep 4, 2026

scoring 1.2: replace coordination/communication_efficiency with plan_coherence (#51)

cursoragent
and
jkbennitt
committed
89c5145
harness layer: BaseHarness/StepResult protocol, FelixHarness + BaselineHarness, entry-point registry

cursoragent
and
jkbennitt
committed
05108e4
CLI: --harness / --harness list / --harness-opt via the plugin registry; rle.testing for plugin authors

cursoragent
and
jkbennitt
committed
f1388da
zero-Felix core: felix-agent-sdk becomes the optional 'felix' extra

cursoragent
and
jkbennitt
committed
c916cf3
rle.mcp: RimAPI as an MCP tool server with a per-tick write ledger

cursoragent
and
jkbennitt
committed
d285b7d
HeadlessCliHarness scaffold + ScriptedMcpHarness for external coding-agent harnesses

cursoragent
and
jkbennitt
committed
9ad3dc7
registry: smoke variants run without the external tool; ship py.typed

cursoragent
and
jkbennitt
committed
6aac546
hygiene: harness x model leaderboard, quarantine-aware aggregation, ADR-004, docs

cursoragent
and
jkbennitt
committed
ffebcc5