Repository navigation
plan-mode 0.6.7
edit_batchjoins the default lean profile (#26, #30). After approval, the agent edits each file in one call
where the tool allows it, and sends edits to different files, including the tests, in the same response. Setlevers
without it to opt out.- Measured in EB-2. It was pre-registered and frozen before the runs, and a blind adjudicator applied the bars.
0.6.6 lean with and withoutedit_batchran on T8 × 8 and PARITY-4's N1 and L2 × 4 each per arm, on Hermes 0.21.6
hermes servewith gpt-6.1-sol:- verified: 16 of 16 in both arms;
- T8 passing tests per run: 27.5 vs 26.375 (#26's guard is ≥ 0.85×);
- execution model calls per run: 7.9 vs 11.8 (0.67×, 95% CI 0.56–0.81);
- execution cost-weighted tokens: 0.94× (95% CI 0.75–1.18).
- A first run, EB-1, ended undecided on calls and cost. A Hermes background-review call in one run broke the call
count; its results and T8 bars held. EB-2 is a fresh replication that counts only the main agent loop. - R066 nominated this lever. It measured 0.6.6 against Codex plan mode on the same day (exploratory):
- both verified 12 of 12;
- blind judges preferred Plan Mode's plans in 11 and 12 of 12;
- cost-weighted tokens were 1.08–1.24× Codex's on W1 and A1, and 1.9–2.5× on N1 and L2.
- Measured in EB-2. It was pre-registered and frozen before the runs, and a blind adjudicator applied the bars.
- Report skill: a yes to the secrets question alone does not approve publishing; only an explicit yes to publishing,
given after the user has seen the text, does (#65, from the plugin community kit).
Install or update: hermes plugins install 100yenadmin/hermes-plan-mode --ref v0.6.7.