Skip to content

jev-browser-wingman 0.3.2 (superseded by 0.3.3)

Choose a tag to compare

@coderexpert123 coderexpert123 released this 08 Oct 11:59
· 4 commits to main since this release

Superseded by v0.3.3. 0.3.2 was never published to npm, so the install line below does not work. Two statements below are wrong. The "60% lower median cost" is a prompt-cache artifact; the robust figure is 30% lower total cost. And the tool description already carried a weaker form of the skip-open-page rule. 0.3.3 also fixes two defects in this tag: the press after a fill skipped the confirm gate, and a wait for something to disappear could be skipped.


jev-browser-wingman 0.3.2

This release makes wingman finish nearly every step on its own. In the 0.3.1 benchmark run the agent had to take over a step 7 times across the 34 wingman runs; in this run it was twice, both in a single run of the longest task.

What changed

  • A press after a fill no longer asks the decision service. When a fill lands and the next step is a key press (Enter to submit, for example), wingman presses the key itself instead of asking which element to target. This removed all 5 of the todo-app hand-backs from the previous run.
  • The agent's step guidance covers an "open the page" step that is already done. The tool text now tells the agent to skip a step that opens the page it is already on, instead of re-sending it and bouncing on low confidence.
  • Sign-in state survives a trimmed step list. If the agent signs in during one call and later re-sends only the remaining steps, wingman still treats the sign-in as done instead of asking for it again.
  • A "wait until text appears" step that is already satisfied is skipped. If the page already shows the expected text, the step completes immediately instead of waiting anyway.
  • The calling agent's benchmark prompts carry the same skip-already-open guidance, matching the tool text.

Benchmark

These are the same 17 tasks as 0.3.0 and 0.3.1: each ran twice with wingman and twice with Playwright alone, for 68 runs.

wingman 0.3.2 Playwright alone
Runs completed 34 of 34 32 of 34
Median cost per run $0.075 $0.185
Total cost, 34 runs $3.75 $5.35
Median time per run 16.0 s 15.5 s

Wingman was cheaper on 16 of 17 tasks and faster on 8. Calls that ended by handing a step back fell from 7 in the 0.3.1 run to 2 (both in one run of the seven-page chain, which still completed). Both Playwright misses were the file-upload task, the same task it missed in both earlier runs.

Wall-clock medians rose on both setups against the previous run (wingman 12.0 s to 16.0 s, Playwright 12.7 s to 15.5 s), so part of that shift is the calling model getting slower rather than wingman. The wingman-side decision work per run stayed roughly constant.

With two runs per task, read the differences as indicative, not statistically established. Costs are token use at list prices, not billing.

Upgrade

npm install -g jev-browser-wingman@0.3.2