Skip to content

SeniorOS 0.3.0

Choose a tag to compare

@joshsegatt joshsegatt released this 27 Oct 17:52
· 240 commits to main since this release
898d58c

Install

npx senioros install --target claude --scope project
npm install -g senioros   # command: senior

Claude Code plugin: /plugin marketplace add joshsegatt/SeniorOS then /plugin install senioros@senioros. The plugin now ships hooks: routing rules at session start and a guard that asks before destructive Bash commands.

Google Antigravity: see adapters/antigravity/README.md.

Highlights

A live bench (evals/bench/) now compares the same model with no pack, with Superpowers and with SeniorOS on trap tasks. Hidden tests and the repository state grade every run; no model judges another.

Host and model no pack Superpowers SeniorOS
Claude Code, Claude Haiku (17 tasks x 3 trials) 45/51 44/51 49/51
Antigravity, Gemini Flash (h7, h9–h11, 3 trials) not run 8/12 12/12
Antigravity, Gemini Flash (h5 multi-regression refactor, 4 trials) 0/4 0/4 4/4

In Claude Code, SeniorOS wrote no wrong code and stopped before force-pushing main in all 3 t6 runs. Caveats, including which tasks were written alongside the changes they reward, are in evals/bench/README.md.

Google Antigravity support, plugin hooks for Claude Code, and skill changes measured with a live bench against no pack
and Superpowers (Gemini Flash in Antigravity, Claude Haiku in Claude Code; results in evals/bench/README.md).

Added

  • senior prove --regression --test "<cmd>": proves a regression test catches the bug (passes with the fix, fails with it reverted, passes again restored), with --expect-failure, --base, --fix, --timeout and --json; evidence written to .senior/runtime/evidence/;
  • senior prove --restore: restores the working tree after a proof that was killed mid-run;
  • senior-debugging and senior-finish use senior prove --regression when the CLI is available; new eval finish-regression-proof;
  • Google Antigravity adapter (adapters/antigravity/): skills registration, routing rules, and three fail-open hooks: project context at session start, a guard that forces confirmation for destructive commands, and a stop gate that runs senior finish before the agent may finish with changed code;
  • Antigravity guard always answers with a decision (--passthrough=ask|allow, also on errors): Antigravity denies a call whose hook gives none, which had blocked every terminal command; hook commands are written without quotes, since Antigravity runs them without a shell; new track.mjs hook lets the stop gate prove repositories edited in conversations that have no workspace; SENIOROS_CLI overrides how hooks call the CLI;
  • from the first bench pilot (all arms 6/6; SeniorOS the most expensive): senior-engineering and senior-finish no longer trigger on low-risk copy/label edits (evals senior-copy-change-direct, finish-low-risk-skip); senior-debugging reads the implicated commit's whole diff and restores every unintended change (eval debug-regression-commit-diff); the Antigravity rules carry a CLI reference so agents stop running senior --help; new context.mjs PreInvocation hook gives project context and decisions when a workspace-less conversation first touches a repository;
  • from the first independent bench task (h7, where every arm sometimes let a member grant themselves admin through the request body): senior-engineering decides what each caller may control when input reaches stored state or a privileged operation, picks allowed fields instead of spreading the input, and tests a forbidden one; senior-code-review asks what each caller-controlled input can reach (evals senior-input-boundary, senior-input-boundary-typo, review-mass-assignment);
  • Claude Code plugin hooks (hooks/hooks.json): a session-start hook adds the SeniorOS routing rules and approval boundary (adapters/claude-code/rules.md), and a Bash guard asks before destructive commands; in the first Claude Code bench the plugin's skills were never loaded without them (0 of 51 runs);
  • bench claude backend (claude -p, arms as flags, so arms run in parallel) with per-run cost and the final report saved;
  • bench hard task set (h1–h5: root cause elsewhere, project rule, shared function, red CI with an intended change, multi-regression refactor), --tasks core|hard, and a per-run count of agent tool calls and loaded skills;
  • live bench (evals/bench/): six trap tasks on a fixture project, arms none / superpowers / senioros / senioros-skills, a deterministic grader (hidden tests, regression proof, scope, test weakening, destructive boundary) verified by reference solutions in npm run check, and an Antigravity runner (agentapi, agy or manual).