Skip to content

Everything AI v0.3.0

Choose a tag to compare

@mitunmanav mitunmanav released this 18 Jun 08:36
· 3 commits to main since this release
a379258

Everything AI v0.3.0

v0.3.0 is the main-branch proof release for safer broad delegation.

What changed

  • Tightened Everything AI ask-gate behavior for non-technical users.
  • Added urgent medical and high-stakes safety boundary.
  • Added contradiction and stale-status defaults.
  • Added v0.3.0 benchmark contract and release proof docs.
  • Added raw with-skill vs without-skill result file.
  • Added visual graph showing behavior score and visible-output token estimate.
  • Added npm lockfile so dependency audit can run cleanly.

Test model and method

  • Model: gpt-5.4-mini
  • Reasoning: medium
  • Execution: fresh-subagent manual scorecard
  • Scenarios: 10
  • With skill: 20/20
  • Without skill: 14/20
  • Lift: +6

Token data

  • Visible-output token estimate, without skill: 210
  • Visible-output token estimate, with skill: 295
  • Delta: +85
  • Method: word/punctuation split over saved visible responses, not API billing usage.
  • Plugin-eval static skill budget: trigger 39, invoke 407, deferred 510, total 956 tokens.

Proof files

  • Raw result: tests/results/v0.3.0-with-vs-without-skill.json
  • Graph: tests/results/v0.3.0-with-vs-without-skill.svg
  • Benchmark contract: tests/evals/everything_ai_benchmark.json
  • Report: TEST_RESULTS.md

Validation

  • npm test: passed
  • npm audit --omit=dev --audit-level=moderate: 0 vulnerabilities
  • skill quick_validate: passed
  • plugin-eval: 100/100, Grade A, low risk
  • tracked-file personal data scan: clean
  • release excludes AGENTS.md and development-only repo rules
  • GitHub PR checks: test, analyze, CodeQL passed
  • PR #7 merged into main

Known gap

  • Scorecard is manual-scored, not automated model-runner output yet.
  • No real API billing token log was available, so token data is clearly labeled as a visible-output estimate.