Skip to content

v0.5.0

Choose a tag to compare

@guinaut guinaut released this 25 Jul 15:35

okareo-tools v0.5.0

REPS agent-evaluation workbench
New top-level reps/ directory: a standalone, forkable harness that evaluates any registered agent across four pillars — Reasoning · Execution · Performance · Security — and generates an explainable assessment report. Each pillar ships committed baseline scenarios, drivers, and checks (including a full security attack suite: authority-pressing, goal-hijacking, covert manipulation, verification-gate probes), plus a report generator and a scenario/target reuse layer. Start at reps/README.md.

Three new skills (8 → 11)

  • reps-explore — run one benign discovery conversation against an unknown agent and draft its profile
  • reps-profile — interview the operator and tune the REPS suite to their agent
  • reps-run — execute a pillar against a registered target and regenerate the report
  • Automated publishing
  • This repo is now published automatically from Okareo's private okareo-tools-dev repository on every change — .sync-state.json at the root fingerprints each sync, and direct edits here are flagged as drift and reconciled upstream. See CONTRIBUTING.md for how to propose changes.

Also in this release

  • Refinements to the existing skills (better target/driver/simulation creation guidance)
  • Release workflow and build/validate script updates; Okareo logo assets added
  • Install / upgrade: /plugin marketplace update okareo-tools then /plugin install okareo@okareo-tools

Full Changelog: v0.4.0...v0.5.0