Skip to content

v5.0.0

Choose a tag to compare

@SAY-5 SAY-5 released this 10 Sep 09:06
· 37 commits to main since this release

playbook ops reads a runs directory back and reports what an operator asks between runs: the procedures, their prompt versions, the pass rate history, the forbidden actions still open with the criteria that failed, the pending proposals, the promoted version, and the last run with its duration. Every eval, loop and regress now writes a JSON artifact under runs//artifacts/ holding the version scores, the failing scenarios and the measured cost of that run. Tool-call counts per tool, calls per run, tool latency as mean, p95 and max, and run wall time are measured from the traces, and each trace records its own duration. make demo prints the ops summary at the end, and the README carries the real output of that run. Everything still works offline with no API key.