Repository navigation
Mino chapter-11
·
15 commits
to main
since this release
Added
- Chapter 11 evals:
internal/evalruns declared YAML cases through the real Agent
loop and grades them with deterministic checks (final_text_contains,
final_text_not_contains,final_text_matches,tool_called,tool_not_called,
tool_order,result_status,file_exists,file_contains,max_requests,
max_tool_calls). A case markedlive: falseasserts a scripted program path and
is skipped by--live. mino eval [PATH]runs every*.yamlcase in a directory (default./evals). Replay
mode drives the loop with a scripted loopback Responses service: no key, no network,
a fresh temporary workspace and home per run, the manual permission mode, and no MCP
servers.--liveuses~/.mino/config.json, runs each case several times (--runs,
default 3), and reports pass rate, pass@k, pass^k, and token usage.--filter,--out
(report.jsonplus one session log per run), and--timeoutrefine a run; any
failing case exits with status 1.- A repository
evals/suite covering approved and denied Bash, a protected.env,
file creation, and an unknown tool.scripts/check.shruns it after the build. - The Agent emits a
response_completedevent carrying the service's token usage after
each validated response. The terminal gateway ignores it;mino evalsums it.
Changed
- The chat banner reads
Mino - Chapter 11: Evals, andmino helplistseval.
Fixed
- Book build: override Vite with 6.4.5 and refresh the lockfile (
dompurify,source-map-js)
sonpm audit --audit-level=moderatepasses again and the tutorial site can be rebuilt
and published. VitePress stays at 1.6.4; two low-severity KaTeX advisories remain.