Skip to content

v0.10.0 — synthesis eval tier: safe → useful → synthesized

Choose a tag to compare

@notEhEnG notEhEnG released this 11 Jul 19:14

Added

  • Synthesis eval tier. agent_eval.synthesis_checks scores the 0.9.0 analyst-layer contract: courier_verbatim_draft (reply is answer_draft pasted verbatim, similarity ≥ 0.90), missing §4a conditional-thesis / weighed-tension / watch-item structure, and insufficient_report_evidence — the automated ticker-swap proxy (< 2 report-specific figures = generic answer). score_answer now grades three axes: safe → useful → synthesized.
  • docs/eval.md: synthesis-tier table, the manual ticker-swap protocol, and a per-agent publishing template (Claude Code / Codex / Antigravity).
  • README: competitor-class comparison — prompt-only skills, web-search analysts, and API wrappers vs. this skill's fact-layer + analyst-layer split.

Fixed

  • agent_eval.score_answer no longer forwards intent/status into hard_fail_checks (latent TypeError for any caller passing them).

🤖 Generated with Claude Code