feat(examples): add evaluation + optimization closed-loop pipeline - #284

Closed

coder-mtj wants to merge 89 commits into

trpc-group:mainfrom

coder-mtj:feat/issue-91-eval-optimize-loop

Commits on Aug 2, 2026

feat(examples): add eval+optimization closed-loop pipeline
coder-mtj
committed
a50e6cf
feat(optimization): expand eval+optimize pipeline with massive test coverage
coder-mtj
committed
45986ed
docs(optimization): add development process documentation
coder-mtj
committed
f98cb7b
feat(optimization): add SDK-faithful trace comparator and fix fake-mode no-op
coder-mtj
committed
3a726e1
test(optimization): add gold-verdict attribution lock and normalize evalset data
coder-mtj
committed
409a301
feat(optimization): add 3-scenario candidate model and overfitting gate rejection
coder-mtj
committed
bc93437
feat(optimization): add candidate block and per-case delta to reports
coder-mtj
committed
b978c53
fix(optimization): fix live mode with real SDK integration and fallback
coder-mtj
committed
03b3998
test(optimization): add scenario, attribution accuracy, and live-mode tests
coder-mtj
committed
c818e48
refactor(optimization): consolidate pipeline exports into unified package entry
coder-mtj
committed
6e1306f
docs(optimization): update docs to match real behavior and add meaningful sample report
coder-mtj
committed
41e84f8
fix(optimization): fix live mode SDK API mismatches found by AI review
coder-mtj
committed
f644c9e
fix(optimization): fix converged check, tool-result dead code, and overfit default (AI review round 2)
coder-mtj
committed
bbef58c
fix(optimization): score holdout set and remove dead fixed_categories param (AI review round 3)
coder-mtj
committed
19f8e1c

Commits on Aug 3, 2026

Commits on Aug 4, 2026