v0.11.3
Bug Fixes
-
checker-context: Typed model, reject litellm+agent_judge/sim, live test
(#137,
727bb7b) -
eval-routing: Restore DEFAULT_JUDGE_MODEL floor + add litellm judge transport
(#137,
727bb7b) -
evalboard: Exclude carried-forward passes from the wall-clock aggregates
(#125,
dd918e6) -
release: Pin python-semantic-release + GitPython to unbreak version bump
(#139,
ef74014) -
routing: Make _resolve_backend_route's match exhaustive
(#137,
727bb7b)
Continuous Integration
-
Retrigger checks (GH Actions appeared stalled repo-wide)
(#137,
727bb7b) -
Retrigger checks (previous push did not trigger CI)
(#137,
727bb7b) -
fix: Install litellm extra for pyright, address CodeQL findings
(#137,
727bb7b)
Documentation
Features
-
eval-routing: Decouple judge/agent_judge backend+model from the agent's own route
(#137,
727bb7b) -
eval-routing: Decouple judge/agent_judge backend+model from the agent's route
(#137,
727bb7b) -
evalboard: Chart seconds per passed task on the overview
(#125,
dd918e6) -
evalboard: Read the time ratio without hovering
(#125,
dd918e6) -
evalboard: Replace the turn-budget signal with time per passed task
(#125,
dd918e6) -
evalboard: Run the wall-clock signal beside the turn budget, behind tabs
(#125,
dd918e6) -
litellm-judge: Support arbitrary litellm kwargs via params/auth
(#137,
727bb7b)