Skip to content

v0.11.3

Choose a tag to compare

@coder-eval-release-bot coder-eval-release-bot released this 27 Aug 18:22
· 40 commits to main since this release

Bug Fixes

  • checker-context: Typed model, reject litellm+agent_judge/sim, live test
    (#137,
    727bb7b)

  • eval-routing: Restore DEFAULT_JUDGE_MODEL floor + add litellm judge transport
    (#137,
    727bb7b)

  • evalboard: Exclude carried-forward passes from the wall-clock aggregates
    (#125,
    dd918e6)

  • release: Pin python-semantic-release + GitPython to unbreak version bump
    (#139,
    ef74014)

  • routing: Make _resolve_backend_route's match exhaustive
    (#137,
    727bb7b)

Continuous Integration

  • Retrigger checks (GH Actions appeared stalled repo-wide)
    (#137,
    727bb7b)

  • Retrigger checks (previous push did not trigger CI)
    (#137,
    727bb7b)

  • fix: Install litellm extra for pyright, address CodeQL findings
    (#137,
    727bb7b)

Documentation

  • timing: Trim justification prose from the wall-clock comments
    (#125,
    dd918e6)

Features

  • eval-routing: Decouple judge/agent_judge backend+model from the agent's own route
    (#137,
    727bb7b)

  • eval-routing: Decouple judge/agent_judge backend+model from the agent's route
    (#137,
    727bb7b)

  • evalboard: Chart seconds per passed task on the overview
    (#125,
    dd918e6)

  • evalboard: Read the time ratio without hovering
    (#125,
    dd918e6)

  • evalboard: Replace the turn-budget signal with time per passed task
    (#125,
    dd918e6)

  • evalboard: Run the wall-clock signal beside the turn budget, behind tabs
    (#125,
    dd918e6)

  • litellm-judge: Support arbitrary litellm kwargs via params/auth
    (#137,
    727bb7b)

Refactoring

  • litellm-judge: Drop settings coupling, rename auth to env_params
    (#137,
    727bb7b)