You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
This commit was created on GitHub.com and signed with GitHub’s verified signature.
0.12.1 - 2026-11-03
Fixed
Preserve failed live-target trials and their native reports when Evals records
target errors/timeouts instead of raising. Wrong answers remain completed trials.
Refresh embedded Evals report schemas and executable example artifacts for
Evals 0.11, including judge/live summaries; exclude measured judge total latency
from deterministic example comparisons.
Raise the Evals compatibility floor to 0.11.0; integrity authentication and
producer-declared coverage semantics are unchanged.