You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
This commit was created on GitHub.com and signed with GitHub’s verified signature.
Explainable workspace evaluations
Add an immutable refund-triage evaluation specification with explicit,
criterion-level pass, fail, and insufficient-evidence results plus bounded
explanations, evidence references, aggregate thresholds, and frozen
evaluator provenance.
Let the maintained Hermes integration report bounded evidence for the six
refund-triage criteria, bound to the active Job and labeled Self-attested
by agent · not independently verified throughout storage and the console.
Reconcile provider usage by distinguishing uncached input, cached input,
output, and total tokens without inventing missing counters or double
counting provider-reported cache usage.
Make eval assignment safer with workspace-scoped source and agent choices,
effective-route previews, and compatibility or coverage warnings before an
owner saves a route.
Keep Job detail reachable from Job rows and supported deep links with a clear
workspace-preserving return path, while removing it from permanent
navigation.
Preserve v1 definitions and historical finalized Jobs through additive
fields; existing workspaces require no migration. This release does not add
a general-purpose rubric builder or independent model judge.