You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
New dashboard-authenticated REST API for evaluation scenarios, manually curated feedback-derived cases for one target playbook: POST/GET /api/evaluation-scenarios, GET/PUT /api/evaluation-scenarios/:id. A scenario can only become ready with task input, a historical failed output, at least one existing feedback signal and one deterministic expectation. Reference in docs/EVALUATION_SCENARIOS_API.md.
The Feedback page can now curate evaluation scenarios from selected signals with a scenario editor. Expectation types match the agent-deck experiment evaluate evaluator.