You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
Authority-readiness as an agent observability/eval dimension
#267
Hi maintainers/users - I am testing authority-readiness as a narrow observability/eval dimension for agent systems.
The narrow question is: when an agent is about to send, export, deploy, close a workflow, change permissions, or write persistent memory, can the system prove authority before execution instead of only tracing the action afterward?
npm run benchmark:agent-authority -- --dry-run --json --source=github_discussion --campaign=agent_authority_week --surface=raga_catalyst_agent_observability_authority
This is not a RagaAI Catalyst approval, endorsement, integration, partnership, listing, pass, or fail claim. It is a proposed authority-before-action observability/eval dimension.
Question for maintainers/users here: is authority-readiness useful to measure alongside traces/evals, or would the better insertion point be somewhere else?
reacted with thumbs up emoji reacted with thumbs down emoji reacted with laugh emoji reacted with hooray emoji reacted with confused emoji reacted with heart emoji reacted with rocket emoji reacted with eyes emoji
Uh oh!
There was an error while loading. Please reload this page.
Hi maintainers/users - I am testing authority-readiness as a narrow observability/eval dimension for agent systems.
The narrow question is: when an agent is about to send, export, deploy, close a workflow, change permissions, or write persistent memory, can the system prove authority before execution instead of only tracing the action afterward?
I put a credential-free dry-run benchmark here:
https://github.com/neurarelay/relay-action-card
For this repo, the closest starting path is:
This is not a RagaAI Catalyst approval, endorsement, integration, partnership, listing, pass, or fail claim. It is a proposed authority-before-action observability/eval dimension.
Question for maintainers/users here: is authority-readiness useful to measure alongside traces/evals, or would the better insertion point be somewhere else?
All reactions