You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Create a sequential end-to-end adoption guide that walks a team from zero to production with AgentOps Toolkit. This document serves as the map — each step links to the detailed tutorial. It is also designed to be the base material for a 1-day hands-on workshop.
Motivation
Existing tutorials cover individual scenarios (model-direct, RAG, agent workflow, etc.) but no document covers the full adoption journey. A developer who just installed AgentOps has no single guide that shows the recommended path from first eval to CI/CD gating to production observability.
Summary
Create a sequential end-to-end adoption guide that walks a team from zero to production with AgentOps Toolkit. This document serves as the map — each step links to the detailed tutorial. It is also designed to be the base material for a 1-day hands-on workshop.
Motivation
Existing tutorials cover individual scenarios (model-direct, RAG, agent workflow, etc.) but no document covers the full adoption journey. A developer who just installed AgentOps has no single guide that shows the recommended path from first eval to CI/CD gating to production observability.
Proposed Content
Sequential walkthrough:
pip install agentops-toolkitagentops init, understand.agentops/structurerun.yaml, select bundle + datasetagentops eval run, understand exit codesresults.jsonschema,report.mdstructure, threshold pass/failagentops workflow generate, PR gating, branch strategyAGENTOPS_OTLP_ENDPOINT, AI Toolkit Trace Viewer, Jaegeragentops eval compare, baseline strategy, regression detectionEach step should be self-contained but link to the detailed tutorial for that topic.
Workshop Mapping
This guide maps to a 1-day (7h) workshop:
Acceptance Criteria
Context
tutorial-model-direct.md,tutorial-basic-foundry-agent.md,tutorial-rag.md,tutorial-http-agent.md,tutorial-agent-workflow.md,tutorial-conversational-agent.mdci-github-actions.mddocs/telemetry.md(PR feat: wire OTel telemetry into runner, add telemetry docs #86)