Repository navigation
Opt-in OpenTelemetry (OTLP) export for the Agent Panel #65794
xmatthias
started this conversation in
Feature Requests
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
What are you proposing?
Let users send OpenTelemetry traces, metrics and events from Zed's agent to their own OTLP collector. This must be off by default and will be completely separate from Zed's own product telemetry.
Why does this matter?
Right now there's no way to see what Zed's agent is doing, or what it costs, in the observability stack a team already runs (Grafana, Honeycomb, Datadog, Langfuse…) (intentionally not pointing to 1 particular - as that's not relevant to this, it's generally applicable)
With OTel export, it becomes easy to:
This is even more important when not using zed's builtin AI, but relying on some third-party as AI provider (e.g. github copilot) - but zed's AI provider should also be part of this (it shouldn't discriminate).
Most other agentic tools already support this.
Are there any examples or context?
CLAUDE_CODE_ENABLE_TELEMETRY=1plus the standardOTEL_*env vars; content is redacted by default. Docsgithub.copilot.chat.otel.*settings; follows the OTel GenAI semantic conventions. Docs[otel]section inconfig.toml;log_user_prompt = falseby default. Docstelemetryblock insettings.json. DocsWhat they have in common: off by default, standard OTLP over gRPC or HTTP, and prompt/response content redacted unless the user opts in.
Possible approach
OTEL_EXPORTER_OTLP_*andOTEL_RESOURCE_ATTRIBUTESenv vars.invoke_agent->chat/execute_toolspan per turn, plus thegen_ai.client.token.usageandgen_ai.client.operation.durationmetrics.capture_contentis on.Ai was used for research of this content - but every word has been read and validated by a human
All reactions