Skip to content

Releases

v0.2.0

Choose a tag to compare

@github-actions github-actions released this 16 Nov 16:46
d133ab4

Two main additions since v0.1.0: Qwen Code as a fourth agent, and honest cost for Claude Code on third-party Anthropic-compatible endpoints.

Qwen Code support (#7)

  • agent-otel-kit setup qwen writes the telemetry block of ~/.qwen/settings.json (enabled, target: "local", otlpEndpoint, otlpProtocol, logPrompts: false) and removes outfile and the per-signal endpoint overrides. It uses OTLP/gRPC on port 4317 by default (an open Qwen Code report says its OTLP/HTTP exporter can send empty bodies); --protocol http|grpc|auto chooses explicitly, and an endpoint not on port 4318 gets OTLP/HTTP with a notice. setup all, setup --undo qwen and doctor cover Qwen Code too.
  • Collector: service.name qwen-code maps to agent_name="qwen-code"; qwen-code.tool_call events feed the shared tool-duration histogram (function_name becomes tool.name).
  • Redaction fix: with logPrompts: false, Qwen Code still sends the final answer of its background subagents as result and execution_summary; the collector now deletes both.
  • Dashboards: Qwen Code tokens (without double-counting cache inside input and thought inside output), sessions, qwen-code.interaction traces, permission decisions and model request duration, in Grafana and Perses.
  • make test-collector runs against OTLP payloads recorded from Qwen Code 0.27.4.

Claude Code on third-party Anthropic-compatible endpoints (#6)

  • When Claude Code talks to DeepSeek, GLM, Kimi, MiniMax, Alibaba or another endpoint through ANTHROPIC_BASE_URL, the tokens are exact but the cost is not (unknown model IDs are priced at the default model's rate). The collector now labels Claude Code cost metrics and api_request events with cost_basis: estimated when anthropic.custom_base_url is true, otherwise list; a cost.basis set on the agent is kept.
  • A [1m]-style suffix is stripped from model on Claude Code metrics, events and spans, so claude-sonnet-5-5[1m] and claude-sonnet-5-5 are one model.
  • Dashboards: Cost and Estimated cost are separate stats and separate session columns, every cost series names its basis, and a Cost basis selector filters by it.
  • README (EN, KO, zh-CN): what the kit shows for these endpoints, the managed-settings modelPricing snippet for exact cost (the kit never writes it), llm.provider tagging, and the subscription-plan caveat.

Smaller changes

  • The Cost panel description names Qwen Code with Codex and Gemini CLI as agents that export no cost (#8).
  • The dashboard screenshots in the README are new, from a real local run of Claude Code, Codex, Gemini CLI and Qwen Code, and show the five-stat cost row (#8).
  • README in Simplified Chinese (README.zh-CN.md) (#5).
  • CI starts the collector and fails on deprecated or unknown config warnings (#4).

What was verified, and how

  • Qwen Code 0.27.4 was run (qwen -p, setup qwen with gRPC and with --protocol http) on a live local stack against a local OpenAI-compatible mock server with a dummy key. No Alibaba Cloud Model Studio (DashScope) or DeepSeek key was used, so the model names, token counts (cached and reasoning tokens) and latencies those providers really report are not verified.
  • The third-party Claude Code path was verified with Claude Code 2.1.325 against a mock Anthropic-compatible endpoint. No DeepSeek, GLM, Kimi, MiniMax or Alibaba key was used.
  • The screenshots come from a real local run: Claude Code (haiku and sonnet) on Anthropic, Codex 0.169.0 (codex exec), Gemini CLI 0.68.0 (gemini -p, AI Studio key) and Qwen Code 0.27.4 against the same mock. The Estimated cost stat shows $0 because no session in that run used a third-party endpoint.
  • CI: go test ./..., lint, dashboard regeneration check, collector config validation and make test-collector against recorded payloads.

Install

  • brew install s3onghyun/tap/agent-otel-kit (or brew upgrade agent-otel-kit)
  • Archives for Linux and macOS (amd64, arm64) and checksums.txt below
  • go install github.com/s3onghyun/agent-otel-kit/cmd/agent-otel-kit@v0.2.0

Changelog

  • 0f0a12e: ci(collector): fail on deprecated or unknown config warnings at start-up (#4) (@s3onghyun)
  • 07411c6: feat(collector): honest Claude Code cost on third-party Anthropic-compatible endpoints (#6) (@s3onghyun)
  • 4c9c3b6: feat: add Qwen Code support (setup qwen, collector rules, dashboards) (#7) (@s3onghyun)
  • d133ab4: fix(dashboards): name Qwen Code in the cost panel and refresh screenshots (#8) (@s3onghyun)

v0.1.0

Choose a tag to compare

@github-actions github-actions released this 15 Nov 05:35
4298e6f

Changelog