Smoke Test: OTEL Backends - 25863982719

[github-actions]

Overall Result: FAIL

The local OTEL emission is working (span for this run confirmed in local mirror), but both Sentry and Grafana query paths are broken due to authentication failures.

Run: https://github.com/github/gh-aw/actions/runs/25863982719

---

Checklist

• Local send verification — INCONCLUSIVE (spans present, 2 export errors)
• Sentry query verification — FAIL (HTTP 403 Forbidden)
• Grafana query verification — FAIL (HTTP 401 Unauthorized)

---

Evidence

Step 1: Local OTEL Emission

Status: INCONCLUSIVE

OTEL environment variables are set:

• OTEL_EXPORTER_OTLP_ENDPOINT = set
• OTEL_EXPORTER_OTLP_HEADERS = set
• GH_AW_OTLP_ENDPOINTS = set
• OTEL_SERVICE_NAME = gh-aw
• COPILOT_OTEL_FILE_EXPORTER_PATH = /tmp/gh-aw/copilot-otel.jsonl

/tmp/gh-aw/otel.jsonl exists with 1 span for run 25863982719:

{"name":"gh-aw.agent.setup","run_id":"25863982719"}

Resource attributes confirm: service.name=gh-aw, github.run_id=25863982719.

⚠️ OTLP export error count: 2 — spans may not have reached remote backends.

Step 2: Sentry

Status: FAIL

• MCP connection: ✅ connected (200 on initialize)
• find_organizations returned HTTP 403: You do not have permission to perform this action
• No project discovered, no traces queried
• Neither current-run nor recent gh-aw spans were accessible

Step 3: Grafana

Status: FAIL

• MCP connection: ✅ connected (200 on initialize)
• list_datasources returned HTTP 401: Unauthorized
• No tracing datasource discovered, no traces queried
• Neither current-run nor recent gh-aw spans were accessible

---

Blockers

🔴 Sentry: 403 Forbidden

The SENTRY_ACCESS_TOKEN secret is present but the token does not have sufficient permissions to call GET /api/0/organizations/. Check:

• Token scope includes org:read and project:read
• Token belongs to the correct Sentry organization for github/gh-aw

🔴 Grafana: 401 Unauthorized

The GRAFANA_SERVICE_ACCOUNT_TOKEN secret is present but the Grafana MCP server rejected the request with 401. Check:

• GRAFANA_SERVICE_ACCOUNT_TOKEN is valid and not expired
• GRAFANA_URL points to the correct Grafana instance
• The service account token has at least Viewer role

⚠️ OTLP Export Errors: 2

Two export errors were recorded in /tmp/gh-aw/otlp-export-errors.count. Even if backend auth is fixed, verify that spans are reaching the remote OTLP endpoint (check GH_AW_OTLP_ENDPOINTS and OTEL_EXPORTER_OTLP_HEADERS are correct).

Generated by Smoke OTEL Backends for issue #32114 · ● 2M · ◷

• expires on May 14, 2026, 3:59 PM UTC

[github-actions]

This issue was automatically closed because it expired on 2026-05-14T15:59:18.505Z.

Closed by Workflow