Skip to content

Remove agentic-observability-kit and agentic-optimization-kit workflows#28959

Merged
mnkiefer merged 1 commit intomainfrom
copilot/remove-observability-optimization-kits
Apr 28, 2026
Merged

Remove agentic-observability-kit and agentic-optimization-kit workflows#28959
mnkiefer merged 1 commit intomainfrom
copilot/remove-observability-optimization-kits

Conversation

Copy link
Copy Markdown
Contributor

Copilot AI commented Apr 28, 2026

Both kits are being removed to allow piecewise re-implementation with proper testing at each layer.

Removed

  • .github/workflows/agentic-observability-kit.md + .lock.yml — weekly repository-scoped observability + portfolio review workflow
  • .github/workflows/agentic-optimization-kit.md + .lock.yml — weekly consolidated token audit + optimization + observability workflow
  • docs/src/content/docs/patterns/agentic-observability-kit.md — docs page for the kit

Capability inventory (for re-implementation reference)

Observability Kit

  • Episode-level lineage analysis via episodes[] / edges[] from gh aw logs
  • Signals: drift, weak control, MCP failures, blocked requests, resource-heavy runs, stale/overlapping workflows
  • Four charts: Episode Risk–Cost Frontier, Workflow Stability Matrix, Repository Portfolio Map, Workflow Overlap Matrix
  • Metrics: episode_risk_score, workflow_instability_score, workflow_value_proxy, workflow_overlap_score
  • Domain-aware interpretation across triage / research / code_fix / release_ops / delegated_automation

Optimization Kit

  • Three-phase pipeline: 7-day baseline audit → optimization target selection → 30-day episode/observability analysis
  • Heavy-hitter flags: is_dominant (>30% token share), is_expensive_per_run (>100k avg tokens/run), is_noisy (>0.5 incidents/run)
  • Rolling 90-day trend snapshots + 14-day optimization cooldown log in repo-memory
  • Five charts: token usage bar, historical trend, risk–cost frontier, stability heatmap, portfolio map
  • Report includes 5 actionable AI prompts (optimization, stability fix, consolidation, right-sizing, escalation)

…ws and docs

Agent-Logs-Url: https://github.com/github/gh-aw/sessions/b02b3f62-0286-4c62-b3ca-5c3b15a0ba6f

Co-authored-by: mnkiefer <8320933+mnkiefer@users.noreply.github.com>
@mnkiefer mnkiefer marked this pull request as ready for review April 28, 2026 15:54
Copilot AI review requested due to automatic review settings April 28, 2026 15:54
@github-actions github-actions Bot mentioned this pull request Apr 28, 2026
Copy link
Copy Markdown
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Removes the “agentic-observability-kit” and “agentic-optimization-kit” workflows (and their compiled lock files) plus the associated docs page, to enable piecewise re-implementation with better testing.

Changes:

  • Deleted .github/workflows/agentic-observability-kit.md and .github/workflows/agentic-observability-kit.lock.yml.
  • Deleted .github/workflows/agentic-optimization-kit.md and .github/workflows/agentic-optimization-kit.lock.yml.
  • Deleted docs/src/content/docs/patterns/agentic-observability-kit.md.
Show a summary per file
File Description
docs/src/content/docs/patterns/agentic-observability-kit.md Removes the documentation page describing the observability kit.
.github/workflows/agentic-optimization-kit.md Removes the optimization kit workflow definition.
.github/workflows/agentic-optimization-kit.lock.yml Removes the compiled/locked workflow artifact for the optimization kit.
.github/workflows/agentic-observability-kit.md Removes the observability kit workflow definition.
.github/workflows/agentic-observability-kit.lock.yml Removes the compiled/locked workflow artifact for the observability kit.

Copilot's findings

Tip

Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Comments suppressed due to low confidence (2)

.github/workflows/agentic-observability-kit.md:1

  • Removing this workflow will leave stale references in the docs that link to /.github/workflows/agentic-observability-kit.md and its badge (agentic-observability-kit.lock.yml). For example: docs/src/content/docs/agent-factory-status.mdx:18 and docs/src/content/docs/blog/2026-04-06-weekly-update.md:62. Please update/remove those references in the same PR to avoid broken links/badges.
    .github/workflows/agentic-optimization-kit.md:1
  • Removing this workflow will leave stale references in the docs that link to /.github/workflows/agentic-optimization-kit.md and its badge (agentic-optimization-kit.lock.yml). For example: docs/src/content/docs/agent-factory-status.mdx:19. Please update/remove those references in the same PR to avoid broken links/badges.
  • Files reviewed: 4/5 changed files
  • Comments generated: 0

@mnkiefer mnkiefer merged commit cd0eb26 into main Apr 28, 2026
106 of 107 checks passed
@mnkiefer mnkiefer deleted the copilot/remove-observability-optimization-kits branch April 28, 2026 16:35
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants