Skip to content

feat(agent-sdk): resolveContext orchestrator + ticket classification (E1/E5/E6/E4)#34

Merged
officialCodeWork merged 1 commit into
developmentfrom
build/phase-5/step-5.1-resolve-context
Jul 15, 2026
Merged

feat(agent-sdk): resolveContext orchestrator + ticket classification (E1/E5/E6/E4)#34
officialCodeWork merged 1 commit into
developmentfrom
build/phase-5/step-5.1-resolve-context

Conversation

@officialCodeWork

Copy link
Copy Markdown
Owner

Step 5.1 — resolveContext orchestrator (opens Phase 5)

Failure modes E1 / E5 / E6 / E4. New @coderadar/agent-sdk package (bundled into ui-lineage), the agent-facing entry point.

  • classifyTicket(ticket) — rule-based + keyword lexicons, no LLM (deterministic, G8). Routes to:
    • visual (screenshot attached)
    • textual (UI terms in prose — E1)
    • behavioral ("clicking X does nothing" — E5)
    • out-of-domain (backend/infra/perf → decline — E6)
    • unsupported (video/GIF → decline — E4)
    • Precedence: unsupported → visual → out-of-domain → behavioral → textual.
  • resolveContext(graph, ticket) — classify, then run the matcher on terms pulled from the prose (quoted phrases, else capitalized runs). OOD/unsupported get a structured decline instead of a forced match.

Eval

Hand-written ticket suite (eval/tickets/tickets.json, 17 cases: 5 visual, 4 textual, 3 behavioral, 3 out-of-domain, 2 unsupported). The harness reports and gates entry-point accuracy (≥ 0.90) and OOD rejection (≥ 0.95) — both 1.000.

CLI

$ ui-lineage resolve "The 'Billing summary' card is wrong"
entry point: textual — UI terms in prose — match on rendered text
BillingSummaryCard  confidence=high (1.00)

$ ui-lineage resolve "Redis latency spiked and the cron worker is backed up"
entry point: out-of-domain — backend/infra/perf vocabulary — not a UI ticket
declined (out-of-scope): … route it to a human or a backend tool.

Verification

41 core + 9 agent-sdk + 3 vision + 105 parser tests pass; pnpm eval green; bundle has no leaked @coderadar imports.

🤖 Generated with Claude Code

…(E1/E5/E6/E4)

New @coderadar/agent-sdk package (TRACKER step 5.1), bundled into ui-lineage:

- classifyTicket(ticket) — rule-based, no LLM (deterministic, G8). Routes to
  visual (screenshot) / textual (UI prose) / behavioral ("clicking X does
  nothing", E5) / out-of-domain (backend/infra/perf → decline, E6) / unsupported
  (video/GIF → decline, E4). Precedence: unsupported → visual → OOD → behavioral
  → textual.
- resolveContext(graph, ticket) — classify, then run the matcher on terms pulled
  from the prose (quoted phrases, else capitalized runs); OOD/unsupported get a
  structured decline instead of a forced match.

Eval: hand-written ticket suite (eval/tickets/tickets.json, 17 cases across all
entry points); harness reports and gates entry-point accuracy (>=0.90) and OOD
rejection (>=0.95) — both 1.000. CLI `resolve <text>` command; lib re-exports
resolveContext/classifyTicket. 41 core + 9 agent-sdk + 3 vision + 105 parser
tests pass; eval green.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
@officialCodeWork
officialCodeWork merged commit fa0a369 into development Jul 15, 2026
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants