Record blocked operational-value study for daily-byok-ollama-test

[Copilot]

Design one deterministic operational-value grader for daily-byok-ollama-test following .github/skills/operational-value-designer/SKILL.md, recovering adoption-time intent and pre-adoption evidence independently.

Analysis

• daily-byok-ollama-test is an infrastructure canary: it verifies the Copilot BYOK proxy can reach a local Ollama endpoint by composing a haiku and filing a status issue.
• The workflow's only reportable artifact — the created issue — is generated exclusively after the run has already succeeded, and its body always states PASS. It restates the run's own execution success rather than reflecting a distinct, attainable repository outcome.
• Operational value must exclude execution quality, output volume, and agent judgment. No opportunity, accepted evidence, or maturation rule can be frozen independent of the run's own success/failure, so no direct primary metric in [0,1] is defensible.

Changes

• Added .github/graders/daily-byok-ollama-test-operational-value-study.json recording designOutcome: "blocked" with:
  • a non-empty rejectionReason explaining the execution-quality conflation
  • full classification (domain, archetype, evidence directness, etc.)
  • decisions covering intent, opportunity, assignment, evidence, maturation, metric, baseline, and diagnostic, each with rejected alternatives and citations to the workflow file and its adoption commit (3cf7c20d93971a0881f88432ee52b1f6d91c97bb)
  • uncertainties covering domain-fit, evidence-availability, assignment, baseline, and causal-attribution risks

No grader script, workflow markdown, or lock file changes were made, per the blocked-design path that limits the change to the study record only.

Original prompt

[operational-value-study:paper-v1] daily-byok-ollama-test

Use the repository's .github/skills/operational-value-designer/SKILL.md to design
and verify one deterministic operational-value grader for github/gh-aw
workflow daily-byok-ollama-test. This is a fresh research run; do not copy another
workflow's metric or contract.

Requirements:

• Recover adoption-time intent and pre-adoption evidence independently.
• Use exactly one direct primary attainment metric in [0,1]. Keep diagnostics separate.
• Treat unavailable evidence as null, never zero. Make maturation explicit and stable.
• Support historical assignment reconstruction when case and event are null.
• If no direct operational metric is defensible, create only the study record below with designOutcome "blocked" and explain why. Never substitute activity, output volume, traces, or agent judgment.
• Change only .github/workflows/daily-byok-ollama-test.md, its generated lock file,
  .github/graders/daily-byok-ollama-test-operational-value.sh, and .github/graders/daily-byok-ollama-test-operational-value-study.json.
• Do not add generated historical reports to the pull request.

Write .github/graders/daily-byok-ollama-test-operational-value-study.json as JSON with this exact top-level shape:
{
"schemaVersion": 1,
"repository": "github/gh-aw",
"workflowId": "daily-byok-ollama-test",
"recordedAt": "ISO-8601 timestamp",
"recorder": "copilot-coding-agent",
"designOutcome": "accepted|rejected|blocked",
"rejectionReason": null,
"classification": {
"domain": "short research domain",
"subdomain": null,
"taskArchetype": "short label",
"interventionType": "short label",
"outcomeType": "short label",
"evidenceDirectness": "direct|proxy|activity",
"evidenceLocality": "same-repository|cross-repository|external",
"measurementLevel": "nominal|ordinal|interval|ratio",
"metricForm": "binary|proportion|rate|distance-to-target|index",
"assignmentDeterminism": "deterministic|bounded-ambiguity|ambiguous",
"intentExplicitness": "explicit|implicit|mixed",
"markdownSpecificity": "exact|bounded|open-ended",
"outcomeObservability": "immediate|delayed",
"causalClaim": "observational|comparative-not-causal"
},
"decisions": [{
"type": "intent|opportunity|assignment|evidence|maturation|metric|baseline|diagnostic",
"selected": "observable selected design",
"alternatives": ["observable rejected alternative"],
"rationale": "concise evidence-backed rationale, not hidden reasoning",
"evidenceReferences": ["commit, issue, PR, or file reference"],
"changedDuringReview": false
}],
"uncertainties": [{
"type": "measurement|assignment|evidence-availability|temporal|baseline|domain-fit|causal-attribution",
"level": "low|medium|high|unknown",
"description": "specific limitation",
"mitigation": null,
"evidenceReferences": []
}]
}

For blocked/rejected designs, rejectionReason must be a non-empty string. Record
observable contract choices and alternatives only; do not record chain-of-thought.

Validation for accepted designs:

1. .github/skills/operational-value-designer/scripts/verify-operational-value-evaluator.sh .github/graders/daily-byok-ollama-test-operational-value.sh
2. gh aw compile .github/workflows/daily-byok-ollama-test.md

Keep the pull request limited to this workflow. The local study runner will replay
history and archive reports after this task completes.