Skip to content

Add output_format A/B experiment to daily-news with structured and bullet digest variants#31001

Closed
Copilot wants to merge 3 commits into
mainfrom
copilot/ab-advisor-experiment-campaign-output-format
Closed

Add output_format A/B experiment to daily-news with structured and bullet digest variants#31001
Copilot wants to merge 3 commits into
mainfrom
copilot/ab-advisor-experiment-campaign-output-format

Conversation

Copy link
Copy Markdown
Contributor

Copilot AI commented May 8, 2026

This updates daily-news to run a 3-way A/B experiment on report presentation (prose, structured, bullet_digest) to measure discussion engagement impact while preserving current behavior as control. The workflow prompt now branches by selected variant at runtime, and the compiled lockfile includes experiment state plumbing/artifacts.

  • Experiment config (frontmatter)

    • Added experiments.output_format with variants, weights, hypothesis/metric metadata, guardrail, sample target, start date, analysis type, tags, and discussion notification.
    • Kept guardrail threshold in schema-supported form ("==0").
  • Prompt behavior by variant

    • Introduced conditional prompt blocks:
      • structured: fixed section template + summary table + required TL;DR
      • bullet_digest: compact bullet-only format, ≤400 words, no embedded charts
      • else: existing upbeat prose style (baseline), preserving prior narrative behavior
  • Compiled workflow updates

    • Regenerated daily-news.lock.yml so activation includes experiment selection output, artifact upload/download for experiment state, and push of experiment state branch data.
{{#if experiments.output_format == "structured"}}
... fixed-section template instructions ...
{{else if experiments.output_format == "bullet_digest"}}
... ultra-compact bullet digest rules ...
{{else}}
... existing prose instructions ...
{{/if}}

Warning

Firewall rules blocked me from connecting to one or more addresses (expand for details)

I tried to connect to the following addresses, but was blocked by firewall rules:

  • https://api.github.com/graphql
    • Triggering command: /usr/bin/gh gh repo view --json owner,name --jq .owner.login + "/" + .name cfg GOINSECURE GOMOD GOMODCACHE ache/go/1.25.8/xtest@example.com (http block)
    • Triggering command: /usr/bin/gh /usr/bin/gh api graphql -f query=query($owner: String!, $name: String!) { repository(owner: $owner, name: $name) { hasDiscussionsEnabled } } -f owner=github -f name=gh-aw GOMOD GOMODCACHE ache/go/1.25.8/x64/pkg/tool/linutest@example.com ranc�� -json GO111MODULE cfg GOINSECURE GOMOD GOMODCACHE ache/go/1.25.8/x64/pkg/tool/linux_amd64/vet (http block)
    • Triggering command: /usr/bin/gh /usr/bin/gh api graphql -f query=query($owner: String!, $name: String!) { repository(owner: $owner, name: $name) { hasDiscussionsEnabled } } -f owner=github -f name=gh-aw GOMOD GOMODCACHE ache/go/1.25.8/x64/pkg/tool/linux_amd64/vet env -json GO111MODULE er.test GOINSECURE GOMOD GOMODCACHE er.test (http block)
  • https://api.github.com/orgs/test-owner/actions/secrets
    • Triggering command: /usr/bin/gh gh api /orgs/test-owner/actions/secrets --jq .secrets[].name -json GO111MODULE 64/bin/go GOINSECURE GOMOD GOMODCACHE go env -json GO111MODULE x_amd64/vet GOINSECURE GOMOD GOMODCACHE x_amd64/vet (http block)
    • Triggering command: /usr/bin/gh gh api /orgs/test-owner/actions/secrets --jq .secrets[].name --write scripts/**/*.js tify-uber-super-expert.lock.yml .prettierignore --log-level=erro/home/REDACTED/work/gh-aw/gh-aw/actions/setup/js/node_modules/.bin/pre�� (http block)
  • https://api.github.com/repos/actions/ai-inference/git/ref/tags/v1
    • Triggering command: /usr/bin/gh gh api /repos/actions/ai-inference/git/ref/tags/v1 --jq [.object.sha, .object.type] | @tsv --show-toplevel 1/x64/bin/node /usr/bin/git licyMinIntegritygit -buildtags /usr/bin/git git rev-�� --show-toplevel git /usr/bin/git runs/20260508-11gh -tests t git (http block)
    • Triggering command: /usr/bin/gh gh api /repos/actions/ai-inference/git/ref/tags/v1 --jq [.object.sha, .object.type] | @tsv --show-toplevel sh /usr/bin/git npx prettier --wgit erignore ache/node/24.14.--show-toplevel git rev-�� --show-toplevel ache/node/24.14.1/x64/bin/node /usr/bin/git y -buildtags t git (http block)
  • https://api.github.com/repos/actions/checkout/git/ref/tags/v3
    • Triggering command: /usr/bin/gh gh api /repos/actions/checkout/git/ref/tags/v3 --jq [.object.sha, .object.type] | @tsv /ref/tags/v9 l sv -json cfg 64/pkg/tool/linu/repos/actions/github-script/git/ref/tags/v9 git conf�� --get remote.origin.url /usr/bin/git -json cfg 64/pkg/tool/linu--show-toplevel /usr/bin/git (http block)
    • Triggering command: /usr/bin/gh gh api /repos/actions/checkout/git/ref/tags/v3 --jq [.object.sha, .object.type] | @tsv --show-toplevel resolved$ /usr/bin/git k/gh-aw/gh-aw/.ggh config /usr/bin/git git rev-�� --show-toplevel git (http block)
  • https://api.github.com/repos/actions/checkout/git/ref/tags/v5
    • Triggering command: /usr/bin/gh gh api /repos/actions/checkout/git/ref/tags/v5 --jq [.object.sha, .object.type] | @tsv orts1509329248/001/main.md /tmp/go-build404280781/b118/vet.cfg 1/x64/bin/node pkg/mod/github.cgit pkg/mod/github.crev-parse 64/bin/go /opt/hostedtoolcache/go/1.25.8/x64/pkg/tool/linux_amd64/vet -has�� ithub/workflows/ai-moderator.md '/tmp/TestParseDefaultBranchFromLsRemoteWithRealGitbranch_with_hgithub.com/github/gh-aw/pkg/slic-1 /opt/hostedtoolcache/go/1.25.8/x64/pkg/tool/linux_amd64/vet bin/linux-x64/rginfocmp go 64/bin/go /opt/hostedtoolcache/go/1.25.8/x5 (http block)
    • Triggering command: /usr/bin/gh gh api /repos/actions/checkout/git/ref/tags/v5 --jq [.object.sha, .object.type] | @tsv --show-toplevel git /usr/bin/git Gf1j/g249MWQPUj8git (http block)
    • Triggering command: /usr/bin/gh gh api /repos/actions/checkout/git/ref/tags/v5 --jq [.object.sha, .object.type] | @tsv --show-toplevel git /usr/bin/gh --show-toplevel ache/go/1.25.8/xrev-parse /usr/bin/git gh api /repos/actions/setup-go/git/ref/tags/v4 --jq /usr/bin/infocmp --show-toplevel 64/pkg/tool/linurev-parse /usr/bin/gh infocmp (http block)
  • https://api.github.com/repos/actions/checkout/git/ref/tags/v6
    • Triggering command: /usr/bin/gh gh api /repos/actions/checkout/git/ref/tags/v6 --jq [.object.sha, .object.type] | @tsv 280781/b465/tty.test -tests t -json GO111MODULE 64/bin/go XHjoE8hqd2SJr/Mm0ui0x2Iv4Z-LYbBHBh/hKJC44cVKMHVnpBvTgXO/G1KutSxXremote.origin.url ls-r�� ry=1 origin 280781/b465/_pkg_.a -json GO111MODULE 64/bin/go git (http block)
    • Triggering command: /usr/bin/gh gh api /repos/actions/checkout/git/ref/tags/v6 --jq [.object.sha, .object.type] | @tsv :latest config /usr/bin/git remote.origin.urgit GO111MODULE 64/bin/go git rev-�� runs/20260508-111029-33952/test-1874554959 go /opt/hostedtoolcache/node/24.14.1/x64/bin/node -json GO111MODULE x_amd64/vet node (http block)
    • Triggering command: /usr/bin/gh gh api /repos/actions/checkout/git/ref/tags/v6 --jq [.object.sha, .object.type] | @tsv waysRecompiles2333324034/001 resolved$ /usr/bin/git -json GO111MODULE x_amd64/vet git conf�� --get remote.origin.url /usr/bin/git -json GO111MODULE x_amd64/vet git (http block)
  • https://api.github.com/repos/actions/download-artifact/git/ref/tags/v8
    • Triggering command: /usr/bin/gh gh api /repos/actions/download-artifact/git/ref/tags/v8 --jq [.object.sha, .object.type] | @tsv --show-toplevel gh r: $owner, name: $name) { hasDiscussionsEnabled } } /repos/actions/ggit nly (http block)
  • https://api.github.com/repos/actions/github-script/git/ref/tags/v8
    • Triggering command: /usr/bin/gh gh api /repos/actions/github-script/git/ref/tags/v8 --jq [.object.sha, .object.type] | @tsv xterm-color git /usr/bin/git /tmp/shared-actigh config /usr/bin/git git rev-�� --show-toplevel git /usr/bin/infocmp (http block)
    • Triggering command: /usr/bin/gh gh api /repos/actions/github-script/git/ref/tags/v8 --jq [.object.sha, .object.type] | @tsv xterm-color git /usr/bin/git add origin /usr/bin/git git rev-�� --show-toplevel git /usr/bin/infocmp tags/v5 .github/workflowrev-parse sv infocmp (http block)
  • https://api.github.com/repos/actions/github-script/git/ref/tags/v9
    • Triggering command: /usr/bin/gh gh api /repos/actions/github-script/git/ref/tags/v9 --jq [.object.sha, .object.type] | @tsv -json GO111MODULE 64/bin/go GOINSECURE GOMOD GOMODCACHE go env -json GO111MODULE 64/bin/go GOINSECURE GOMOD GOMODCACHE go (http block)
    • Triggering command: /usr/bin/gh gh api /repos/actions/github-script/git/ref/tags/v9 --jq [.object.sha, .object.type] | @tsv -json GO111MODULE 64/bin/go GOINSECURE GOMOD GOMODCACHE TU50lDyNK2iA env -json GO111MODULE 64/bin/go GOINSECURE GOMOD GOMODCACHE go (http block)
    • Triggering command: /usr/bin/gh gh api /repos/actions/github-script/git/ref/tags/v9 --jq [.object.sha, .object.type] | @tsv .github/workflows GO111MODULE 64/bin/go GOINSECURE GOMOD GOMODCACHE go env -json GO111MODULE 64/bin/go GOINSECURE GOMOD GOMODCACHE go (http block)
  • https://api.github.com/repos/actions/github-script/git/ref/tags/v9.0.0
    • Triggering command: /usr/bin/gh gh api /repos/actions/github-script/git/ref/tags/v9.0.0 --jq [.object.sha, .object.type] | @tsv -json GO111MODULE 64/bin/go GOINSECURE GOMOD GOMODCACHE go env -json GO111MODULE 64/bin/go GOINSECURE GOMOD GOMODCACHE go (http block)
    • Triggering command: /usr/bin/gh gh api /repos/actions/github-script/git/ref/tags/v9.0.0 --jq [.object.sha, .object.type] | @tsv -json GO111MODULE 64/bin/go GOINSECURE GOMOD GOMODCACHE So_z10iwA5KW env -json GO111MODULE 64/bin/go GOINSECURE GOMOD GOMODCACHE go (http block)
    • Triggering command: /usr/bin/gh gh api /repos/actions/github-script/git/ref/tags/v9.0.0 --jq [.object.sha, .object.type] | @tsv go1.25.8 -c=4 -nolocalimports -importcfg /tmp/go-build404280781/b419/importcfg -pack /tmp/go-build404280781/b419/_testmain.go env -json GO111MODULE 64/bin/go GOINSECURE GOMOD GOMODCACHE go (http block)
  • https://api.github.com/repos/actions/setup-go/git/ref/tags/v4
    • Triggering command: /usr/bin/gh gh api /repos/actions/setup-go/git/ref/tags/v4 --jq [.object.sha, .object.type] | @tsv --show-toplevel 64/pkg/tool/linu--repo /usr/bin/gh -bool -buildtags 1/x64/bin/node gh api /repos/actions/github-script/git/ref/tags/v9 --jq /usr/bin/git ithub/workflows/git /tmp/go-build404rev-parse cfg git (http block)
    • Triggering command: /usr/bin/gh gh api /repos/actions/setup-go/git/ref/tags/v4 --jq [.object.sha, .object.type] | @tsv --show-toplevel ache/go/1.25.8/xrepos/{owner}/{repo}/actions/runs/12346/artifacts /usr/bin/infocmp 426940753/.githugit gh /node_modules/.b--show-toplevel infocmp -1 xterm-color node /usr/bin/git FieldEnforcementgit --write bject.type] | @t--show-toplevel git (http block)
  • https://api.github.com/repos/actions/setup-node/git/ref/tags/v4
    • Triggering command: /usr/bin/gh gh api /repos/actions/setup-node/git/ref/tags/v4 --jq [.object.sha, .object.type] | @tsv /tmp/TestCompileErrorFormatting609529366/001 config /usr/bin/git remote.origin.urgit GO111MODULE x_amd64/vet git add .github/workflows/test.md resolved$ /usr/bin/git matter-with-nestgit GO111MODULE x_amd64/vet git (http block)
    • Triggering command: /usr/bin/gh gh api /repos/actions/setup-node/git/ref/tags/v4 --jq [.object.sha, .object.type] | @tsv xterm-color /opt/hostedtoolcache/go/1.25.8/x64/pkg/tool/linu-tests /usr/bin/git SameOutput373164infocmp /tmp/go-build404-1 64/pkg/tool/linuxterm-color git rev-�� --show-toplevel 64/pkg/tool/linux_amd64/vet /usr/bin/git '/tmp/TestParsegit cfg 1/x64/bin/node git (http block)
    • Triggering command: /usr/bin/gh gh api /repos/actions/setup-node/git/ref/tags/v4 --jq [.object.sha, .object.type] | @tsv ithub-script/git/ref/tags/v9 ache/node/24.14.1/x64/bin/node bject.type] | @tsv ub.actor -importcfg /opt/hostedtoolc--show-toplevel git rev-�� --show-toplevel node /usr/bin/git /tmp/TestHashConinfocmp -extld=gcc /usr/bin/git git (http block)
  • https://api.github.com/repos/actions/setup-node/git/ref/tags/v6
    • Triggering command: /usr/bin/gh gh api /repos/actions/setup-node/git/ref/tags/v6 --jq [.object.sha, .object.type] | @tsv t0 -tests ache/go/1.25.8/x64/pkg/tool/linux_amd64/vet m0s GO111MODULE (http block)
    • Triggering command: /usr/bin/gh gh api /repos/actions/setup-node/git/ref/tags/v6 --jq [.object.sha, .object.type] | @tsv /repos/actions/github-script/git/ref/tags/v9 --jq /usr/bin/git -json GO111MODULE 64/bin/go git -C /tmp/gh-aw-test-runs/20260508-111029-33952/test-4219378795 rev-parse /usr/bin/git -json GO111MODULE x_amd64/vet git (http block)
    • Triggering command: /usr/bin/gh gh api /repos/actions/setup-node/git/ref/tags/v6 --jq [.object.sha, .object.type] | @tsv waysRecompiles2333324034/001 -test.v=true r,url,status,conclusion,workflowName,createdAt,startedAt,updatedAt,event,headBranch,headSha,disp--show-toplevel -test.timeout=10git -test.run=^Test -test.short=true--show-toplevel git init�� GOMODCACHE x_amd64/vet /usr/bin/git -json GO111MODULE x_amd64/vet git (http block)
  • https://api.github.com/repos/actions/upload-artifact/git/ref/tags/v4
    • Triggering command: /usr/bin/gh gh api /repos/actions/upload-artifact/git/ref/tags/v4 --jq [.object.sha, .object.type] | @tsv --show-toplevel (http block)
    • Triggering command: /usr/bin/gh gh api /repos/actions/upload-artifact/git/ref/tags/v4 --jq [.object.sha, .object.type] | @tsv Secret: ${{ secrets.TOKEN }} git /usr/bin/git iant-567714819 config layTitle git -C /tmp/shared-actions-test941713314 show /usr/bin/git ithub/workflows config /usr/bin/gh git (http block)
  • https://api.github.com/repos/aws-actions/configure-aws-credentials/git/ref/tags/v4
    • Triggering command: /usr/bin/gh gh api /repos/aws-actions/configure-aws-credentials/git/ref/tags/v4 --jq [.object.sha, .object.type] | @tsv --show-toplevel node /usr/bin/git /tmp/TestHashCongit go clusion,workflow--show-toplevel git rev-�� --show-toplevel ache/node/24.14.1/x64/bin/node /usr/bin/git ere x_amd64/link /usr/bin/git git (http block)
    • Triggering command: /usr/bin/gh gh api /repos/aws-actions/configure-aws-credentials/git/ref/tags/v4 --jq [.object.sha, .object.type] | @tsv --show-toplevel node /usr/bin/git /tmp/TestHashCongh go /usr/bin/git git rev-�� --show-toplevel git /usr/bin/infocmp /tmp/gh-aw-test-git rev-parse /usr/bin/git infocmp (http block)
    • Triggering command: /usr/bin/gh gh api /repos/aws-actions/configure-aws-credentials/git/ref/tags/v4 --jq [.object.sha, .object.type] | @tsv --show-toplevel git /usr/bin/git 393221/001 config /opt/hostedtoolc--show-toplevel git rev-�� --show-toplevel /opt/hostedtoolcache/node/24.14.--jq /usr/bin/git env.NODE_VERSIONgh bash /usr/bin/gh git (http block)
  • https://api.github.com/repos/azure/login/git/ref/tags/v2
    • Triggering command: /usr/bin/gh gh api /repos/azure/login/git/ref/tags/v2 --jq [.object.sha, .object.type] | @tsv --show-toplevel node /usr/bin/git /tmp/TestHashCongit go /opt/hostedtoolc--show-toplevel git rev-�� --show-toplevel /opt/hostedtoolcache/go/1.25.8/x64/pkg/tool/linux_amd64/compile /usr/bin/gh GOMODCACHE x_amd64/compile /usr/bin/git gh (http block)
    • Triggering command: /usr/bin/gh gh api /repos/azure/login/git/ref/tags/v2 --jq [.object.sha, .object.type] | @tsv --show-toplevel git /usr/bin/git /tmp/gh-aw-test-git remote 904491/b481/vet.--show-toplevel git rev-�� --show-toplevel git /usr/bin/gh /ref/tags/v9 rev-parse sv gh (http block)
  • https://api.github.com/repos/docker/login-action/git/ref/tags/v3
    • Triggering command: /usr/bin/gh gh api /repos/docker/login-action/git/ref/tags/v3 --jq [.object.sha, .object.type] | @tsv --show-toplevel 280781/b471/importcfg /usr/bin/git k/gh-aw/gh-aw/pkgit k/gh-aw/gh-aw/pkrev-parse /tmp/go-build404--show-toplevel git rev-�� /ref/tags/v9 /tmp/go-build404280781/b468/types.test sv -test.paniconexiinfocmp l /usr/bin/git gh (http block)
    • Triggering command: /usr/bin/gh gh api /repos/docker/login-action/git/ref/tags/v3 --jq [.object.sha, .object.type] | @tsv --show-toplevel git /usr/bin/git /tmp/gh-aw-test-git rev-parse repository(owne--show-toplevel git rev-�� /ref/tags/v9 git sv --show-toplevel git /opt/hostedtoolcxterm-color gh (http block)
  • https://api.github.com/repos/docker/metadata-action/git/ref/tags/v6
    • Triggering command: /usr/bin/gh gh api /repos/docker/metadata-action/git/ref/tags/v6 --jq [.object.sha, .object.type] | @tsv --show-toplevel infocmp 1/x64/lib/node_modules/npm/node_modules/@npmcli/run-script/lib/node-gyp-bin/sh xterm-color git /usr/bin/infocmp/home/REDACTED/work/gh-aw/gh-aw/.github/workflows git rev-�� */*.ts' '**/*.json' --ignore-path ../../../.pret.prettierignore infocmp r: $owner, name: $name) { hasDiscussionsEnabled } } ithub-script/gitgit git bject.type] | @t/home/REDACTED/work/gh-aw/gh-aw/.github/workflows infocmp (http block)
  • https://api.github.com/repos/docker/setup-buildx-action/git/ref/tags/v4
    • Triggering command: /usr/bin/gh gh api /repos/docker/setup-buildx-action/git/ref/tags/v4 --jq [.object.sha, .object.type] | @tsv assword=$GITHUB_TOKEN"; }; f get assword=$GITHUB_TOKEN"; }; f get /usr/bin/git --show-toplevel gh k git rev-�� */*.ts' '**/*.js-f infocmp r: $owner, name:-f xterm-color git /usr/bin/git git (http block)
  • https://api.github.com/repos/github/gh-aw
    • Triggering command: /usr/bin/gh gh api /repos/github/gh-aw --jq .default_branch *.json' '!../../../pkg/workflow/js/**/*.json' --ignore-path ../../../.prettierignore s/ab-testing-advisor.lock.yml ache/go/1.25.8/x64/bin/gofmt s/agent-performa/usr/bin/gh s/agent-persona-api s/ai-moderator.lgraphql ache/go/1.25.8/x-f s/ap�� successfully" l_workflow_test.owner=github ester.lock.yml l_workflow_validgit paign_trigger_te-C ckout_config_par/home/REDACTED/work/gh-aw/gh-aw ckout_disabled_tshow (http block)
  • https://api.github.com/repos/github/gh-aw-actions/git/ref/tags/v0.1.2
    • Triggering command: /usr/bin/gh gh api /repos/github/gh-aw-actions/git/ref/tags/v0.1.2 --jq [.object.sha, .object.type] | @tsv --show-toplevel /opt/hostedtoolcache/go/1.25.8/x64/pkg/tool/linux_amd64/vet /usr/bin/gh 1029-33952/test-gh /tmp/go-build404api e/git-upload-pac/repos/actions/github-script/git/ref/tags/v9 gh api /repos/actions/github-script/git/ref/tags/v9 --jq (http block)
    • Triggering command: /usr/bin/gh gh api /repos/github/gh-aw-actions/git/ref/tags/v0.1.2 --jq [.object.sha, .object.type] | @tsv -f bash /usr/bin/git 373271786 on rkflow/js/**/*.j/repos/actions/github-script/git/ref/tags/v9 git -C /tmp/gh-aw-test-runs/20260508-111502-49915/test-2071596400 rev-parse (http block)
  • https://api.github.com/repos/github/gh-aw-actions/git/ref/tags/v1.0.0
    • Triggering command: /usr/bin/gh gh api /repos/github/gh-aw-actions/git/ref/tags/v1.0.0 --jq [.object.sha, .object.type] | @tsv testing.testBinary=1 -extld=gcc (http block)
    • Triggering command: /usr/bin/gh gh api /repos/github/gh-aw-actions/git/ref/tags/v1.0.0 --jq [.object.sha, .object.type] | @tsv /repos/github/gh-aw/git/ref/tags/v2.0.0 --jq /usr/bin/git json' --ignore-pgit :latest kflows/daily-sen--show-toplevel git -C /home/REDACTED/work/gh-aw/gh-aw/pkg/cli rev-parse /usr/bin/git th .prettierignogit -f odules/npm/node_--show-toplevel git (http block)
  • https://api.github.com/repos/github/gh-aw-actions/git/ref/tags/v1.2.3
    • Triggering command: /usr/bin/gh gh api /repos/github/gh-aw-actions/git/ref/tags/v1.2.3 --jq [.object.sha, .object.type] | @tsv /ref/tags/v9 (http block)
    • Triggering command: /usr/bin/gh gh api /repos/github/gh-aw-actions/git/ref/tags/v1.2.3 --jq [.object.sha, .object.type] | @tsv /ref/tags/v9 runc sv tmatter-with-arrgit git review.lock.yml git rev-�� --show-toplevel infocmp /usr/bin/git th .prettierignogit gh bin/node git (http block)
  • https://api.github.com/repos/github/gh-aw/actions/runs
    • Triggering command: /usr/bin/gh gh run list --json databaseId,number,url,status,conclusion,workflowName,createdAt,startedAt,updatedAt,event,headBranch,headSha,displayTitle --limit 100 --created >=2026-05-01 GOMOD GOMODCACHE 64/pkg/tool/linutest@example.com env -json GO111MODULE 64/pkg/tool/linux_amd64/vet GOINSECURE GOMOD GOMODCACHE 64/pkg/tool/linux_amd64/vet (http block)
    • Triggering command: /usr/bin/gh gh run list --json databaseId,number,url,status,conclusion,workflowName,createdAt,startedAt,updatedAt,event,headBranch,headSha,displayTitle --limit 100 --created >=2026-04-08 GOMOD GOMODCACHE 64/pkg/tool/linux_amd64/vet eWit�� -json cfg 64/pkg/tool/linux_amd64/vet GOINSECURE GOMOD GOMODCACHE 64/pkg/tool/linuInitial commit (http block)
    • Triggering command: /usr/bin/gh gh run list --json databaseId,number,url,status,conclusion,workflowName,createdAt,startedAt,updatedAt,event,headBranch,headSha,displayTitle --limit 100 --created >=2026-02-07 GOMOD GOMODCACHE 64/pkg/tool/linux_amd64/vet env -json cfg 64/pkg/tool/linux_amd64/vet GOINSECURE GOMOD GOMODCACHE 64/pkg/tool/linux_amd64/vet (http block)
  • https://api.github.com/repos/github/gh-aw/actions/runs/1/artifacts
    • Triggering command: /usr/bin/gh gh api --paginate repos/{owner}/{repo}/actions/runs/1/artifacts --jq .artifacts[].name GO111MODULE ache/go/1.25.8/x64/pkg/tool/linux_amd64/vet GOINSECURE GOMOD GOMODCACHE ache/go/1.25.8/x64/pkg/tool/linux_amd64/vet (http block)
    • Triggering command: /usr/bin/gh gh run download 1 --dir test-logs/run-1 GO111MODULE ache/go/1.25.8/x64/pkg/tool/linu-buildmode=exe GOINSECURE GOMOD GOMODCACHE ache/go/1.25.8/x64/pkg/tool/linuremote.origin.url (http block)
    • Triggering command: /usr/bin/gh gh api --paginate repos/{owner}/{repo}/actions/runs/1/artifacts --jq .artifacts[].name -f e_modules/.bin/sh nore owner=github -f infocmp ranc�� ed_at, event: .event, headBranch: .head_branch, git sh */*.ts' '**/*.jsinfocmp gh r: $owner, name:xterm-color git (http block)
  • https://api.github.com/repos/github/gh-aw/actions/runs/12345/artifacts
    • Triggering command: /usr/bin/gh gh api --paginate repos/{owner}/{repo}/actions/runs/12345/artifacts --jq .artifacts[].name tmain.go cfg GOINSECURE GOMOD GOMODCACHE ache/go/1.25.8/x64/pkg/tool/linux_amd64/link env 280781/b400/agentdrain.test GO111MODULE k GOINSECURE GOMOD GOMODCACHE ache/go/1.25.8/x64/pkg/tool/linutest@example.com (http block)
    • Triggering command: /usr/bin/gh gh run download 12345 --dir test-logs/run-12345 go cfg GOINSECURE GOMOD GOMODCACHE ache/go/1.25.8/x64/pkg/tool/linu--jq (http block)
    • Triggering command: /usr/bin/gh gh api --paginate repos/{owner}/{repo}/actions/runs/12345/artifacts --jq .artifacts[].name git ache/node/24.14.1/x64/lib/node_modules/npm/node_modules/@npmcli/run-script/lib/node-gyp-bin/node--git-dir mpaign-output-fogit git (http block)
  • https://api.github.com/repos/github/gh-aw/actions/runs/1234567890
    • Triggering command: /usr/bin/gh gh api repos/{owner}/{repo}/actions/runs/1234567890 --jq {databaseId: .id, number: .run_number, url: .html_url, status: .status, conclusion: .conclusion, workflowName: .name, workflowPath: .path, createdAt: .created_at, startedAt: .run_started_at, updatedAt: .updated_at, event: .event, headBranch: .head_branch, -json GO111MODULE 64/bin/go GOINSECURE GOMOD GOMODCACHE go env -json GO111MODULE x_amd64/vet GOINSECURE GOMOD GOMODCACHE x_amd64/vet (http block)
    • Triggering command: /usr/bin/gh gh api repos/{owner}/{repo}/actions/runs/1234567890 --jq {databaseId: .id, number: .run_number, url: .html_url, status: .status, conclusion: .conclusion, workflowName: .name, workflowPath: .path, createdAt: .created_at, startedAt: .run_started_at, updatedAt: .updated_at, event: .event, headBranch: .head_branch, h ../../../.pret.prettierignore git er: String!, $name: String!) { -f tierignore git ed } } node /hom�� w/js/**/*.json' --ignore-path ../../../.prettierignore ../../../**/*.json kflows/daily-cli-performance.lock.yml --ignore-path ../../../.pretti-1 /usr/bin/infocmpxterm-color /opt/hostedtoolcache/go/1.25.8/x64/pkg/tool/linushow (http block)
  • https://api.github.com/repos/github/gh-aw/actions/runs/12346/artifacts
    • Triggering command: /usr/bin/gh gh api --paginate repos/{owner}/{repo}/actions/runs/12346/artifacts --jq .artifacts[].name GO111MODULE x_amd64/link GOINSECURE GOMOD GOMODCACHE x_amd64/link (http block)
    • Triggering command: /usr/bin/gh gh run download 12346 --dir test-logs/run-12346 GO111MODULE 64/pkg/tool/linux_amd64/compile GOINSECURE GOMOD GOMODCACHE 64/pkg/tool/linu--json (http block)
    • Triggering command: /usr/bin/gh gh api --paginate repos/{owner}/{repo}/actions/runs/12346/artifacts --jq .artifacts[].name -f in/node -f owner=github -f git ache�� 2140020186/001 config sv remote.origin.urgit git ode erignore (http block)
  • https://api.github.com/repos/github/gh-aw/actions/runs/2/artifacts
    • Triggering command: /usr/bin/gh gh api --paginate repos/{owner}/{repo}/actions/runs/2/artifacts --jq .artifacts[].name GO111MODULE ache/go/1.25.8/x64/pkg/tool/linux_amd64/vet GOINSECURE GOMOD GOMODCACHE ache/go/1.25.8/x64/pkg/tool/linux_amd64/vet (http block)
    • Triggering command: /usr/bin/gh gh run download 2 --dir test-logs/run-2 GO111MODULE x_amd64/vet GOINSECURE GOMOD GOMODCACHE x_amd64/vet (http block)
    • Triggering command: /usr/bin/gh gh api --paginate repos/{owner}/{repo}/actions/runs/2/artifacts --jq .artifacts[].name config ache/node/24.14.1/x64/lib/node_modules/npm/node_modules/@npmcli/run-script/lib/node-gyp-bin/sh nore gh de_modules/.bin/user.name git -C efaultBranchFromLsRemoteWithRealGitmain_branch1822807883/001' efaultBranchFromLsRemoteWithRealGitmain_branch1822807883/001' /usr/bin/gh */*.ts' '**/*.jsinfocmp gh ck.yml /usr/bin/gh (http block)
  • https://api.github.com/repos/github/gh-aw/actions/runs/3/artifacts
    • Triggering command: /usr/bin/gh gh api --paginate repos/{owner}/{repo}/actions/runs/3/artifacts --jq .artifacts[].name GO111MODULE ache/go/1.25.8/x64/pkg/tool/linux_amd64/vet GOINSECURE GOMOD GOMODCACHE ache/go/1.25.8/x--json (http block)
    • Triggering command: /usr/bin/gh gh run download 3 --dir test-logs/run-3 GO111MODULE ache/go/1.25.8/x64/pkg/tool/linu-importcfg GOINSECURE GOMOD GOMODCACHE ache/go/1.25.8/x64/pkg/tool/linu/home/REDACTED/work/gh-aw/gh-aw/pkg/stats/spec_test.go (http block)
    • Triggering command: /usr/bin/gh gh api --paginate repos/{owner}/{repo}/actions/runs/3/artifacts --jq .artifacts[].name git es/.bin/sh nore git tions/setup/node_modules/.bin/sh git -C te '**/*.cjs' '**/*.ts' '**/*.json' --ignore-path ../../../.pret.prettierignore rev-parse h */*.ts' '**/*.jsgit gh $name) { has--show-toplevel git (http block)
  • https://api.github.com/repos/github/gh-aw/actions/runs/4/artifacts
    • Triggering command: /usr/bin/gh gh api --paginate repos/{owner}/{repo}/actions/runs/4/artifacts --jq .artifacts[].name GO111MODULE ache/go/1.25.8/x64/pkg/tool/linux_amd64/vet GOINSECURE GOMOD GOMODCACHE ache/go/1.25.8/x64/pkg/tool/linurev-parse (http block)
    • Triggering command: /usr/bin/gh gh run download 4 --dir test-logs/run-4 GO111MODULE ache/go/1.25.8/x64/pkg/tool/linu-lang=go1.25 GOINSECURE GOMOD GOMODCACHE ache/go/1.25.8/x64/pkg/tool/linu--json env 606820710 GO111MODULE cfg GOINSECURE GOMOD GOMODCACHE ache/go/1.25.8/x64/pkg/tool/linu/home/REDACTED/work/gh-aw/gh-aw/pkg/timeutil/format_test.go (http block)
    • Triggering command: /usr/bin/gh gh api --paginate repos/{owner}/{repo}/actions/runs/4/artifacts --jq .artifacts[].name rev-parse in/sh nore git DiscussionsEnabladd git -C te '**/*.cjs' '**/*.ts' '**/*.json' --ignore-path ../../../.pret.prettierignore config /usr/bin/git remote.origin.urgh infocmp r: $owner, name:/repos/actions/github-script/git/ref/tags/v9 git (http block)
  • https://api.github.com/repos/github/gh-aw/actions/runs/5/artifacts
    • Triggering command: /usr/bin/gh gh api --paginate repos/{owner}/{repo}/actions/runs/5/artifacts --jq .artifacts[].name GO111MODULE cfg GOINSECURE GOMOD GOMODCACHE ache/go/1.25.8/x^remote\..*\.gh-resolved$ (http block)
    • Triggering command: /usr/bin/gh gh run download 5 --dir test-logs/run-5 GO111MODULE ache/go/1.25.8/x64/pkg/tool/linu-nilfunc GOINSECURE GOMOD GOMODCACHE ache/go/1.25.8/x64/pkg/tool/linu-tests stlo�� se 280781/b143/vet.cfg x_amd64/vet GOINSECURE GOMOD GOMODCACHE x_amd64/vet (http block)
    • Triggering command: /usr/bin/gh gh api --paginate repos/{owner}/{repo}/actions/runs/5/artifacts --jq .artifacts[].name show k nore infocmp $name) { hasuser.email docker sRem�� te '**/*.cjs' '**/*.ts' '**/*.json' --ignore-path ../../../.pret.prettierignore ghcr.io/github/serena-mcp-server:latest ache/node/24.14.1/x64/bin/npx */*.ts' '**/*.jsgit ache/node/24.14.rev-parse repository(owne--show-toplevel infocmp (http block)
  • https://api.github.com/repos/github/gh-aw/actions/workflows
    • Triggering command: /usr/bin/gh gh workflow list --json name,state,path -json GO111MODULE 64/bin/go GOINSECURE GOMOD GOMODCACHE go env -json GO111MODULE x_amd64/vet GOINSECURE GOMOD GOMODCACHE x_amd64/vet (http block)
    • Triggering command: /usr/bin/gh gh run list --json databaseId,number,url,status,conclusion,workflowName,createdAt,startedAt,updatedAt,event,headBranch,headSha,displayTitle --workflow nonexistent-workflow-12345 --limit 100 -pack /home/REDACTED/work/gh-aw/gh-aw/pkg/timeutil/format.go /home/REDACTED/work/gh-aw/gh-aw/pkg/timeutil/format_test.go env -json GO111MODULE x_amd64/vet GOINSECURE GOMOD GOMODCACHE x_amd64/vet (http block)
    • Triggering command: /usr/bin/gh gh run list --json databaseId,number,url,status,conclusion,workflowName,createdAt,startedAt,updatedAt,event,headBranch,headSha,displayTitle --workflow nonexistent-workflow-12345 --limit 6 GOMOD GOMODCACHE 64/pkg/tool/linux_amd64/link env util.test GO111MODULE k GOINSECURE GOMOD GOMODCACHE iC_8TYgJC_Wlv0IiZI/d5EXBy1MIAlwgremote.origin.url (http block)
  • https://api.github.com/repos/github/gh-aw/contents/.github/workflows/shared/reporting.md
    • Triggering command: /tmp/go-build404280781/b405/cli.test /tmp/go-build404280781/b405/cli.test -test.testlogfile=/tmp/go-build404280781/b405/testlog.txt -test.paniconexit0 -test.v=true -test.parallel=4 -test.timeout=10m0s -test.run=^Test -test.short=true GOINSECURE GOMOD GOMODCACHE go env -json GO111MODULE 64/bin/go GOINSECURE GOMOD GOMODCACHE go (http block)
    • Triggering command: /tmp/go-build371904491/b405/cli.test /tmp/go-build371904491/b405/cli.test -test.testlogfile=/tmp/go-build371904491/b405/testlog.txt -test.paniconexit0 -test.v=true -test.parallel=4 -test.timeout=10m0s -test.run=^Test -test.short=true /ref/tags/v9 git ed } } node /opt�� ./cmd/gh-aw --write me: String!) { repository(owner: $owner, name:-f l **/*.json --ignore-path sh (http block)
  • https://api.github.com/repos/github/gh-aw/git/ref/tags/v0.47.4
    • Triggering command: /usr/bin/gh gh api /repos/github/gh-aw/git/ref/tags/v0.47.4 --jq [.object.sha, .object.type] | @tsv --show-toplevel git /usr/bin/git /tmp/gh-aw-test-du config /opt/hostedtoolc/tmp/gh-aw/aw-feature-branch.patch git rev-�� --show-toplevel node /usr/bin/git /home/REDACTED/worgit lL1NFbSSmfCB /usr/bin/gh git (http block)
    • Triggering command: /usr/bin/gh gh api /repos/github/gh-aw/git/ref/tags/v0.47.4 --jq [.object.sha, .object.type] | @tsv --show-toplevel git /usr/bin/git 99297291/001 bash /usr/bin/git git rev-�� --show-toplevel git /usr/bin/git --show-toplevel infocmp /usr/bin/git git (http block)
  • https://api.github.com/repos/github/gh-aw/git/ref/tags/v1.0.0
    • Triggering command: /usr/bin/gh gh api /repos/github/gh-aw/git/ref/tags/v1.0.0 --jq [.object.sha, .object.type] | @tsv 1009346316/001 GO111MODULE ache/go/1.25.8/x64/pkg/tool/linux_amd64/vet GOINSECURE GOMOD GOMODCACHE rtcfg env 1029-33952/test-3634466306/.github/workflows g/jsonutil/json_test.go ngutil.test GOINSECURE GOMOD GOMODCACHE ngutil.test (http block)
    • Triggering command: /usr/bin/gh gh api /repos/github/gh-aw/git/ref/tags/v1.0.0 --jq [.object.sha, .object.type] | @tsv graphql -f n-dir/node -f owner=github -f /usr/bin/gh 1/x6�� 3035/001/stability-test.md -f tions/setup/js/node_modules/.bin/sh -f owner=github -f git (http block)
  • https://api.github.com/repos/github/gh-aw/git/ref/tags/v1.2.3
    • Triggering command: /usr/bin/gh gh api /repos/github/gh-aw/git/ref/tags/v1.2.3 --jq [.object.sha, .object.type] | @tsv -json GO111MODULE x_amd64/vet GOINSECURE GOMOD GOMODCACHE x_amd64/vet env b/workflows GO111MODULE x_amd64/vet GOINSECURE GOMOD GOMODCACHE x_amd64/vet (http block)
    • Triggering command: /usr/bin/gh gh api /repos/github/gh-aw/git/ref/tags/v1.2.3 --jq [.object.sha, .object.type] | @tsv iant-2745085363/.github/workflows git sh --show-toplevel git /usr/bin/git infocmp -1 th .prettierignore --log-level=e!../../../pkg/workflow/js/**/*.json git me: String!) { repository(owne../../../.prettierignore --show-toplevel git /usr/bin/infocmp--show-toplevel infocmp (http block)
  • https://api.github.com/repos/github/gh-aw/git/ref/tags/v2.0.0
    • Triggering command: /usr/bin/gh gh api /repos/github/gh-aw/git/ref/tags/v2.0.0 --jq [.object.sha, .object.type] | @tsv -json GO111MODULE x_amd64/vet GOINSECURE GOMOD GOMODCACHE x_amd64/vet env -json GO111MODULE x_amd64/vet GOINSECURE GOMOD GOMODCACHE x_amd64/vet (http block)
    • Triggering command: /usr/bin/gh gh api /repos/github/gh-aw/git/ref/tags/v2.0.0 --jq [.object.sha, .object.type] | @tsv -json GO111MODULE x_amd64/vet GOINSECURE GOMOD GOMODCACHE x_amd64/vet env ub/workflows GO111MODULE x_amd64/compile GOINSECURE GOMOD GOMODCACHE x_amd64/compile (http block)
    • Triggering command: /usr/bin/gh gh api /repos/github/gh-aw/git/ref/tags/v2.0.0 --jq [.object.sha, .object.type] | @tsv -json GO111MODULE x_amd64/vet GOINSECURE GOMOD GOMODCACHE x_amd64/vet env -json GO111MODULE x_amd64/compile GOINSECURE GOMOD GOMODCACHE x_amd64/compile (http block)
  • https://api.github.com/repos/github/gh-aw/git/ref/tags/v3.0.0
    • Triggering command: /usr/bin/gh gh api /repos/github/gh-aw/git/ref/tags/v3.0.0 --jq [.object.sha, .object.type] | @tsv -json GO111MODULE x_amd64/vet GOINSECURE GOMOD GOMODCACHE x_amd64/vet env -json GO111MODULE x_amd64/link GOINSECURE GOMOD GOMODCACHE x_amd64/link (http block)
    • Triggering command: /usr/bin/gh gh api /repos/github/gh-aw/git/ref/tags/v3.0.0 --jq [.object.sha, .object.type] | @tsv tmatter-with-nested-objects.md git /usr/bin/git ns.json and pkg/git git /usr/bin/infocmp--show-toplevel git -C th .prettierignore --log-level=error show node xterm-color infocmp /usr/bin/gh git (http block)
  • https://api.github.com/repos/google-github-actions/auth/git/ref/tags/v2
    • Triggering command: /usr/bin/gh gh api /repos/google-github-actions/auth/git/ref/tags/v2 --jq [.object.sha, .object.type] | @tsv --show-toplevel /opt/hostedtoolcache/go/1.25.8/x64/pkg/tool/linush /usr/bin/git /tmp/go-build404git -trimpath /usr/bin/git git rev-�� --show-toplevel git /usr/bin/git /ref/tags/v9 config sv git (http block)
    • Triggering command: /usr/bin/gh gh api /repos/google-github-actions/auth/git/ref/tags/v2 --jq [.object.sha, .object.type] | @tsv --show-toplevel git /usr/bin/git --show-toplevel sh /usr/bin/git git rev-�� --show-toplevel git /usr/bin/git /tmp/gh-aw-test-git rev-parse /usr/bin/infocmp--show-toplevel git (http block)
  • https://api.github.com/repos/nonexistent/action/git/ref/tags/v999.999.999
    • Triggering command: /usr/bin/gh gh api /repos/nonexistent/action/git/ref/tags/v999.999.999 --jq [.object.sha, .object.type] | @tsv -json GO111MODULE er.test GOINSECURE GOMOD GOMODCACHE er.test 0428�� -json GO111MODULE 280781/b196/vet.cfg GOINSECURE GOMOD GOMODCACHE /opt/hostedtoolcache/go/1.25.8/xremote1 (http block)
    • Triggering command: /usr/bin/gh gh api /repos/nonexistent/action/git/ref/tags/v999.999.999 --jq [.object.sha, .object.type] | @tsv k/gh-aw/gh-aw/.github/workflows infocmp tions/setup/js/node_modules/.bin/sh l git ode_modules/.bin--get /usr/bin/gh api */*.ts' '**/*.json' --ignore-path ../../../.prettierignore -f h -f owner=github -f git (http block)
  • https://api.github.com/repos/nonexistent/repo/actions/runs/12345
    • Triggering command: /usr/bin/gh gh run view 12345 --repo nonexistent/repo --json status,conclusion GOINSECURE GOMOD GOMODCACHE x_amd64/compile env -json GO111MODULE cfg GOINSECURE GOMOD GOMODCACHE ache/go/1.25.8/x64/pkg/tool/linu/tmp/go-build404280781/b465/_testmain.go (http block)
    • Triggering command: /usr/bin/gh gh run view 12345 --repo nonexistent/repo --json status,conclusion -f owner=github -f git -C rite '../../../**/*.json' '!../..github/workflows/test.md rev-parse ache/go/1.25.8/x64/pkg/tool/linux_amd64/link ithub-script/gitgit gh ock.yml ache/go/1.25.8/x64/pkg/tool/linutest@example.com (http block)
  • https://api.github.com/repos/owner/repo/actions/workflows
    • Triggering command: /usr/bin/gh gh workflow list --json name,state,path --repo owner/repo 64/bin/go GOINSECURE GOMOD GOMODCACHE go env -json GO111MODULE x_amd64/vet GOINSECURE GOMOD GOMODCACHE x_amd64/vet (http block)
    • Triggering command: /usr/bin/gh gh workflow list --repo owner/repo --json name,path,state cfg GOINSECURE GOMOD GOMODCACHE ache/go/1.25.8/x64/pkg/tool/linu-dwarf=false (http block)
    • Triggering command: /usr/bin/gh gh workflow list --json name,state,path --repo owner/repo /usr/sbin/sh --show-toplevel git (http block)
  • https://api.github.com/repos/test-owner/test-repo/actions/secrets
    • Triggering command: /usr/bin/gh gh api /repos/test-owner/test-repo/actions/secrets --jq .secrets[].name -json GO111MODULE 64/bin/go GOINSECURE GOMOD GOMODCACHE go env -json GO111MODULE x_amd64/vet GOINSECURE GOMOD GOMODCACHE x_amd64/vet (http block)
    • Triggering command: /usr/bin/gh gh api /repos/test-owner/test-repo/actions/secrets --jq .secrets[].name k/gh-aw/gh-aw/.github/workflows **/*.cjs /sh **/*.json --ignore-path ../../../.pretti--write sh -c w/js/**/*.json' --ignore-path infocmp repository(owner: $owner, name: $name) { hasDiscussionsEnabled } } ithub-script/gitgh git bject.type] | @t/repos/actions/github-script/git/ref/tags/v9 make (http block)
  • https://api.github.com/repos/test/repo
    • Triggering command: /usr/bin/gh gh api /repos/test/repo --jq .default_branch 177141549 280781/b169/vet.cfg $name) { hasDiscussionsEnabled } } GOINSECURE GOMOD GOMODCACHE ache/go/1.25.8/x64/pkg/tool/linux_amd64/vet env 1029-33952/test-417293354/.github/workflows GO111MODULE ache/go/1.25.8/x64/pkg/tool/linux_amd64/link GOINSECURE GOMOD GOMODCACHE ache/go/1.25.8/xsh (http block)
    • Triggering command: /usr/bin/gh gh api /repos/test/repo --jq .default_branch ithub/workflows --write 904491/b391/vet.cfg **/*.ts **/*.json --ignore-path node /opt�� run format:pkg-json /opt/hostedtoolcache/go/1.25.8/x64/pkg/tool/linux_amd64/vet (http block)

If you need me to access, download, or install something from one of these locations, you can either:

Copilot AI changed the title [WIP] Experiment with output format for daily-news campaign Add output_format A/B experiment to daily-news with structured and bullet digest variants May 8, 2026
Copilot AI requested a review from pelikhan May 8, 2026 11:24
@pelikhan pelikhan marked this pull request as ready for review May 8, 2026 11:24
Copilot AI review requested due to automatic review settings May 8, 2026 11:24
@pelikhan
Copy link
Copy Markdown
Collaborator

pelikhan commented May 8, 2026

@copilot merge main and recompile

Copy link
Copy Markdown
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Adds an output_format experiment to the daily-news workflow so the generated Discussion body can vary between the current prose baseline and two new presentation variants.

Changes:

  • Added experiments.output_format frontmatter config (variants, weights, metrics/guardrails, start date, notifications).
  • Added conditional prompt branches for structured and bullet_digest formats (with prose as control).
  • Regenerated daily-news.lock.yml to include experiment selection, state artifact handling, and pushing experiment state to a git branch.
Show a summary per file
File Description
.github/workflows/daily-news.md Declares the output_format experiment and adds conditional prompt instructions for each variant.
.github/workflows/daily-news.lock.yml Compiled workflow updates to pick experiment variants, persist state via artifacts/git branch, and propagate experiment outputs.

Copilot's findings

Tip

Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Comments suppressed due to low confidence (3)

.github/workflows/daily-news.md:364

  • The conditional branching tags here don’t match the supported template syntax. The renderer recognizes {{#elseif ...}} / {{#else-if ...}} / {{#else_if ...}} and {{#else}}, but not {{else if ...}} (with a space) or {{else}} (without #). As written, the non-structured variants may drop the entire block or leave template markers in the prompt. Update to the supported elseif/#else forms so the three variants actually branch at runtime.
{{else if experiments.output_format == "bullet_digest"}}
Write an ultra-compact daily digest using only bullet points. Rules:
- Total word count must not exceed 400 words
- Use minimal headers (### Issues, ### PRs, ### Highlights)
- One line per item, e.g. `- github/gh-aw#123 Fix login bug (merged by \`@alice\`)`
- No paragraphs, no haiku, no embedded charts (list chart URLs under ### Charts)
- No filler phrases ("Great news!", "The team has been busy")
- Emoji allowed only as bullet prefixes (one per section max)
{{else}}
Write an upbeat, friendly, motivating summary of recent activity in the repo.
{{/if}}

.github/workflows/daily-news.md:346

  • The fixed-section template uses literal ... placeholder lines for each section. Without an explicit instruction to replace them, the model may copy ... verbatim into the report. Consider removing the ... lines or replacing them with clearer placeholder text (e.g., "(add items here)") plus a direct instruction to not include placeholder markers in the final output.
### 🔴 Issues
...
### 🟢 Pull Requests
...
### 💬 Discussions
...

.github/workflows/daily-news.md:360

  • The bullet digest rules conflict: you restrict headers to ### Issues, ### PRs, ### Highlights, but later instruct to put chart URLs under ### Charts. Either add ### Charts to the allowed headers list or remove/adjust the charts requirement to keep the constraints consistent.
- Total word count must not exceed 400 words
- Use minimal headers (### Issues, ### PRs, ### Highlights)
- One line per item, e.g. `- github/gh-aw#123 Fix login bug (merged by \`@alice\`)`
- No paragraphs, no haiku, no embedded charts (list chart URLs under ### Charts)
- No filler phrases ("Great news!", "The team has been busy")
  • Files reviewed: 2/2 changed files
  • Comments generated: 1

Write the daily news report using the following **fixed-section template** (always include every section, even if empty):

```markdown
## 📋 Daily Digest — {{date}}
Agent-Logs-Url: https://github.com/github/gh-aw/sessions/b6458008-98bf-4d4f-8455-044c2df6aa02

Co-authored-by: pelikhan <4175913+pelikhan@users.noreply.github.com>
@pelikhan pelikhan closed this May 8, 2026
Copilot stopped work on behalf of pelikhan due to an error May 8, 2026 11:36
@github-actions github-actions Bot deleted the copilot/ab-advisor-experiment-campaign-output-format branch May 16, 2026 03:00
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[ab-advisor] Experiment campaign for daily-news: A/B test output_format

3 participants