[q] Improve daily-experiment-report with progressive disclosure and visual enhancements

[github-actions]

🎯 Objective

Improve the daily-experiment-report workflow to create more delightful, scannable reports using progressive disclosure and better markdown formatting.

📝 Changes Made

1. Progressive Disclosure Pattern

Before: All charts, ASCII tables, and statistics were displayed inline, creating a very long, overwhelming report.

After:

• Charts and detailed statistics wrapped in <details><summary> tags
• Critical information (summary, recommendations, quick stats) always visible
• Verbose content (tables, charts) hidden by default and expandable on demand

2. Quick Stats Section

Added a prominent Quick Stats section at the top of the report showing:

• Total experiments active
• Experiments ready for analysis
• Experiments with statistical significance
• Breakdown of recommendations (promote/extend/abandon)

3. Visual Progress Bars

Added Step 5.5 with Python helper code to generate Unicode progress bars showing min_samples progress:

███████░░░ 15/20 (75%)
██████████ 20/20 (100%)
██░░░░░░░░ 5/20 (25%)

These provide at-a-glance understanding of how close each variant is to having enough data.

4. Visual Enhancement Guidelines

Added explicit guidance on using:

• Emojis strategically (📊 for charts, ✅ for success, ⚠️ for warnings, ❌ for failures)
• Status badges for experiment state (🟢 READY, 🟡 COLLECTING, 🔴 FAILED)
• Text formatting (bold for recommendations, code blocks for variant names)

5. Improved Report Structure

Updated the discussion body structure template to:

• Lead with executive summary and quick stats (always visible)
• Wrap per-experiment details in collapsible sections
• Keep recommendations visible for easy scanning
• Move the full experiments table into a <details> section

📊 Example Comparison

Before (from discussion #33968):

#### `prompt_compression` · `agent-performance-analyzer`

> **Variants**: caveman · **Total runs**: 2

Experiment : prompt_compression
[Long ASCII table always visible]

Recommendation: EXTEND

After:

#### `prompt_compression` · `agent-performance-analyzer`

> **Variants**: caveman · **Total runs**: 2

<details>
<summary><b>📈 View Detailed Statistics</b></summary>

**Sample Sizes & Progress**
| Variant | Runs | Progress |
|---------|------|----------|
| caveman | 2 | ██░░░░░░░░ 2/20 (10%) |

[Charts and ASCII table]

</details>

**Recommendation: 🟡 EXTEND** — Continue collecting data

✅ Validation

agenticworkflows compile --workflows daily-experiment-report

Result: ✅ Workflow compiles successfully with no errors or warnings

🎨 Impact

These changes make the report:

1. More scannable - Key information visible at a glance
2. Less overwhelming - Long details hidden by default
3. More delightful - Visual progress bars and strategic emoji use
4. More actionable - Recommendations and quick stats front and center

📚 Related

• Triggered by: Discussion [experiments] Daily Experiment Report — 2026-05-22 #33968 comment
• Request: "/q make this report more delightful (better use of markdown, progressive disclosure)"
• Follows: shared/reporting.md guidelines for progressive disclosure

---

Warning

Protected Files — Push Permission Denied

This was originally intended as a pull request, but the patch modifies protected files. A human must create the pull request manually.

Protected files

• .github/workflows/daily-experiment-report.md

The push was rejected because GitHub Actions does not have workflows permission to push these changes, and is never allowed to make such changes, or other authorization being used does not have this permission.

Create the pull request manually

# Download the patch from the workflow run
gh run download 26294177605 -n agent -D /tmp/agent-26294177605

# Create a new branch
git checkout -b q-improve-experiment-report-formatting-4245777127c781c4 main

# Apply the patch (--3way handles cross-repo patches)
git am --3way /tmp/agent-26294177605/aw-q-improve-experiment-report-formatting.patch

# Push the branch and create the pull request
git push origin q-improve-experiment-report-formatting-4245777127c781c4
gh pr create --title '[q] Improve daily-experiment-report with progressive disclosure and visual enhancements' --base main --head q-improve-experiment-report-formatting-4245777127c781c4 --repo github/gh-aw

🎩 Equipped by Q · ● 1.5M · ◷

• expires on May 24, 2026, 2:48 PM UTC