Skip to content

Add daily HTML-change → Playwright test generator workflow#43421

Closed
pelikhan with Copilot wants to merge 4 commits into
mainfrom
copilot/analyze-code-changes-web-tests
Closed

Add daily HTML-change → Playwright test generator workflow#43421
pelikhan with Copilot wants to merge 4 commits into
mainfrom
copilot/analyze-code-changes-web-tests

Conversation

Copilot AI commented Jul 4, 2026

Copy link
Copy Markdown
Contributor

Introduces html-web-test-generator, a scheduled agentic workflow that detects HTML file changes from the last 24 hours and auto-generates Playwright specs for any uncovered pages.

Workflow design

  • Trigger: schedule: daily on weekdays + workflow_dispatch
  • Phase 1 – Discover: git log --since="24 hours ago" -- "*.html" to collect modified HTML paths
  • Phase 2 – Gap check: derives expected docs/tests/<slug>.spec.ts for each file; skips files already covered
  • Phase 3 – Generate: writes specs following existing docs/tests/ conventions — @playwright/test, test.describe, beforeEach nav + networkidle, ≥3 tests per page (render, interactivity, a11y basics)
  • Phase 4 – PR: opens a draft PR scoped strictly to docs/tests/**/*.spec.ts with a structured report body

Safety / scope

  • Agent job is read-only; all writes go through create-pull-request safe output
  • allowed-files restricted to docs/tests/**/*.spec.ts — no other paths can be touched
  • noop on: no HTML changes, full coverage already present, or purely non-functional edits (whitespace/comments)

Copilot AI and others added 3 commits July 4, 2026 17:23
Co-authored-by: pelikhan <4175913+pelikhan@users.noreply.github.com>
Co-authored-by: pelikhan <4175913+pelikhan@users.noreply.github.com>
Co-authored-by: pelikhan <4175913+pelikhan@users.noreply.github.com>
Copilot AI changed the title Add html-web-test-generator workflow Add daily HTML-change → Playwright test generator workflow Jul 4, 2026
Copilot AI requested a review from pelikhan July 4, 2026 17:28
@pelikhan

pelikhan commented Jul 4, 2026

Copy link
Copy Markdown
Collaborator

@copilot optimize

Co-authored-by: pelikhan <4175913+pelikhan@users.noreply.github.com>

Copilot AI commented Jul 4, 2026

Copy link
Copy Markdown
Contributor Author

@copilot optimize

Applied in d30d26d. Changes made:

  • DataOps pre-step: git log + coverage-gap detection moved into a deterministic steps: shell script that writes a compact JSON to /tmp/gh-aw/data/html-changes.json. The agent reads that file directly instead of executing discovery commands turn-by-turn — eliminates the most token-heavy phases.
  • Removed unused tools: dropped github (gh-proxy) and actions: read permission — neither was used by the agent.
  • Shrunk bash allowlist: from 11 entries down to cat * and date * (all the agent needs post-DataOps).
  • Removed github network domain: no longer needed without the gh-proxy tool.
  • Added max-ai-credits: 500 cap to guard per-run spend.
  • Trimmed prompt: ~50% shorter now that discovery/coverage logic lives in the pre-step rather than the prompt body.

@github-actions

github-actions Bot commented Jul 4, 2026

Copy link
Copy Markdown
Contributor

🤖 PR Triage — Run §28715668077

Field Value
Category feature
Risk 🟡 Medium
Score 28/100
Impact 18/50
Urgency 6/30
Quality 4/20
Action defer
Batch pr-batch:new-workflows

Adds daily HTML-change Playwright test generator workflow. +1681+112 new workflow files. Draft, no CI, large addition. Defer for focused review.

Generated by 🔧 PR Triage Agent · 113.5 AIC · ⌖ 13 AIC · ⊞ 5.5K ·

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants