Skip to content

Make criteria for unquarantining tests more strict#66518

Merged
wtgodbe merged 2 commits into
mainfrom
wtgodbe/WorkflowUpdates
Apr 28, 2026
Merged

Make criteria for unquarantining tests more strict#66518
wtgodbe merged 2 commits into
mainfrom
wtgodbe/WorkflowUpdates

Conversation

@wtgodbe
Copy link
Copy Markdown
Member

@wtgodbe wtgodbe commented Apr 28, 2026

  • Only unquarantine tests that have been quarantined for 60+ days, rather than 30+
  • If this workflow has ever re-quarantined a test (unquarantined, then immediately quarantined again because it was flaky), this workflow should never attempt to unquarantine that test again. Only a human should unquarantine such a test.
  • Add .github/agents/agentic-workflows.agent.md (automatically added by gh aw extension, useful for creating future agentic workflows)
  • Recompile all workflow files with latest version of gh aw

Copilot AI review requested due to automatic review settings April 28, 2026 17:15
@wtgodbe wtgodbe requested a review from a team as a code owner April 28, 2026 17:15
@github-actions github-actions Bot added the area-infrastructure Includes: MSBuild projects/targets, build scripts, CI, Installers and shared framework label Apr 28, 2026
Copy link
Copy Markdown
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Updates the test-quarantine agentic workflow guidance to be more conservative about when tests are automatically unquarantined, and refreshes generated workflow lock files using a newer gh aw compiler version.

Changes:

  • Tighten unquarantine eligibility: require [QuarantinedTest] to be present for 60+ days (was 30+).
  • Add a rule to permanently exclude tests from automated unquarantining if they’ve ever been re-quarantined.
  • Recompile *.lock.yml workflows with the latest gh aw output and add the new .github/agents/agentic-workflows.agent.md dispatcher agent doc.

Reviewed changes

Copilot reviewed 8 out of 8 changed files in this pull request and generated 1 comment.

Show a summary per file
File Description
.github/workflows/test-quarantine.md Updates unquarantine criteria (60-day minimum, never re-unquarantine re-quarantined tests) and rules text.
.github/workflows/test-quarantine.lock.yml Regenerated compiled workflow/lock output with updated tool/runtime scaffolding.
.github/workflows/issue-triage-agent.lock.yml Regenerated compiled workflow/lock output with updated tool/runtime scaffolding.
.github/workflows/cswin32-update.lock.yml Regenerated compiled workflow/lock output with updated tool/runtime scaffolding.
.github/workflows/community-pr-issue-check.lock.yml Regenerated compiled workflow/lock output with updated tool/runtime scaffolding.
.github/workflows/browsertesting-deps-update.lock.yml Regenerated compiled workflow/lock output with updated tool/runtime scaffolding.
.github/aw/actions-lock.json Bumps the pinned github/gh-aw-actions/setup version/sha used by gh-aw.
.github/agents/agentic-workflows.agent.md Adds an agent dispatcher doc for working with gh-aw workflows.

Comment thread .github/workflows/test-quarantine.md Outdated
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
@wtgodbe wtgodbe merged commit cd1fa16 into main Apr 28, 2026
10 checks passed
@wtgodbe wtgodbe deleted the wtgodbe/WorkflowUpdates branch April 28, 2026 19:53
@dotnet-policy-service dotnet-policy-service Bot added this to the 11.0-preview5 milestone Apr 28, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area-infrastructure Includes: MSBuild projects/targets, build scripts, CI, Installers and shared framework

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants