[Flaky Test] Microsoft.Build.Tasks.UnitTests.RoslynCodeTaskFactory_Tests.RoslynCodeTaskFactory_ReuseCompilation

[github-actions]

Flaky-test key (automated de-duplication — do not edit):

flaky-test-id: Microsoft.Build.Tasks.UnitTests.RoslynCodeTaskFactory_Tests.RoslynCodeTaskFactory_ReuseCompilation

Evidence

• Distinct sources: 3 (3 rolling main builds)
• Affected PRs: none
• Rolling build IDs: 1496519, 1506834, 1514373
• Legs / TFMs: FullOnWindows, FullOnWindows Release / net472
• Assembly: Microsoft.Build.Tasks.UnitTests
• Fully-qualified test name: Microsoft.Build.Tasks.UnitTests.RoslynCodeTaskFactory_Tests.RoslynCodeTaskFactory_ReuseCompilation
• First seen: 2026-07-07 | Last seen: 2026-07-17
• Distinct error hashes: 3 (indicates nondeterministic failure)
• Sample error:

  Shouldly.ShouldAssertException : env.CreateTestProjectWithFiles(...) assertion failure on build messages
  

• Sample build: https://dev.azure.com/dnceng-public/public/_build/results?buildId=1496519

Notes

This test will be quarantined via [ActiveIssue("<issue url>")] (from Microsoft.DotNet.XUnitV3Extensions, namespace Xunit) on a follow-up automated run once this issue has a real number. The quarantine stamps Category=failing, which normal CI excludes, and the quarantine pipeline (def 344) re-runs it on all platforms to gather signal over time. The underlying nondeterminism should be investigated and fixed by the auto-fixer workflow or a human.

Warning

Firewall blocked 1 domain

The following domain was blocked by the firewall during workflow execution:

• awmgmcpg

To allow these domains, add them to the network.allowed list in your workflow frontmatter:

network:
  allowed:
    - defaults
    - "awmgmcpg"

See Network Configuration for more information.

Generated by Flaky Test Triage · 108 AIC · ⌖ 7.61 AIC · ⊞ 13.5K · ◷

[github-actions]

This test has been quarantined via [ActiveIssue] in PR #aw_pr1 (branch flaky-test/quarantine-2026-07-20). Evidence: 3 independent rolling CI builds (1496519, 1506834, 1514373) across FullOnWindows net472, 3 distinct error hashes, first seen 2026-07-07, last seen 2026-07-17.

Warning

Firewall blocked 2 domains

The following domains were blocked by the firewall during workflow execution:

• awmgmcpg
• southcentralus0.in.applicationinsights.azure.com

To allow these domains, add them to the network.allowed list in your workflow frontmatter:

network:
  allowed:
    - defaults
    - "awmgmcpg"
    - "southcentralus0.in.applicationinsights.azure.com"

See Network Configuration for more information.

Generated by Flaky Test Triage · 123.6 AIC · ⌖ 6.99 AIC · ⊞ 14.8K · ◷

[github-actions]

Updated evidence (automated triage, 2026-07-22)

This test continues to flake. Latest scan (last 14 days on main):

Field	Value
Distinct sources	3 (0 PRs + 3 rolling builds)
Rolling builds	1506834, 1514373, 1517682
Legs	FullOnWindows Release
TFMs	net472
First seen	2026-07-13
Last seen	2026-07-20
Error hashes	64e60107, 4eca6c51 (2 distinct — non-deterministic)
Sample build	1506834

Sample error: Shouldly.ShouldAssertException (compilation reuse assertion failure)

Test is already quarantined via [ActiveIssue]. The quarantine pipeline (def 344) continues gathering signal.

Warning

Firewall blocked 1 domain

The following domain was blocked by the firewall during workflow execution:

• awmgmcpg

To allow these domains, add them to the network.allowed list in your workflow frontmatter:

network:
  allowed:
    - defaults
    - "awmgmcpg"

See Network Configuration for more information.

Generated by Flaky Test Triage · 117.5 AIC · ⌖ 5.7 AIC · ⊞ 14.8K · ◷

[github-actions]

Automated flaky-test detector update (2026-07-25)

This test continues to fail intermittently. New evidence from the past 14 days:

Field	Value
Distinct sources	3 (3 rolling builds)
Rolling builds	1506834, 1514373, 1517682
Distinct error hashes	2
First seen	2026-07-13
Last seen	2026-07-20

The test remains quarantined via [ActiveIssue]. The quarantine pipeline (def 344) continues collecting signal.

Warning

Firewall blocked 1 domain

The following domain was blocked by the firewall during workflow execution:

• awmgmcpg

To allow these domains, add them to the network.allowed list in your workflow frontmatter:

network:
  allowed:
    - defaults
    - "awmgmcpg"

See Network Configuration for more information.

Generated by Flaky Test Triage · 190.7 AIC · ⌖ 7.39 AIC · ⊞ 14.8K · ◷