Skip to content

Quarantine flaky test TracingEnablesTheRightActivitySource_Keyed #9918

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 2 commits into from
Jun 17, 2025

Conversation

Copilot
Copy link
Contributor

@Copilot Copilot AI commented Jun 17, 2025

This PR quarantines the flaky test Aspire.Azure.AI.OpenAI.Tests.ConformanceTests.TracingEnablesTheRightActivitySource_Keyed by adding the [QuarantinedTest] attribute.

Changes Made

  • Added using Aspire.TestUtilities; import to enable use of the QuarantinedTestAttribute
  • Added [QuarantinedTest("https://github.com/dotnet/aspire/issues/9916")] attribute to the TracingEnablesTheRightActivitySource_Keyed test method

Impact

The flaky test is now excluded from regular CI test runs to prevent false negatives, but will continue to run in the outerloop workflow for monitoring. This follows the established pattern for handling flaky tests in the codebase.

Verification

  • ✅ Project builds successfully
  • ✅ Regular test runs now exclude the quarantined test (112 tests vs previous 113)
  • ✅ Quarantined test can still be run individually when filtering for quarantined=true trait

Fixes #9917.


💡 You can make Copilot smarter by setting up custom instructions, customizing its development environment and configuring Model Context Protocol (MCP) servers. Learn more Copilot coding agent tips in the docs.

Co-authored-by: radical <1472+radical@users.noreply.github.com>
@Copilot Copilot AI changed the title [WIP] Quarantine test 'Aspire.Azure.AI.OpenAI.Tests.ConformanceTests.TracingEnablesTheRightActivitySource_Keyed' via Copilot Quarantine flaky test TracingEnablesTheRightActivitySource_Keyed Jun 17, 2025
@Copilot Copilot AI requested a review from radical June 17, 2025 17:09
Copilot finished work on behalf of radical June 17, 2025 17:09
@radical radical marked this pull request as ready for review June 17, 2025 18:17
@Copilot Copilot AI review requested due to automatic review settings June 17, 2025 18:17
Copy link
Contributor

@Copilot Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull Request Overview

This PR quarantines a flaky test to prevent it from causing false negatives in regular CI test runs while still allowing it to be executed in the outerloop workflow.

  • Added a using directive for Aspire.TestUtilities to enable the QuarantinedTestAttribute.
  • Applied the [QuarantinedTest] attribute to the key-based test method to mark it as quarantined.

@joperezr joperezr merged commit 1eaad62 into main Jun 17, 2025
504 of 512 checks passed
@joperezr joperezr deleted the copilot/fix-9917 branch June 17, 2025 18:57
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Error loading sessions

Retrying...

Successfully merging this pull request may close these issues.

Quarantine test 'Aspire.Azure.AI.OpenAI.Tests.ConformanceTests.TracingEnablesTheRightActivitySource_Keyed' via Copilot
3 participants