Flaky test: WithHttpCommand_ResultsInExpectedResultForStatusCode

[mitchdenny]

Build Information

Build: https://github.com/dotnet/aspire/actions/runs/13959173935/job/39077271364?pr=8189

Build error leg or test failing: Aspire.Hosting.Tests.WithHttpCommandTests.WithHttpCommand_ResultsInExpectedResultForStatusCode
Pull request: #5363

Error Message

Fill the error message using step by step known issues guidance.

{
  "ErrorMessage": "Assert.Equal() Failure: Values differ",
  "ErrorPattern": "",
  "BuildRetry": false,
  "ExcludeConsoleLog": true
}

Disabled in: #8189

https://github.com/dotnet/aspire/actions/runs/13959173935/job/39077271364?pr=8189

[xUnit.net 00:03:11.39]         | [2025-03-20T00:20:35] Aspire.Hosting.Dcp.dcp.start-apiserver Information: Shutdown complete.
  Failed Aspire.Hosting.Tests.WithHttpCommandTests.WithHttpCommand_ResultsInExpectedResultForStatusCode(statusCode: 200, expectSuccess: True) [32 s]
  Error Message:
   Assert.Equal() Failure: Values differ
Expected: True
Actual:   False
  Stack Trace:
     at Aspire.Hosting.Tests.WithHttpCommandTests.WithHttpCommand_ResultsInExpectedResultForStatusCode(Int32 statusCode, Boolean expectSuccess) in /_/tests/Aspire.Hosting.Tests/WithHttpCommandTests.cs:line 132
--- End of stack trace from previous location ---
  Standard Output Messages:

Github Actions Workflow runs report

In the last 50 runs 0 failed. Listing last 10 failures:

Run date	Outcome	Test Name

-- Updated on 4/15/2025 9:48:04 AM UTC

[eerhardt]

@DamianEdwards - looks like 4 of the HttpCommand tests are disabled.

• Flaky test: WithHttpCommandTests.WithHttpCommand_CallsPrepareRequestCallback_BeforeSendingRequest (dotnet/aspire#8192)
• WithHttpCommand_EnablesCommandOnceResourceIsRunning flaky (dotnet/aspire#8101)
• Flaky test: WithHttpCommand_CallsGetResponseCallback_AfterSendingRequest (dotnet/aspire#8200)

[DamianEdwards]

I think I'm going to rewrite these to use a mock HttpMessageHandler to try and avoid needing to hit a real service at all.

[radical]

@mitchdenny @DamianEdwards Is this a flaky test? It is marked with [QuarantinedTest] in the code.

[DamianEdwards]

Yeah

[radical]

In the last 53 runs 1 failed. Listing last 10 failures:

Run date	Outcome
Apr 5 8 AM	Failed