Flaky tests: FSharpLint.Core.Tests.Rules.Conventions.FailwithBadUsage.TestConventionsFailwithBadUsage #763
Description
Sometimes we get one of the tests failing on CI, but it's not a deterministic failure, only happens sometimes:
Starting task 'DotNet:test': tests/FSharpLint.Core.Tests
/home/runner/work/FSharpLint/FSharpLint> "/usr/share/dotnet/dotnet" test tests/FSharpLint.Core.Tests --filter "\"TestCategory!=Performance\"" --configuration Release /nodeReuse:False /clp:ForceConsoleColor /bl:/tmp/tmpmUBq9m.tmp.binlog (In: false, Out: false, Err: false)
Determining projects to restore...
All projects are up-to-date for restore.
FSharpLint.Core -> /home/runner/work/FSharpLint/FSharpLint/src/FSharpLint.Core/bin/Release/net9.0/FSharpLint.Core.dll
FSharpLint.Core.Tests -> /home/runner/work/FSharpLint/FSharpLint/tests/FSharpLint.Core.Tests/bin/Release/net9.0/FSharpLint.Core.Tests.dll
Test run for /home/runner/work/FSharpLint/FSharpLint/tests/FSharpLint.Core.Tests/bin/Release/net9.0/FSharpLint.Core.Tests.dll (.NETCoreApp,Version=v9.0)
VSTest version 17.13.0 (x64)
Starting test execution, please wait...
A total of 1 test files matched the specified pattern.
Failed FailwithWithBadArgumentsDuplicateExceptionMessage [519 ms]
Error Message:
Expected: True
But was: False
Stack Trace:
at FSharpLint.Core.Tests.Rules.Conventions.FailwithBadUsage.TestConventionsFailwithBadUsage.FailwithWithBadArgumentsDuplicateExceptionMessage() in /home/runner/work/FSharpLint/FSharpLint/tests/FSharpLint.Core.Tests/Rules/Conventions/FailwithBadUsage.fs:line 72
1) at FSharpLint.Core.Tests.Rules.Conventions.FailwithBadUsage.TestConventionsFailwithBadUsage.FailwithWithBadArgumentsDuplicateExceptionMessage() in /home/runner/work/FSharpLint/FSharpLint/tests/FSharpLint.Core.Tests/Rules/Conventions/FailwithBadUsage.fs:line 72
Skipped Error for named tuple with spaces around colon [< 1 ms]
Failed! - Failed: 1, Passed: 823, Skipped: 1, Total: 825, Duration: 1 m 14 s - FSharpLint.Core.Tests.dll (net9.0)
Finished (Failed) 'DotNet:test' in 00:01:17.1815952
Finished (Failed) 'Test' in 00:01:17.1823105
---------------------------------------------------------------------
Build Time Report
---------------------------------------------------------------------
Target Duration
------ --------
Clean 00:00:00.0060674
Build 00:00:28.8553722
Test 00:01:17.1822021 (Exception of type 'Fake.DotNet.MSBuildException' was thrown.)
Default 00:00:00 (skipped)
Pack 00:00:00 (skipped)
Push 00:00:00 (skipped)
Total: 00:01:46.0882891
Status: Failure
---------------------------------------------------------------------
Fake.Core.BuildFailedException: Target 'Test' failed.
---> System.AggregateException: One or more errors occurred. (Exception of type 'Fake.DotNet.MSBuildException' was thrown.)
---> 'dotnet test tests/FSharpLint.Core.Tests' failed with exit code 1.
--- End of inner exception stack trace ---
--- End of inner exception stack trace ---
at Fake.Core.TargetModule.raiseIfError(OptionalTargetContext context) in D:\a\FAKE\FAKE\src\app\Fake.Core.Target\Target.fs:line 1319
at Fake.Core.TargetModule.runOrDefaultWithArguments(String defaultTarget) in D:\a\FAKE\FAKE\src\app\Fake.Core.Target\Target.fs:line 1542
at <StartupCode$FSI_0002>.$FSI_0002.main@() in /home/runner/work/FSharpLint/FSharpLint/build.fsx:line 279
at System.RuntimeMethodHandle.InvokeMethod(Object target, Void** arguments, Signature sig, Boolean isConstructor)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Object obj, BindingFlags invokeAttr)
Stopped due to error
From e.g. https://github.com/fsprojects/FSharpLint/actions/runs/16934748946/job/47988948992