SQL Server functional tests take twice as long after recent Arcade update

[ajcvickers]

Likely cause: external perf regression somewhere in .NET 9.0 Preview 5.

git checkout 9e6e342126d2831fd8a1aa2035e4b6d025a6447e <- Update dependencies from dotnet/arcade #34006
./test
Build succeeded in 738.3s


git checkout 33d7699b2e55d65dd50026fa6969219cdb3cd2cd
./test
Build succeeded in 325.6s

[maumar]

times on my machine ( .\test.cmd)
9e6e342 - Build succeeded in 409.7s
33d7699 - Build succeeded in 465.1s

so the issue doesn't repro for me.

this is on the new laptop though. Tried running on the slow machine but sadly failed, SqlServer tests all fail due to timeouts :) For context, on that machine InMemoryTests took 1485s (it's really old/slow)

[ajcvickers]

Following the latest runtime update, the tests now take four to six times as long as they did before!

git checkout 349f4bdedbe4d8b7e92698eb9884d30b93fa5a24
Build succeeded in 500.1s

git checkout 27ca3896cf101ab24476944a62ef2efded164edc
Build succeeded in 688.1s

git checkout bc170c77ddb9d61f6144aea3f9b1dc5be7510c55
Build succeeded in 447.3s

git checkout 1e1a8d84c91996654514706f538aacad55db3aa1
Build succeeded in 1368.8s

git checkout main
Build succeeded in 2041.5s

[ajcvickers]

Just for context, on my machine, at the start of .NET 9, these tests used to take approximately, but quite consistently, 5 minutes. With the latest .NET 9 runtime, they are now much slower and much more variable, with the fastest I have seen being ~21 minutes, and the slowest being ~33 minutes.

[roji]

Is this the same EF commit with different runtimes, or different EF commits? Just asking because if it's different EF commits it may be changes on our side, e.g. more tests added during 9 etc.

[ajcvickers]

@roji It's different commits. The commit before "Update dependencies from https://github.com/dotnet/runtime" still has the 2x slowdown. Checking out the commit for "Update dependencies from https://github.com/dotnet/runtime" (1e1a8d8) and building/testing that results in the additional slowdown. So the only code that changed was from "Update dependencies from https://github.com/dotnet/runtime".