Benchmarks for dotnet/runtime#124614 (for @MihaZupan)

[EgorBot]

Processing benchmark request from PR dotnet/runtime#124614.

Targets: ubuntu24_helix_arm64, macos26_helix_arm64, ubuntu24_helix_x64, ubuntu24_azure_turin, ubuntu24_azure_milano
Commits: 202f33c8bbb326624532266e88cf492e638811ce

• ubuntu24_helix_arm64: live logs
• macos26_helix_arm64: live logs
• ubuntu24_helix_x64: live logs
• ubuntu24_azure_turin: live logs
• ubuntu24_azure_milano: live logs

Results will be posted here once they are ready.

[EgorBot]

ubuntu24_azure_milano — Failed

@MihaZupan

The template deployment 'egorbot-deploy-267fd8bb-5dfa-4b1a-ad26-8a0fe62ea1db' is not valid according to the validation procedure. The tracking id is '4dce78ef-25f1-4e10-875f-dabd3fde1d72'. See inner errors for details.
Status: 400 (Bad Request)
ErrorCode: InvalidTemplateDeployment

Content:
{"error":{"code":"InvalidTemplateDeployment","message":"The template deployment 'egorbot-deploy-267fd8bb-5dfa-4b1a-ad26-8a0fe62ea1db' is not valid according to the validation procedure. The tracking id is '4dce78ef-25f1-4e10-875f-dabd3fde1d72'. See inner errors for details.","details":[{"code":"SkuNotAvailable","message":"The requested VM size for resource 'Following SKUs have failed for Capacity Restrictions: Standard_D8ads_v5' is currently not available in location 'westeurope'. Please try another size or deploy to a different location or different zone. See https://aka.ms/azureskunotavailable for details."}]}}

Headers:
Cache-Control: no-cache
Pragma: no-cache
x-ms-failure-cause: REDACTED
x-ms-ratelimit-remaining-subscription-writes: REDACTED
x-ms-ratelimit-remaining-subscription-global-writes: REDACTED
x-ms-request-id: 4dce78ef-25f1-4e10-875f-dabd3fde1d72
x-ms-correlation-request-id: REDACTED
x-ms-routing-request-id: REDACTED
Strict-Transport-Security: REDACTED
X-Content-Type-Options: REDACTED
X-Cache: REDACTED
X-MSEdge-Ref: REDACTED
Date: Mon, 23 Feb 2026 22:26:52 GMT
Content-Length: 620
Content-Type: application/json; charset=utf-8
Expires: -1

Job | Full logs

[EgorBo]

Ouch 🤔

[EgorBot]

ubuntu24_helix_arm64 — Failed

@MihaZupan

Agent failed with exit code 1

Job | Full logs

[EgorBot]

ubuntu24_helix_x64 — Failed

@MihaZupan

Agent failed with exit code 1

Job | Full logs

[EgorBo]

ugh. I definitely broke something

[MihaZupan]

I just added ninja-build to the rest of the required things for apt

[EgorBot]

Results for macos26_helix_arm64

@MihaZupan

BenchmarkDotNet v0.15.8, macOS Tahoe 26.0.1 (25A362) [Darwin 25.0.0]
Apple M1, 1 CPU, 8 logical and 8 physical cores
.NET SDK 11.0.100-preview.3.26123.109
  [Host]    : .NET 10.0.3 (10.0.3, 10.0.326.7603), Arm64 RyuJIT armv8.0-a
  MediumRun : .NET 11.0.0 (11.0.0-dev, 42.42.42.42424), Arm64 RyuJIT armv8.0-a

Job=MediumRun  Toolchain=CoreRun  IterationCount=15  
LaunchCount=2  WarmupCount=10  

Method	Mean	Error
OneChar_Ascii	454.1 ns	1.77 ns
OneChar_NonAscii	463.8 ns	8.60 ns
TwoChar_AsciiCasedLetter	556.3 ns	0.20 ns
TwoChar_Ascii	556.1 ns	0.16 ns
TwoChar_NonAscii	542.6 ns	0.20 ns
ThreeChar_Ascii	690.3 ns	0.20 ns
ThreeChar_NonAscii	689.4 ns	0.68 ns
FourChar	887.7 ns	1.91 ns
FiveChar	1,083.4 ns	1.87 ns
Char_AsciiRange	520.0 ns	0.34 ns
Char_NonAsciiRange	508.2 ns	7.68 ns
FourChar_AsciiCasedLetter_SV	448.2 ns	1.33 ns
Char_AnyAscii_SV	447.6 ns	1.13 ns
Char_AsciiUniqueNibble_SV	372.1 ns	1.28 ns
Char_ProbMap_SV	895.0 ns	3.13 ns
Char_OneString_SV	554.3 ns	9.49 ns
Char_OneStringIgnoreCase_SV	683.0 ns	11.76 ns
Char_Teddy_SV	940.6 ns	3.97 ns
Char_TeddyIgnoreCase_SV	1,052.3 ns	8.96 ns

Full logs

[EgorBot]

Results for ubuntu24_azure_turin

@MihaZupan

BenchmarkDotNet v0.15.8, Linux Ubuntu 24.04.3 LTS (Noble Numbat)
AMD EPYC 9V45 2.60GHz, 1 CPU, 8 logical and 4 physical cores
.NET SDK 11.0.100-preview.3.26123.109
  [Host]    : .NET 10.0.3 (10.0.3, 10.0.326.7603), X64 RyuJIT x86-64-v4
  MediumRun : .NET 11.0.0 (11.0.0-dev, 42.42.42.42424), X64 RyuJIT x86-64-v4

Job=MediumRun  Toolchain=CoreRun  IterationCount=15  
LaunchCount=2  WarmupCount=10  

Method	Mean	Error
OneChar_Ascii	73.24 ns	0.405 ns
OneChar_NonAscii	108.22 ns	0.361 ns
TwoChar_AsciiCasedLetter	76.87 ns	0.232 ns
TwoChar_Ascii	149.51 ns	0.482 ns
TwoChar_NonAscii	290.80 ns	5.009 ns
ThreeChar_Ascii	200.74 ns	0.707 ns
ThreeChar_NonAscii	387.21 ns	1.047 ns
FourChar	473.00 ns	2.727 ns
FiveChar	563.23 ns	6.399 ns
Char_AsciiRange	73.71 ns	0.190 ns
Char_NonAsciiRange	201.20 ns	0.462 ns
FourChar_AsciiCasedLetter_SV	167.90 ns	2.143 ns
Char_AnyAscii_SV	151.73 ns	1.003 ns
Char_AsciiUniqueNibble_SV	120.51 ns	0.444 ns
Char_ProbMap_SV	274.76 ns	0.879 ns
Char_OneString_SV	229.61 ns	1.564 ns
Char_OneStringIgnoreCase_SV	246.93 ns	0.731 ns
Char_Teddy_SV	505.76 ns	1.234 ns
Char_TeddyIgnoreCase_SV	431.88 ns	59.602 ns

Full logs

[MihaZupan]

Local machine for reference:

BenchmarkDotNet v0.15.8, Windows 11 (10.0.26200.7840/25H2/2025Update/HudsonValley2)
AMD Ryzen 9 9950X 4.30GHz, 1 CPU, 32 logical and 16 physical cores
.NET SDK 11.0.100-preview.2.26102.119
  [Host]    : .NET 10.0.3 (10.0.3, 10.0.326.7603), X64 RyuJIT x86-64-v4
  MediumRun : .NET 10.0.3 (10.0.3, 10.0.326.7603), X64 RyuJIT x86-64-v4

Job=MediumRun  IterationCount=15  LaunchCount=2
WarmupCount=10

Method	Mean	Error	StdDev
OneChar_Ascii	70.27 ns	1.096 ns	1.572 ns
OneChar_NonAscii	98.70 ns	1.049 ns	1.505 ns
TwoChar_AsciiCasedLetter	69.76 ns	0.825 ns	1.156 ns
TwoChar_Ascii	134.22 ns	0.480 ns	0.703 ns
TwoChar_NonAscii	265.25 ns	2.988 ns	4.379 ns
ThreeChar_Ascii	182.77 ns	8.378 ns	12.539 ns
ThreeChar_NonAscii	339.24 ns	2.229 ns	3.197 ns
FourChar	410.20 ns	2.501 ns	3.666 ns
FiveChar	491.09 ns	2.297 ns	3.367 ns
Char_AsciiRange	65.89 ns	0.413 ns	0.605 ns
Char_NonAsciiRange	361.43 ns	5.529 ns	7.750 ns
FourChar_AsciiCasedLetter_SV	146.53 ns	2.211 ns	3.241 ns
Char_AnyAscii_SV	136.56 ns	0.843 ns	1.125 ns
Char_AsciiUniqueNibble_SV	114.13 ns	1.163 ns	1.705 ns
Char_ProbMap_SV	243.25 ns	1.837 ns	2.749 ns
Char_OneString_SV	203.63 ns	1.076 ns	1.509 ns
Char_OneStringIgnoreCase_SV	218.84 ns	2.735 ns	3.833 ns
Char_Teddy_SV	221.71 ns	1.082 ns	1.585 ns
Char_TeddyIgnoreCase_SV	222.19 ns	1.250 ns	1.626 ns