Benchmarks for dotnet/runtime#132951 (for @EgorBo)

[EgorBot]

Processing benchmark request from issue dotnet/runtime#132951.

Benchmark: ASP.NET Core minimal API (requests/sec)
Targets: ubuntu24_azure_turin, ubuntu24_azure_cobalt100, ubuntu24_aws_graviton5
Commits: ae59a935c5338b1d3e4260bb7c1ec36d038eda9a;main

• ubuntu24_azure_turin: live logs
• ubuntu24_azure_cobalt100: live logs
• ubuntu24_aws_graviton5: live logs

Results will be posted here once they are ready.

[EgorBot]

ubuntu24_aws_graviton5 — Failed

@EgorBo

Agent failed with exit code 1

Job | Full logs

[EgorBot]

ubuntu24_azure_cobalt100 — Failed

@EgorBo

Agent failed with exit code 1

Job | Full logs

[EgorBot]

ubuntu24_azure_turin — Failed

@EgorBo

Cancelled by admin.

Job | Full logs

[EgorBo]

@EgorBot minimalapi -linux_amd -linux_arm -aws_graviton5 -commits main,61f59a1a75419872ba05379a140290cd4177dbb3~1 -profiler

[EgorBot]

Benchmark job submitted. The results will be posted here once they are ready.

• ubuntu24_azure_turin: live logs
• ubuntu24_azure_cobalt100: live logs
• ubuntu24_aws_graviton5: live logs

[EgorBot]

Results for ubuntu24_aws_graviton5

@EgorBo

ASP.NET Core minimal API -- throughput (requests/sec, higher is better)

Runtime	RPS	StdDev	Noise (CV)	Min .. Max	Ratio	Median latency (p50 / p90 / p99)
main	377,789	4,790	1.3%	371,395 .. 382,005	baseline	0.14 ms / 0.23 ms / 0.53 ms
61f59a1a~1	411,893	2,654	0.6%	409,545 .. 415,656	1.090 (+9.0%)	0.14 ms / 0.19 ms / 0.51 ms

RPS is the mean of 6 measured intervals per runtime; Noise (CV) is their coefficient of variation.

Configuration and per-interval results

• Fixed POST /api/customers/{customerId}/quotes: route + float, DateTimeOffset and string query parameters + header + nested JSON body
• System.Text.Json source-generated metadata contracts with reflection serialization disabled; JSON response includes calculated quote data
• linux-arm64, net11.0, self-contained
• 16 core(s) visible -- app pinned to 0,1,2,3,4,5,6,7, bombardier pinned to 8,9,10,11,12,13,14,15
• 64 connections, 30s warmup, 2 process(es) x 3 x 15s measured
• DOTNET_HillClimbing_Disable=1, DOTNET_gcServer=1

Runtime	Process	Interval	RPS	p50	p90	p99	non-2xx
main	1	1	371,395	0.15	0.24	0.48	0
main	1	2	382,005	0.14	0.23	0.54	0
main	1	3	381,255	0.14	0.23	0.53	0
main	2	1	372,019	0.15	0.24	0.53	0
main	2	2	380,633	0.14	0.23	0.48	0
main	2	3	379,424	0.14	0.23	0.53	0
61f59a1a~1	1	1	409,545	0.14	0.19	0.47	0
61f59a1a~1	1	2	414,219	0.14	0.18	0.53	0
61f59a1a~1	1	3	415,656	0.14	0.18	0.53	0
61f59a1a~1	2	1	409,597	0.14	0.19	0.47	0
61f59a1a~1	2	2	409,791	0.14	0.19	0.51	0
61f59a1a~1	2	3	412,551	0.14	0.19	0.52	0

Runtime assemblies come from each commit's Core_Root, which is not ReadyToRun-compiled. Compare rows from this job; do not compare its absolute RPS with released-runtime measurements.

Profiling artifacts

Supported perf events on this machine: perf_events.txt

MinimalApi:

	61f59a1a75419872ba05379a140290cd4177dbb3~1	main
flamegraph	link	link
functions	link	link
asm	link	link
stats	link	link
speedscope	link	link

Full logs

[EgorBot]

Results for ubuntu24_azure_cobalt100

@EgorBo

ASP.NET Core minimal API -- throughput (requests/sec, higher is better)

Runtime	RPS	StdDev	Noise (CV)	Min .. Max	Ratio	Median latency (p50 / p90 / p99)
main	155,467	2,582	1.7%	151,959 .. 158,055	baseline	0.34 ms / 0.71 ms / 1.19 ms
61f59a1a~1	155,059	2,710	1.7%	149,842 .. 157,054	0.997 (-0.3%)	0.34 ms / 0.69 ms / 1.20 ms

RPS is the mean of 6 measured intervals per runtime; Noise (CV) is their coefficient of variation.

Configuration and per-interval results

• Fixed POST /api/customers/{customerId}/quotes: route + float, DateTimeOffset and string query parameters + header + nested JSON body
• System.Text.Json source-generated metadata contracts with reflection serialization disabled; JSON response includes calculated quote data
• linux-arm64, net11.0, self-contained
• 16 core(s) visible -- app pinned to 0,1,2,3,4,5,6,7, bombardier pinned to 8,9,10,11,12,13,14,15
• 64 connections, 30s warmup, 2 process(es) x 3 x 15s measured
• DOTNET_HillClimbing_Disable=1, DOTNET_gcServer=1

Runtime	Process	Interval	RPS	p50	p90	p99	non-2xx
main	1	1	158,014	0.33	0.69	1.15	0
main	1	2	158,055	0.33	0.70	1.16	0
main	1	3	157,069	0.33	0.71	1.18	0
main	2	1	153,687	0.34	0.71	1.20	0
main	2	2	151,959	0.34	0.73	1.23	0
main	2	3	154,015	0.34	0.72	1.20	0
61f59a1a~1	1	1	149,842	0.36	0.71	1.25	0
61f59a1a~1	1	2	156,140	0.34	0.69	1.20	0
61f59a1a~1	1	3	157,054	0.34	0.69	1.20	0
61f59a1a~1	2	1	154,541	0.34	0.70	1.20	0
61f59a1a~1	2	2	155,876	0.34	0.69	1.19	0
61f59a1a~1	2	3	156,902	0.34	0.69	1.18	0

Runtime assemblies come from each commit's Core_Root, which is not ReadyToRun-compiled. Compare rows from this job; do not compare its absolute RPS with released-runtime measurements.

Profiling artifacts

Supported perf events on this machine: perf_events.txt

MinimalApi:

	61f59a1a75419872ba05379a140290cd4177dbb3~1	main
flamegraph	link	link
functions	link	link
asm	link	link
stats	link	link
speedscope	link	link

Full logs