Skip to content

[Perf] Regressions from inliner policy change #114996

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
performanceautofiler bot opened this issue Apr 24, 2025 · 7 comments
Open

[Perf] Regressions from inliner policy change #114996

performanceautofiler bot opened this issue Apr 24, 2025 · 7 comments
Assignees
Labels
arch-arm64 area-CodeGen-coreclr CLR JIT compiler in src/coreclr/src/jit and related components such as SuperPMI os-linux Linux OS (any supported distro) runtime-coreclr specific to the CoreCLR runtime
Milestone

Comments

@performanceautofiler
Copy link

Run Information

Name Value
Architecture arm64
OS ubuntu 22.04
Queue AmpereUbuntu
Baseline 27d23218a56d484638692d56b3abd27e0b21b591
Compare d9c4c3e73dcf09435a3cc1cabb23584c9f24b504
Diff Diff
Configs CompilationMode:tiered, RunKind:micro

Regressions in System.Memory.ReadOnlySpan

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
39.46 ns 45.49 ns 1.15 0.00 False
250.88 ns 300.80 ns 1.20 0.11 False
22.82 ns 28.21 ns 1.24 0.00 False
30.78 ns 36.42 ns 1.18 0.00 False
27.12 ns 32.08 ns 1.18 0.00 False

graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Memory.ReadOnlySpan*'

System.Memory.ReadOnlySpan.IndexOfString(input: "foobardzsdzs", value: "rddzs", comparisonType: InvariantCulture)

ETL Files

Histogram

JIT Disasms

System.Memory.ReadOnlySpan.IndexOfString(input: "AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAXAAAAAAAAAAAAAAAAAAAAAAAAAAAAA", value: "x", comparisonType: InvariantCultureIgnoreCase)

ETL Files

Histogram

JIT Disasms

System.Memory.ReadOnlySpan.IndexOfString(input: "ABCDE", value: "c", comparisonType: InvariantCultureIgnoreCase)

ETL Files

Histogram

JIT Disasms

System.Memory.ReadOnlySpan.IndexOfString(input: "string1", value: "string2", comparisonType: InvariantCulture)

ETL Files

Histogram

JIT Disasms

System.Memory.ReadOnlySpan.IndexOfString(input: "AAAAA5AAAA", value: "5", comparisonType: InvariantCulture)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture arm64
OS ubuntu 22.04
Queue AmpereUbuntu
Baseline 27d23218a56d484638692d56b3abd27e0b21b591
Compare d9c4c3e73dcf09435a3cc1cabb23584c9f24b504
Diff Diff
Configs CompilationMode:tiered, RunKind:micro

Regressions in System.Text.Json.Tests.Perf_Basic

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
1.82 ms 2.02 ms 1.11 0.01 False
569.82 ns 632.04 ns 1.11 0.00 False
1.78 ms 2.04 ms 1.15 0.00 False
606.24 ns 661.19 ns 1.09 0.00 False

graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.Json.Tests.Perf_Basic*'

System.Text.Json.Tests.Perf_Basic.WriteBasicUtf16(Formatted: False, SkipValidation: True, DataSize: 100000)

ETL Files

Histogram

JIT Disasms

System.Text.Json.Tests.Perf_Basic.WriteBasicUtf8(Formatted: False, SkipValidation: True, DataSize: 10)

ETL Files

Histogram

JIT Disasms

System.Text.Json.Tests.Perf_Basic.WriteBasicUtf8(Formatted: False, SkipValidation: True, DataSize: 100000)

ETL Files

Histogram

JIT Disasms

System.Text.Json.Tests.Perf_Basic.WriteBasicUtf8(Formatted: False, SkipValidation: False, DataSize: 10)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture arm64
OS ubuntu 22.04
Queue AmpereUbuntu
Baseline 27d23218a56d484638692d56b3abd27e0b21b591
Compare d9c4c3e73dcf09435a3cc1cabb23584c9f24b504
Diff Diff
Configs CompilationMode:tiered, RunKind:micro

Regressions in System.Tests.Perf_Guid

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
33.19 ns 35.91 ns 1.08 0.01 False
33.05 ns 36.90 ns 1.12 0.01 False

graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_Guid*'

System.Tests.Perf_Guid.ctor_str

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Guid.ParseExactD

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture arm64
OS ubuntu 22.04
Queue AmpereUbuntu
Baseline 27d23218a56d484638692d56b3abd27e0b21b591
Compare d9c4c3e73dcf09435a3cc1cabb23584c9f24b504
Diff Diff
Configs CompilationMode:tiered, RunKind:micro

Regressions in System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
231.75 μs 244.13 μs 1.05 0.00 False
158.99 μs 166.98 μs 1.05 0.00 False

graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock*'

System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "(?i)Holmes", Options: None)

ETL Files

Histogram

JIT Disasms

System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "(?i)Sherlock Holmes", Options: NonBacktracking)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture arm64
OS ubuntu 22.04
Queue AmpereUbuntu
Baseline 27d23218a56d484638692d56b3abd27e0b21b591
Compare d9c4c3e73dcf09435a3cc1cabb23584c9f24b504
Diff Diff
Configs CompilationMode:tiered, RunKind:micro

Regressions in System.Buffers.Tests.RentReturnArrayPoolTests<Byte>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
337.73 ns 407.52 ns 1.21 0.03 False
54.42 μs 61.41 μs 1.13 0.43 False
8.46 μs 9.47 μs 1.12 0.06 False

graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Buffers.Tests.RentReturnArrayPoolTests&lt;Byte&gt;*'

System.Buffers.Tests.RentReturnArrayPoolTests<Byte>.MultipleSerial(RentalSize: 4096, ManipulateArray: False, Async: False, UseSharedPool: False)

ETL Files

Histogram

JIT Disasms

System.Buffers.Tests.RentReturnArrayPoolTests<Byte>.SingleParallel(RentalSize: 4096, ManipulateArray: True, Async: False, UseSharedPool: False)

ETL Files

Histogram

JIT Disasms

System.Buffers.Tests.RentReturnArrayPoolTests<Byte>.SingleParallel(RentalSize: 4096, ManipulateArray: False, Async: False, UseSharedPool: False)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture arm64
OS ubuntu 22.04
Queue AmpereUbuntu
Baseline 27d23218a56d484638692d56b3abd27e0b21b591
Compare d9c4c3e73dcf09435a3cc1cabb23584c9f24b504
Diff Diff
Configs CompilationMode:tiered, RunKind:micro

Regressions in System.Text.Json.Document.Tests.Perf_ParseThenWrite

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
19.70 μs 22.00 μs 1.12 0.04 False
13.30 μs 16.23 μs 1.22 0.01 False
1.39 ms 1.65 ms 1.19 0.28 False

graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.Json.Document.Tests.Perf_ParseThenWrite*'

System.Text.Json.Document.Tests.Perf_ParseThenWrite.ParseThenWrite(IsDataIndented: True, TestCase: DeepTree)

ETL Files

Histogram

JIT Disasms

System.Text.Json.Document.Tests.Perf_ParseThenWrite.ParseThenWrite(IsDataIndented: False, TestCase: Json4KB)

ETL Files

Histogram

JIT Disasms

System.Text.Json.Document.Tests.Perf_ParseThenWrite.ParseThenWrite(IsDataIndented: False, TestCase: Json400KB)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture arm64
OS ubuntu 22.04
Queue AmpereUbuntu
Baseline 27d23218a56d484638692d56b3abd27e0b21b591
Compare d9c4c3e73dcf09435a3cc1cabb23584c9f24b504
Diff Diff
Configs CompilationMode:tiered, RunKind:micro

Regressions in System.Globalization.Tests.StringSearch

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
821.17 ns 898.62 ns 1.09 0.01 False
541.36 ns 614.16 ns 1.13 0.11 False
539.89 ns 613.38 ns 1.14 0.11 False
821.32 ns 901.57 ns 1.10 0.01 False
540.29 ns 613.34 ns 1.14 0.10 False
852.78 ns 926.97 ns 1.09 0.09 False

graph
graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Globalization.Tests.StringSearch*'

System.Globalization.Tests.StringSearch.IndexOf_Word_NotFound(Options: (en-US, IgnoreCase, False))

ETL Files

Histogram

JIT Disasms

System.Globalization.Tests.StringSearch.IndexOf_Word_NotFound(Options: (, None, False))

ETL Files

Histogram

JIT Disasms

System.Globalization.Tests.StringSearch.IndexOf_Word_NotFound(Options: (en-US, IgnoreNonSpace, False))

ETL Files

Histogram

JIT Disasms

System.Globalization.Tests.StringSearch.IndexOf_Word_NotFound(Options: (, IgnoreCase, False))

ETL Files

Histogram

JIT Disasms

System.Globalization.Tests.StringSearch.IndexOf_Word_NotFound(Options: (en-US, None, False))

ETL Files

Histogram

JIT Disasms

System.Globalization.Tests.StringSearch.LastIndexOf_Word_NotFound(Options: (en-US, IgnoreCase, False))

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture arm64
OS ubuntu 22.04
Queue AmpereUbuntu
Baseline 27d23218a56d484638692d56b3abd27e0b21b591
Compare d9c4c3e73dcf09435a3cc1cabb23584c9f24b504
Diff Diff
Configs CompilationMode:tiered, RunKind:micro

Regressions in System.Buffers.Tests.RentReturnArrayPoolTests<Object>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
339.43 ns 398.33 ns 1.17 0.02 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Buffers.Tests.RentReturnArrayPoolTests&lt;Object&gt;*'

System.Buffers.Tests.RentReturnArrayPoolTests<Object>.MultipleSerial(RentalSize: 4096, ManipulateArray: False, Async: False, UseSharedPool: False)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture arm64
OS ubuntu 22.04
Queue AmpereUbuntu
Baseline 27d23218a56d484638692d56b3abd27e0b21b591
Compare d9c4c3e73dcf09435a3cc1cabb23584c9f24b504
Diff Diff
Configs CompilationMode:tiered, RunKind:micro

Regressions in System.Text.Json.Tests.Utf8JsonReaderCommentsTests

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
4.41 μs 4.78 μs 1.08 0.00 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.Json.Tests.Utf8JsonReaderCommentsTests*'

System.Text.Json.Tests.Utf8JsonReaderCommentsTests.Utf8JsonReaderCommentParsing(CommentHandling: Skip, SegmentSize: 0, TestCase: LongMultiLine)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture arm64
OS ubuntu 22.04
Queue AmpereUbuntu
Baseline 27d23218a56d484638692d56b3abd27e0b21b591
Compare d9c4c3e73dcf09435a3cc1cabb23584c9f24b504
Diff Diff
Configs CompilationMode:tiered, RunKind:micro

Regressions in System.Globalization.Tests.StringEquality

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
1.38 μs 1.72 μs 1.25 0.00 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Globalization.Tests.StringEquality*'

System.Globalization.Tests.StringEquality.Compare_Same(Count: 1024, Options: (en-US, OrdinalIgnoreCase))

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

@performanceautofiler performanceautofiler bot added arch-arm64 os-linux Linux OS (any supported distro) runtime-coreclr specific to the CoreCLR runtime untriaged New issue has not been triaged by the area owner labels Apr 24, 2025
Copy link
Author

Run Information

Name Value
Architecture arm64
OS ubuntu 22.04
Queue AmpereUbuntu
Baseline 27d23218a56d484638692d56b3abd27e0b21b591
Compare d9c4c3e73dcf09435a3cc1cabb23584c9f24b504
Diff Diff
Configs CompilationMode:tiered, RunKind:micro

Regressions in System.Collections.Sort<BigStruct>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
20.39 μs 22.32 μs 1.09 0.11 False
20.54 μs 21.97 μs 1.07 0.06 False

graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.Sort&lt;BigStruct&gt;*'

System.Collections.Sort<BigStruct>.LinqOrderByExtension(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.Sort<BigStruct>.LinqQuery(Size: 512)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture arm64
OS ubuntu 22.04
Queue AmpereUbuntu
Baseline 27d23218a56d484638692d56b3abd27e0b21b591
Compare d9c4c3e73dcf09435a3cc1cabb23584c9f24b504
Diff Diff
Configs CompilationMode:tiered, RunKind:micro

Regressions in System.Text.Json.Serialization.Tests.WriteJson<ImmutableSortedDictionary<String, String>>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
9.13 μs 10.34 μs 1.13 0.29 False
10.27 μs 12.48 μs 1.21 0.28 False

graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.Json.Serialization.Tests.WriteJson&lt;ImmutableSortedDictionary&lt;String, String&gt;&gt;*'

System.Text.Json.Serialization.Tests.WriteJson<ImmutableSortedDictionary<String, String>>.SerializeToUtf8Bytes(Mode: SourceGen)

ETL Files

Histogram

JIT Disasms

System.Text.Json.Serialization.Tests.WriteJson<ImmutableSortedDictionary<String, String>>.SerializeToString(Mode: SourceGen)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

@AndyAyersMS
Copy link
Member

#114821

@AndyAyersMS AndyAyersMS removed the untriaged New issue has not been triaged by the area owner label Apr 24, 2025
@AndyAyersMS AndyAyersMS transferred this issue from dotnet/perf-autofiling-issues Apr 24, 2025
@ghost ghost added the needs-area-label An area label is needed to ensure this gets routed to the appropriate area owners label Apr 24, 2025
@dotnet-policy-service dotnet-policy-service bot added the untriaged New issue has not been triaged by the area owner label Apr 24, 2025
@AndyAyersMS AndyAyersMS changed the title [Perf] Linux/arm64: 32 Regressions on 4/21/2025 2:03:19 AM +00:00 [Perf] Regressions from inliner policy change Apr 24, 2025
@AndyAyersMS
Copy link
Member

AndyAyersMS commented Apr 24, 2025

Related regressions:

More reports (possibly dups):

@jeffschwMSFT jeffschwMSFT added the area-CodeGen-coreclr CLR JIT compiler in src/coreclr/src/jit and related components such as SuperPMI label Apr 25, 2025
Copy link
Contributor

Tagging subscribers to this area: @JulieLeeMSFT, @jakobbotsch
See info in area-owners.md if you want to be subscribed.

@JulieLeeMSFT JulieLeeMSFT removed untriaged New issue has not been triaged by the area owner needs-area-label An area label is needed to ensure this gets routed to the appropriate area owners labels Apr 25, 2025
@JulieLeeMSFT JulieLeeMSFT added this to the 10.0.0 milestone Apr 25, 2025
@AndyAyersMS
Copy link
Member

It also looks like there is a substantial increase in ASP.NET app startup time, likely (but not yet confirmed) from this change. @sebastienros FYI

Image

If so, we may need to be more aggressive about marking "noinline" for methods that are unlikely to ever be good inline candidates even under PGO. Seems like we could study the distribution of rejected/accepted discretionary inlines and perhaps spot some good critiera (eg what characterizes methods that are always rejected).

@AndyAyersMS
Copy link
Member

AndyAyersMS commented Apr 28, 2025

It also looks like there is a substantial increase in ASP.NET app startup time, likely (but not yet confirmed) from this change. @sebastienros FYI

The "disabled PGO" run shows the same impact, and this change should only affect behavior when PGO is enabled. So perhaps the root cause is something else?

Commit range seems to be 8c3a2e1...e1702c3

Likewise the "full PGO" shows no change (disables R2R), if this was JIT related we'd expect it to show a slowdown too.

Wonder if somehow R2R images were invalidated and we've just ended jitting more methods at startup?

@AndyAyersMS
Copy link
Member

Collated data

Notes Recent Score Orig Score arm64 ubuntu x64 ubuntu x64 Windows Viper Ubuntu Viper Windows Benchmark
2.69 2.59 2.69
2.59
System.Globalization.Tests.StringEquality.Compare_Same_Upper(Count: 1024, Options: (en-US, OrdinalIgnoreCase))
2.58 2.71 2.58
2.71
System.Buffers.Text.Tests.Utf8FormatterTests.FormatterInt32(value: 4)
1.94 1.94 1.94
1.94
System.Globalization.Tests.StringSearch.LastIndexOf_Word_NotFound(Options: (en-US, None, False))
1.94 1.63 1.94
1.63
System.Globalization.Tests.StringSearch.LastIndexOf_Word_NotFound(Options: (, None, False))
1.76 1.14 1.76
1.14
System.Collections.Sort(Int32).Array_Comparison(Size: 512)
1.62 1.73 1.62
1.73
System.Globalization.Tests.StringSearch.LastIndexOf_Word_NotFound(Options: (, IgnoreCase, False))
1.59 1.39 1.59
1.39
System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Leipzig.Count(Pattern: "\p{Sm}", Options: NonBacktracking)
1.47 1.39 1.47
1.50
System.Buffers.Text.Tests.Utf8ParserTests.TryParseUInt64(value: 18446744073709551615)
1.47 1.31 1.46
1.33
System.IO.Tests.Perf_Path.GetFullPathNoRedundantSegments
1.46 1.45 1.25
1.25
1.69
1.69
System.Globalization.Tests.StringEquality.Compare_Same(Count: 1024, Options: (en-US, OrdinalIgnoreCase))
1.41 1.36 1.43
1.38
System.Collections.CtorFromCollection(Int32).Stack(Size: 512)
1.41 1.42 1.41
1.44
System.Memory.Span(Byte).LastIndexOfValue(Size: 512)
1.37 1.39 1.37
1.39
System.Buffers.Text.Tests.Utf8FormatterTests.FormatterInt32(value: -2147483648)
1.35 1.37 1.35
1.37
System.Buffers.Tests.RentReturnArrayPoolTests(Byte).SingleSerial(RentalSize: 4096, ManipulateArray: True, Async: True, UseSharedPool: True)
1.35 1.36 1.36
1.38
System.Collections.CtorFromCollection(Int32).Queue(Size: 512)
1.34 1.48 1.66
1.66
1.09
1.25
System.Collections.ContainsTrue(String).Queue(Size: 512)
1.33 1.33 1.09
1.09
1.63
1.63
System.Globalization.Tests.StringSearch.LastIndexOf_Word_NotFound(Options: (en-US, IgnoreCase, False))
1.33 1.33 1.34
1.34
System.Buffers.Text.Tests.Utf8ParserTests.TryParseDecimal(value: 123456.789)
1.32 1.34 1.50
1.35
1.17
1.36
System.Collections.ContainsFalse(String).Queue(Size: 512)
1.30 1.25 1.31
1.25
System.Buffers.Text.Tests.Utf8FormatterTests.FormatterDecimal(value: 123456.789)
1.30 1.29 1.27
1.27
System.Text.Json.Tests.Perf_Get.GetDecimal
1.29 1.09 1.29
1.09
System.Net.Sockets.Tests.SocketSendReceivePerfTest.ReceiveAsyncThenSendAsync_Task
1.27 1.29 1.28
1.30
System.Collections.CtorFromCollection(Int32).List(Size: 512)
1.27 1.28 1.19
1.21
1.38
1.38
System.Text.Json.Document.Tests.Perf_ParseThenWrite.ParseThenWrite(IsDataIndented: True, TestCase: Json4KB)
1.25 1.26 1.25
1.26
System.Net.Tests.Perf_WebUtility.Decode_DecodingRequired
1.25 1.23 1.25
1.23
System.Buffers.Tests.RentReturnArrayPoolTests(Byte).SingleSerial(RentalSize: 4096, ManipulateArray: False, Async: False, UseSharedPool: True)
1.24 1.26 1.16
1.17
1.34
1.36
System.Text.Json.Document.Tests.Perf_ParseThenWrite.ParseThenWrite(IsDataIndented: True, TestCase: Json400KB)
1.24 1.26 1.24
1.26
System.Buffers.Text.Tests.Utf8FormatterTests.FormatterInt32(value: 2147483647)
1.24 1.22 1.24
1.23
System.IO.Tests.BinaryWriterExtendedTests.WriteAsciiString(StringLengthInChars: 8000)
1.23 1.23 1.23
1.26
System.IO.Tests.BinaryWriterExtendedTests.WriteAsciiCharArray(StringLengthInChars: 8000)
1.23 1.23 1.30
1.31
1.16
1.15
Benchmark.GetChildKeysTests.AddChainedConfigurationEmpty
1.22 1.27 1.22
1.27
System.Buffers.Text.Tests.Utf8ParserTests.TryParseUInt64(value: 12345)
1.22 1.22 1.22
1.22
System.Collections.Sort(Int32).LinqQuery(Size: 512)
1.20 1.19 1.19
1.18
System.Collections.CtorFromCollection(Int32).ImmutableArray(Size: 512)
1.19 1.19 1.19
1.18
System.Globalization.Tests.StringSearch.IsPrefix_FirstHalf(Options: (en-US, Ordinal, False))
1.18 1.19 1.18
1.20
System.IO.Tests.Perf_Path.GetFullPathForLegacyLength
1.17 1.13 1.17
1.13
System.Buffers.Tests.RentReturnArrayPoolTests(Byte).SingleParallel(RentalSize: 4096, ManipulateArray: True, Async: False, UseSharedPool: False)
1.17 1.14 1.17
1.14
System.Memory.Span(Char).LastIndexOfValue(Size: 512)
1.16 1.13 1.18
1.19
1.12
1.16
1.26
1.10
1.11
1.12
System.Text.Json.Document.Tests.Perf_ParseThenWrite.ParseThenWrite(IsDataIndented: False, TestCase: Json400KB)
1.16 1.15 1.18
1.18
System.Text.Tests.Perf_Encoding.GetBytes(size: 512, encName: "utf-8")
1.16 1.13 1.13
1.15
1.07
1.06
1.20
1.21
1.30
1.15
1.14
1.14
System.Text.Json.Tests.Perf_Basic.WriteBasicUtf8(Formatted: False, SkipValidation: True, DataSize: 100000)
1.16 1.15 1.22
1.17
1.06
1.09
System.Text.RegularExpressions.Tests.Perf_Regex_Industry_SliceSlice.Count(Options: IgnoreCase, NonBacktracking)
1.16 1.11 1.16
1.11
System.Collections.Sort(Int32).LinqOrderByExtension(Size: 512)
1.16 1.15 1.16
1.17
System.Tests.Perf_Decimal.ToString(value: 123456.789)
1.15 1.17 1.22
1.22
1.17
1.23
1.12
1.15
1.18
1.20
1.16
1.17
System.Text.Json.Document.Tests.Perf_ParseThenWrite.ParseThenWrite(IsDataIndented: False, TestCase: Json4KB)
1.15 1.12 1.06
1.12
1.25
1.12
System.Buffers.Tests.RentReturnArrayPoolTests(Byte).SingleParallel(RentalSize: 4096, ManipulateArray: False, Async: False, UseSharedPool: False)
1.15 1.37 1.13
1.45
1.13
1.31
System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "(?i)Sherlock", Options: NonBacktracking)
1.15 1.10 1.15
1.10
System.Buffers.Tests.RentReturnArrayPoolTests(Object).SingleParallel(RentalSize: 4096, ManipulateArray: True, Async: True, UseSharedPool: False)
1.14 1.11 1.14
1.11
1.13
1.11
System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Leipzig.Count(Pattern: "(?i)Twain", Options: None)
1.14 1.25 1.18
1.12
1.09
1.25
System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "(?i)Sherlock", Options: None)
1.14 1.14 1.13
1.13
System.IO.Tests.Perf_Directory.GetCurrentDirectory
1.14 1.18 1.13
1.18
System.Buffers.Tests.RentReturnArrayPoolTests(Byte).SingleParallel(RentalSize: 4096, ManipulateArray: True, Async: True, UseSharedPool: True)
1.13 1.14 1.14
1.17
System.Text.RegularExpressions.Tests.Perf_Regex_Industry_SliceSlice.Count(Options: IgnoreCase)
1.13 1.14 1.13
1.14
System.Globalization.Tests.StringSearch.IndexOf_Word_NotFound(Options: (en-US, IgnoreNonSpace, False))
1.13 1.13 1.13
1.13
System.Globalization.Tests.StringSearch.IndexOf_Word_NotFound(Options: (, None, False))
1.13 1.14 1.13
1.14
System.Globalization.Tests.StringSearch.IndexOf_Word_NotFound(Options: (en-US, None, False))
1.13 1.14 1.12
1.14
1.11
1.11
1.15
1.16
System.Text.Json.Tests.Perf_Basic.WriteBasicUtf8(Formatted: False, SkipValidation: False, DataSize: 100000)
1.13 1.14 1.13
1.19
System.Collections.CreateAddAndRemove(String).Queue(Size: 512)
1.12 1.12 1.12
1.12
1.07
1.07
1.12
1.13
1.11
1.14
1.21
1.20
System.Text.Json.Document.Tests.Perf_ParseThenWrite.ParseThenWrite(IsDataIndented: True, TestCase: DeepTree)
1.12 1.13 1.11
1.14
System.Collections.Tests.Perf_BitArray.BitArrayIntArrayCtor(Size: 512)
1.12 1.12 1.12
1.12
System.Collections.Sort(IntClass).Array_ComparerClass(Size: 512)
1.12 1.07 1.12
1.07
System.Tests.Perf_Type.GetType_FullyQualifiedNames(input: typeof(System.Collections.Generic.Dictionary`2[]))
1.12 1.08 1.16
1.07
1.11
1.11
1.09
1.09
System.Tests.Perf_Double.ToStringWithFormat(value: 1.7976931348623157E+308, format: "F50")
1.12 1.18 1.12
1.18
System.Text.Json.Serialization.Tests.WriteJson(ImmutableSortedDictionary(String, String)).SerializeToString(Mode: SourceGen)
1.12 1.17 1.14
1.24
1.09
1.11
System.Memory.ReadOnlySpan.IndexOfString(input: "ABCDE", value: "c", comparisonType: InvariantCultureIgnoreCase)
1.12 1.54 1.25
1.34
System.Buffers.Tests.RentReturnArrayPoolTests(Object).SingleParallel(RentalSize: 4096, ManipulateArray: False, Async: False, UseSharedPool: False)
1.11 1.11 1.11
1.11
System.Buffers.Text.Tests.Utf8ParserTests.TryParseUInt32Hex(value: FFFFFFFFFFFFFFFF)
1.11 1.12 1.11
1.12
System.Tests.Perf_Guid.ParseExactD
1.11 1.18 1.11
1.18
System.Memory.ReadOnlySpan.IndexOfString(input: "AAAAA5AAAA", value: "5", comparisonType: InvariantCulture)
1.11 1.10 1.12
1.11
System.Collections.Sort(IntClass).Array_Comparison(Size: 512)
1.10 1.10 1.11
1.11
1.11
1.10
System.Text.Json.Tests.Perf_Basic.WriteBasicUtf8(Formatted: False, SkipValidation: True, DataSize: 10)
1.10 1.13 1.05
1.05
1.17
1.18
1.04
1.09
System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "(?i)Sherlock Holmes", Options: NonBacktracking)
1.10 1.12 1.10
1.12
System.Text.Json.Tests.Perf_Basic.WriteBasicUtf16(Formatted: False, SkipValidation: False, DataSize: 100000)
1.10 1.11 1.10
1.11
1.13
1.18
1.07
1.07
1.09
1.10
System.Text.Json.Tests.Perf_Basic.WriteBasicUtf16(Formatted: False, SkipValidation: True, DataSize: 100000)
1.10 1.12 1.10
1.15
1.10
1.10
System.Memory.ReadOnlySpan.IndexOfString(input: "foobardzsdzs", value: "rddzs", comparisonType: InvariantCulture)
1.10 1.20 1.10
1.20
System.Memory.ReadOnlySpan.IndexOfString(input: "AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAXAAAAAAAAAAAAAAAAAAAAAAAAAAAAA", value: "x", comparisonType: InvariantCultureIgno
1.10 1.08 1.10
1.08
System.Tests.Perf_Type.GetType_FullyQualifiedNames(input: typeof(System.Tests.NestedGeneric(String, Boolean)))
1.10 1.12 1.12
1.18
1.06
1.07
1.08
1.08
System.Memory.ReadOnlySpan.IndexOfString(input: "string1", value: "string2", comparisonType: InvariantCulture)
1.09 1.14 1.09
1.14
System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "(?i)Holmes", Options: NonBacktracking)
1.09 1.10 1.09
1.10
System.Globalization.Tests.StringSearch.IndexOf_Word_NotFound(Options: (, IgnoreCase, False))
1.09 1.12 1.09
1.12
System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "zqj", Options: NonBacktracking)
1.09 1.09 1.09
1.09
System.Globalization.Tests.StringSearch.IndexOf_Word_NotFound(Options: (en-US, IgnoreCase, False))
1.09 1.12 1.15
1.17
1.04
1.07
System.Buffers.Tests.RentReturnArrayPoolTests(Object).MultipleSerial(RentalSize: 4096, ManipulateArray: False, Async: False, UseSharedPool: False)
1.09 1.08 1.09
1.08
System.Text.Json.Tests.Utf8JsonReaderCommentsTests.Utf8JsonReaderCommentParsing(CommentHandling: Skip, SegmentSize: 0, TestCase: LongMultiLine)
1.08 1.08 1.06
1.08
System.Reflection.Activator(EmptyClass).CreateInstanceNames
1.08 1.12 1.08
1.10
1.10
1.28
1.08
1.08
System.Tests.Perf_Double.ToStringWithFormat(value: -1.7976931348623157E+308, format: "F50")
1.08 1.09 1.08
1.09
System.Tests.Perf_Enum.InterpolateIntoSpan_Flags(value: Red, Green)
1.08 1.08 1.08
1.08
System.Tests.Perf_Guid.ctor_str
1.08 1.08 1.08
1.09
1.07
1.07
System.Text.Json.Tests.Perf_Basic.WriteBasicUtf8(Formatted: False, SkipValidation: False, DataSize: 10)
1.07 1.08 1.05
1.05
1.10
1.12
System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "(?i)Holmes", Options: None)
1.07 1.06 1.09
1.06
1.06
1.06
System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Leipzig.Count(Pattern: "(?i)Twain", Options: NonBacktracking)
1.07 1.07 1.09
1.06
1.06
1.09
System.Collections.Sort(IntClass).LinqOrderByExtension(Size: 512)
1.07 1.06 1.07
1.06
System.Buffers.Tests.RentReturnArrayPoolTests(Byte).SingleParallel(RentalSize: 4096, ManipulateArray: False, Async: True, UseSharedPool: False)
1.07 1.12 1.18
1.21
0.99
1.08
1.09
1.10
1.03
1.08
System.Buffers.Tests.RentReturnArrayPoolTests(Byte).MultipleSerial(RentalSize: 4096, ManipulateArray: False, Async: False, UseSharedPool: False)
1.06 1.05 1.06
1.05
System.Perf_Convert.ChangeType
1.06 1.07 1.06
1.07
System.Threading.Tests.Perf_CancellationToken.CreateLinkedTokenSource3
1.06 1.07 1.06
1.07
System.Threading.Channels.Tests.BoundedChannelPerfTests.PingPong
1.05 1.05 1.05
1.05
System.Perf_Convert.ToBase64String(formattingOptions: InsertLineBreaks)
1.05 1.17 1.08
1.18
1.02
1.21
System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "(?i)Sherlock Holmes", Options: None)
1.03 1.08 1.03
1.08
System.Text.Tests.Perf_Encoding.GetByteCount(size: 512, encName: "utf-8")
1.02 1.12 1.03
1.10
System.Reflection.Attributes.IsDefinedMethodBaseMiss
1.01 1.57 1.01
1.57
MicroBenchmarks.Serializers.Xml_ToStream(IndexViewModel).XmlSerializer_
0.96 1.17 0.96
1.17
System.Globalization.Tests.StringSearch.IndexOf_Word_NotFound(Options: (en-US, Ordinal, False))

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
arch-arm64 area-CodeGen-coreclr CLR JIT compiler in src/coreclr/src/jit and related components such as SuperPMI os-linux Linux OS (any supported distro) runtime-coreclr specific to the CoreCLR runtime
Projects
None yet
Development

No branches or pull requests

3 participants