[Perf] Linux/x64: 23 Regressions on 4/8/2024 6:26:42 PM

[performanceautofiler]

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	bc2bd2bd77ecd7a7979a3ef815e3ff36881a1b94
Compare	f6f91998634961ec4df518ebe99d245ba34e7874
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.IO.Tests.StreamReaderReadToEndTests

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
ReadToEnd - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	71.86 ms	80.66 ms	1.12	0.08	False
ReadToEnd - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	69.99 ms	81.20 ms	1.16	0.10	False
ReadToEnd - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	69.66 ms	83.25 ms	1.20	0.11	False
ReadToEnd - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	72.13 ms	79.88 ms	1.11	0.08	False
ReadToEnd - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	69.52 ms	80.77 ms	1.16	0.13	False
ReadToEnd - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	70.75 ms	81.56 ms	1.15	0.07	False
ReadToEnd - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	70.82 ms	81.57 ms	1.15	0.06	False
ReadToEnd - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	70.65 ms	82.54 ms	1.17	0.10	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.IO.Tests.StreamReaderReadToEndTests*'

System.IO.Tests.StreamReaderReadToEndTests.ReadToEnd(LineLengthRange: [ 9, 32])

ETL Files

Histogram

JIT Disasms

System.IO.Tests.StreamReaderReadToEndTests.ReadToEnd(LineLengthRange: [ 129, 1024])

ETL Files

Histogram

JIT Disasms

System.IO.Tests.StreamReaderReadToEndTests.ReadToEnd(LineLengthRange: [1025, 2048])

ETL Files

Histogram

JIT Disasms

System.IO.Tests.StreamReaderReadToEndTests.ReadToEnd(LineLengthRange: [ 0, 0])

ETL Files

Histogram

JIT Disasms

System.IO.Tests.StreamReaderReadToEndTests.ReadToEnd(LineLengthRange: [ 0, 1024])

ETL Files

Histogram

JIT Disasms

System.IO.Tests.StreamReaderReadToEndTests.ReadToEnd(LineLengthRange: [ 1, 1])

ETL Files

Histogram

JIT Disasms

System.IO.Tests.StreamReaderReadToEndTests.ReadToEnd(LineLengthRange: [ 1, 8])

ETL Files

Histogram

JIT Disasms

System.IO.Tests.StreamReaderReadToEndTests.ReadToEnd(LineLengthRange: [ 33, 128])

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	bc2bd2bd77ecd7a7979a3ef815e3ff36881a1b94
Compare	f6f91998634961ec4df518ebe99d245ba34e7874
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Text.Json.Serialization.Tests.WriteJson<IndexViewModel>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
SerializeObjectProperty - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	42.60 μs	45.58 μs	1.07	0.05	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.Json.Serialization.Tests.WriteJson<IndexViewModel>*'

System.Text.Json.Serialization.Tests.WriteJson<IndexViewModel>.SerializeObjectProperty(Mode: SourceGen)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	bc2bd2bd77ecd7a7979a3ef815e3ff36881a1b94
Compare	f6f91998634961ec4df518ebe99d245ba34e7874
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Text.Json.Serialization.Tests.WriteJson<BinaryData>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
SerializeToString - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	1.88 μs	2.18 μs	1.16	0.02	False
SerializeToString - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	2.23 μs	2.49 μs	1.11	0.03	False
SerializeObjectProperty - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	2.61 μs	2.89 μs	1.11	0.06	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.Json.Serialization.Tests.WriteJson<BinaryData>*'

System.Text.Json.Serialization.Tests.WriteJson<BinaryData>.SerializeToString(Mode: SourceGen)

ETL Files

Histogram

JIT Disasms

System.Text.Json.Serialization.Tests.WriteJson<BinaryData>.SerializeToString(Mode: Reflection)

ETL Files

Histogram

JIT Disasms

System.Text.Json.Serialization.Tests.WriteJson<BinaryData>.SerializeObjectProperty(Mode: SourceGen)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	bc2bd2bd77ecd7a7979a3ef815e3ff36881a1b94
Compare	f6f91998634961ec4df518ebe99d245ba34e7874
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Numerics.Tensors.Tests.Perf_NumberTensorPrimitives<Single>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
Max_Vector - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	1.77 μs	1.89 μs	1.07	0.01	True

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tensors.Tests.Perf_NumberTensorPrimitives<Single>*'

System.Numerics.Tensors.Tests.Perf_NumberTensorPrimitives<Single>.Max_Vector(BufferLength: 3079)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	bc2bd2bd77ecd7a7979a3ef815e3ff36881a1b94
Compare	f6f91998634961ec4df518ebe99d245ba34e7874
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.IO.Tests.StreamReaderReadLineTests

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
ReadLine - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	16.29 μs	19.70 μs	1.21	0.02	False
ReadLine - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	16.49 μs	19.80 μs	1.20	0.03	False
ReadLine - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	17.15 μs	21.16 μs	1.23	0.03	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.IO.Tests.StreamReaderReadLineTests*'

System.IO.Tests.StreamReaderReadLineTests.ReadLine(LineLengthRange: [ 129, 1024])

ETL Files

Histogram

JIT Disasms

System.IO.Tests.StreamReaderReadLineTests.ReadLine(LineLengthRange: [ 0, 1024])

ETL Files

Histogram

JIT Disasms

System.IO.Tests.StreamReaderReadLineTests.ReadLine(LineLengthRange: [1025, 2048])

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	bc2bd2bd77ecd7a7979a3ef815e3ff36881a1b94
Compare	f6f91998634961ec4df518ebe99d245ba34e7874
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Text.Tests.Perf_Encoding

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
GetChars - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	315.60 ns	427.01 ns	1.35	0.12	False
GetString - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	320.84 ns	426.26 ns	1.33	0.16	False
GetChars - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	314.35 ns	413.17 ns	1.31	0.13	False
GetString - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	326.58 ns	450.44 ns	1.38	0.09	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.Tests.Perf_Encoding*'

System.Text.Tests.Perf_Encoding.GetChars(size: 512, encName: "utf-8")

ETL Files

Histogram

JIT Disasms

System.Text.Tests.Perf_Encoding.GetString(size: 512, encName: "ascii")

ETL Files

Histogram

JIT Disasms

System.Text.Tests.Perf_Encoding.GetChars(size: 512, encName: "ascii")

ETL Files

Histogram

JIT Disasms

System.Text.Tests.Perf_Encoding.GetString(size: 512, encName: "utf-8")

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	bc2bd2bd77ecd7a7979a3ef815e3ff36881a1b94
Compare	f6f91998634961ec4df518ebe99d245ba34e7874
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Text.Perf_Ascii

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
ToUtf16 - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	34.68 ns	65.46 ns	1.89	0.48	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.Perf_Ascii*'

System.Text.Perf_Ascii.ToUtf16(Size: 128)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	bc2bd2bd77ecd7a7979a3ef815e3ff36881a1b94
Compare	f6f91998634961ec4df518ebe99d245ba34e7874
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt16>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
LessThanOrEqualAnyBenchmark - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	1.31 ns	7.17 ns	5.46	0.91	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt16>*'

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt16>.LessThanOrEqualAnyBenchmark

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	bc2bd2bd77ecd7a7979a3ef815e3ff36881a1b94
Compare	f6f91998634961ec4df518ebe99d245ba34e7874
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Text.Perf_Utf8Encoding

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
GetString - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	110.55 μs	141.89 μs	1.28	0.06	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.Perf_Utf8Encoding*'

System.Text.Perf_Utf8Encoding.GetString(Input: EnglishAllAscii)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

[radekdoulik]

looks like dotnet/runtime#99982