[Perf] Changes at 3/31/2022 1:23:38 AM

[performanceautofiler]

Run Information

Architecture	x64
OS	Windows 10.0.18362
Baseline	5a0564b01442f8ea9247e27c4fab85ee0d457265
Compare	43ab6b874e08f55fe88081f75ddde8e4a2fe726e
Diff	Diff

Regressions in Benchstone.BenchI.IniArray

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
Test - Duration of single invocation	59.38 ms	64.81 ms	1.09	0.13	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'Benchstone.BenchI.IniArray*'

Payloads

Baseline
Compare

Histogram

Benchstone.BenchI.IniArray.Test

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 64.8054075 > 62.3474555.
IsChangePoint: Marked as a change because one of 2/25/2022 7:19:51 AM, 3/30/2022 6:37:35 PM, 4/5/2022 2:02:34 AM falls between 3/26/2022 9:07:40 PM and 4/5/2022 2:02:34 AM.
IsRegressionStdDev: Marked as regression because -15.33610918488523 (T) = (0 -63725778.958333336) / Math.Sqrt((1760962907889.1511 / (31)) + (1237433310967.074 / (24))) is less than -2.005745995316835 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (24) - 2, .025) and -0.08603783308791582 = (58677310.326420896 - 63725778.958333336) / 58677310.326420896 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

### Run Information

Architecture	x64
OS	Windows 10.0.18362
Baseline	5a0564b01442f8ea9247e27c4fab85ee0d457265
Compare	43ab6b874e08f55fe88081f75ddde8e4a2fe726e
Diff	Diff

Regressions in System.Collections.CopyTo<Int32>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
Array - Duration of single invocation	147.80 ns	241.25 ns	1.63	0.03	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.CopyTo<Int32>*'

Payloads

Baseline
Compare

Histogram

System.Collections.CopyTo<Int32>.Array(Size: 2048)

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 241.24945679184265 > 154.59570431589688.
IsChangePoint: Marked as a change because one of 2/4/2022 6:00:25 PM, 2/10/2022 10:02:40 PM, 3/30/2022 6:37:35 PM, 4/5/2022 2:02:34 AM falls between 3/26/2022 9:07:40 PM and 4/5/2022 2:02:34 AM.
IsRegressionStdDev: Marked as regression because -389.569439701311 (T) = (0 -239.73885205766194) / Math.Sqrt((0.8703875075860327 / (31)) + (0.6899967093206196 / (24))) is less than -2.005745995316835 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (24) - 2, .025) and -0.6323003836695372 = (146.8717733918009 - 239.73885205766194) / 146.8717733918009 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	x64
OS	Windows 10.0.18362
Baseline	5a0564b01442f8ea9247e27c4fab85ee0d457265
Compare	43ab6b874e08f55fe88081f75ddde8e4a2fe726e
Diff	Diff

Regressions in Benchstone.BenchF.NewtR

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
Test - Duration of single invocation	99.79 ms	109.88 ms	1.10	0.15	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'Benchstone.BenchF.NewtR*'

Payloads

Baseline
Compare

Histogram

Benchstone.BenchF.NewtR.Test

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 109.8849175 > 104.77361026442308.
IsChangePoint: Marked as a change because one of 2/5/2022 8:17:17 PM, 2/25/2022 7:19:51 AM, 3/30/2022 6:37:35 PM, 4/5/2022 2:02:34 AM falls between 3/26/2022 9:07:40 PM and 4/5/2022 2:02:34 AM.
IsRegressionStdDev: Marked as regression because -15.307370245425952 (T) = (0 -113243823.4375) / Math.Sqrt((27049321152410.867 / (31)) + (5994533951565.655 / (24))) is less than -2.005745995316835 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (24) - 2, .025) and -0.16713510256789066 = (97027176.36402574 - 113243823.4375) / 97027176.36402574 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	x64
OS	Windows 10.0.18362
Baseline	5a0564b01442f8ea9247e27c4fab85ee0d457265
Compare	43ab6b874e08f55fe88081f75ddde8e4a2fe726e
Diff	Diff

Regressions in System.Collections.TryGetValueFalse<Int32, Int32>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
ImmutableSortedDictionary - Duration of single invocation	39.51 μs	42.99 μs	1.09	0.06	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.TryGetValueFalse<Int32, Int32>*'

Payloads

Baseline
Compare

Histogram

System.Collections.TryGetValueFalse<Int32, Int32>.ImmutableSortedDictionary(Size: 512)

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 42.98798076923076 > 41.235514254385976.
IsChangePoint: Marked as a change because one of 2/1/2022 8:13:55 AM, 2/24/2022 10:17:16 AM, 3/3/2022 7:35:51 PM, 3/11/2022 8:42:43 PM, 3/17/2022 6:54:53 PM, 3/30/2022 6:37:35 PM, 4/5/2022 2:02:34 AM falls between 3/26/2022 9:07:40 PM and 4/5/2022 2:02:34 AM.
IsRegressionStdDev: Marked as regression because -77.42694564340583 (T) = (0 -42798.37024785119) / Math.Sqrt((44309.06701311202 / (31)) + (12916.259529904797 / (24))) is less than -2.005745995316835 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (24) - 2, .025) and -0.08724704962210303 = (39363.97920116382 - 42798.37024785119) / 39363.97920116382 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	x64
OS	Windows 10.0.18362
Baseline	5a0564b01442f8ea9247e27c4fab85ee0d457265
Compare	43ab6b874e08f55fe88081f75ddde8e4a2fe726e
Diff	Diff

Regressions in Benchstone.BenchF.Simpsn

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
Test - Duration of single invocation	160.21 ms	176.85 ms	1.10	0.03	True

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'Benchstone.BenchF.Simpsn*'

Payloads

Baseline
Compare

Histogram

Benchstone.BenchF.Simpsn.Test

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 176.8477 > 168.00364700000003.
IsChangePoint: Marked as a change because one of 3/30/2022 6:37:35 PM, 4/5/2022 2:02:34 AM falls between 3/26/2022 9:07:40 PM and 4/5/2022 2:02:34 AM.
IsRegressionStdDev: Marked as regression because -17.650192671204046 (T) = (0 -176808099.0583028) / Math.Sqrt((23393079608999.23 / (31)) + (190666185083.2273 / (24))) is less than -2.005745995316835 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (24) - 2, .025) and -0.09549838277527671 = (161395125.5778093 - 176808099.0583028) / 161395125.5778093 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	x64
OS	Windows 10.0.18362
Baseline	5a0564b01442f8ea9247e27c4fab85ee0d457265
Compare	43ab6b874e08f55fe88081f75ddde8e4a2fe726e
Diff	Diff

Regressions in System.IO.Tests.StreamReaderReadLineTests

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
ReadLine - Duration of single invocation	18.50 μs	19.75 μs	1.07	0.06	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.IO.Tests.StreamReaderReadLineTests*'

Payloads

Baseline
Compare

Histogram

System.IO.Tests.StreamReaderReadLineTests.ReadLine(LineLengthRange: [ 0, 1024])

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 19.74640123070505 > 19.463471957666204.
IsChangePoint: Marked as a change because one of 2/10/2022 7:02:09 PM, 2/19/2022 11:51:48 PM, 3/15/2022 12:53:39 AM, 3/23/2022 6:35:24 PM, 3/30/2022 6:37:35 PM, 4/5/2022 2:02:34 AM falls between 3/26/2022 9:07:40 PM and 4/5/2022 2:02:34 AM.
IsRegressionStdDev: Marked as regression because -31.840117848765882 (T) = (0 -19727.63375475608) / Math.Sqrt((9269.926670693178 / (31)) + (27585.211853771234 / (24))) is less than -2.005745995316835 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (24) - 2, .025) and -0.0654450880592657 = (18515.861564194216 - 19727.63375475608) / 18515.861564194216 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	x64
OS	Windows 10.0.18362
Baseline	5a0564b01442f8ea9247e27c4fab85ee0d457265
Compare	43ab6b874e08f55fe88081f75ddde8e4a2fe726e
Diff	Diff

Regressions in System.Linq.Tests.Perf_Enumerable

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
Max - Duration of single invocation	463.57 ns	528.48 ns	1.14	0.12	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Linq.Tests.Perf_Enumerable*'

Payloads

Baseline
Compare

Histogram

System.Linq.Tests.Perf_Enumerable.Max(input: IEnumerable)

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 528.4822132828521 > 486.72138566277624.
IsChangePoint: Marked as a change because one of 3/15/2022 12:53:39 AM, 3/23/2022 3:13:36 PM, 3/30/2022 6:37:35 PM, 4/5/2022 2:02:34 AM falls between 3/26/2022 9:07:40 PM and 4/5/2022 2:02:34 AM.
IsRegressionStdDev: Marked as regression because -256.4988183354515 (T) = (0 -527.7346315430638) / Math.Sqrt((0.5669718677373463 / (31)) + (1.0505081232951132 / (24))) is less than -2.005745995316835 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (24) - 2, .025) and -0.1377618912145361 = (463.8357424502226 - 527.7346315430638) / 463.8357424502226 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository