[Perf] Changes at 4/8/2022 8:38:01 PM

[performanceautofiler]

Run Information

Architecture	arm64
OS	ubuntu 18.04
Baseline	8e8a62156ea459945b1d953c4fbe950d276bbc9b
Compare	d09f42d1075ce9cedd0101df07c6f4861e03901c
Diff	Diff

Regressions in Exceptions.Handling

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
ThrowAndCatchDeepRecursive - Duration of single invocation	155.07 μs	216.92 μs	1.40	0.43	False
ThrowAndCatch_ManyCatchBlocks - Duration of single invocation	140.99 μs	172.22 μs	1.22	0.30	False
ThrowAndCatch_ManyCatchBlocks - Duration of single invocation	136.07 μs	177.04 μs	1.30	0.37	False
ThrowAndCatchDeepRecursive - Duration of single invocation	184.07 μs	208.59 μs	1.13	0.45	False
ThrowAndCatch - Duration of single invocation	129.87 μs	179.91 μs	1.39	0.34	False
ThrowAndCatchDeep - Duration of single invocation	153.54 μs	187.23 μs	1.22	0.40	False
ThrowAndCatch - Duration of single invocation	137.62 μs	194.67 μs	1.41	0.43	False
ThrowAndCatchDeep - Duration of single invocation	186.45 μs	212.98 μs	1.14	0.36	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'Exceptions.Handling*'

Payloads

Baseline
Compare

Histogram

Exceptions.Handling.ThrowAndCatchDeepRecursive(kind: ReflectionHardware)

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 216.91719339037695 > 171.945860904544.
IsChangePoint: Marked as a change because one of 12/15/2021 12:53:06 PM, 4/8/2022 2:40:20 PM, 4/11/2022 8:24:09 AM falls between 4/2/2022 3:48:06 PM and 4/11/2022 8:24:09 AM.
IsRegressionStdDev: Marked as regression because -8.359714313989429 (T) = (0 -201127.94072093698) / Math.Sqrt((63426603.17949089 / (34)) + (157996533.77715808 / (8))) is less than -2.0210753903043583 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (34) + (8) - 2, .025) and -0.23952612365204165 = (162261.96195716274 - 201127.94072093698) / 162261.96195716274 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### Exceptions.Handling.ThrowAndCatch_ManyCatchBlocks(kind: ReflectionSoftware)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 172.222096682164 > 147.49363929215315.
IsChangePoint: Marked as a change because one of 12/15/2021 12:53:06 PM, 4/8/2022 2:40:20 PM, 4/11/2022 8:24:09 AM falls between 4/2/2022 3:48:06 PM and 4/11/2022 8:24:09 AM.
IsRegressionStdDev: Marked as regression because -11.586841363289022 (T) = (0 -185550.63416146772) / Math.Sqrt((23102821.44001649 / (32)) + (105686003.62331629 / (8))) is less than -2.0243941639098457 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (8) - 2, .025) and -0.3039310773987186 = (142300.95238747782 - 185550.63416146772) / 142300.95238747782 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### Exceptions.Handling.ThrowAndCatch_ManyCatchBlocks(kind: ReflectionHardware)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 177.0442588050994 > 140.86832003156104.
IsChangePoint: Marked as a change because one of 12/15/2021 12:53:06 PM, 4/8/2022 8:30:12 AM, 4/11/2022 8:24:09 AM falls between 4/2/2022 3:48:06 PM and 4/11/2022 8:24:09 AM.
IsRegressionStdDev: Marked as regression because -11.21321823307902 (T) = (0 -166645.6025792194) / Math.Sqrt((19559232.212716676 / (31)) + (80564957.36827043 / (8))) is less than -2.026192463026769 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (8) - 2, .025) and -0.2822489772372731 = (129963.52934378872 - 166645.6025792194) / 129963.52934378872 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### Exceptions.Handling.ThrowAndCatchDeepRecursive(kind: ReflectionSoftware)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 208.59227984022556 > 185.50255949113483.
IsChangePoint: Marked as a change because one of 12/15/2021 12:53:06 PM, 4/8/2022 2:40:20 PM, 4/11/2022 8:24:09 AM falls between 4/2/2022 3:48:06 PM and 4/11/2022 8:24:09 AM.
IsRegressionStdDev: Marked as regression because -8.24385646680138 (T) = (0 -207912.2826608051) / Math.Sqrt((72592505.93932731 / (34)) + (103557254.56017482 / (8))) is less than -2.0210753903043583 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (34) + (8) - 2, .025) and -0.18199660897169787 = (175899.22093066125 - 207912.2826608051) / 175899.22093066125 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### Exceptions.Handling.ThrowAndCatch(kind: ReflectionHardware)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 179.91293770292208 > 138.6038389665041.
IsChangePoint: Marked as a change because one of 12/15/2021 12:53:06 PM, 4/8/2022 2:40:20 PM, 4/11/2022 8:24:09 AM falls between 4/2/2022 3:48:06 PM and 4/11/2022 8:24:09 AM.
IsRegressionStdDev: Marked as regression because -13.855688560023676 (T) = (0 -164257.70863109492) / Math.Sqrt((18115055.683142822 / (33)) + (45666213.09425441 / (8))) is less than -2.0226909200346674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (8) - 2, .025) and -0.26743534173840083 = (129598.49171145946 - 164257.70863109492) / 129598.49171145946 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### Exceptions.Handling.ThrowAndCatchDeep(kind: ReflectionHardware)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 187.23321184098643 > 158.40684628286326.
IsChangePoint: Marked as a change because one of 12/15/2021 12:53:06 PM, 4/8/2022 2:40:20 PM, 4/11/2022 8:24:09 AM falls between 4/2/2022 3:48:06 PM and 4/11/2022 8:24:09 AM.
IsRegressionStdDev: Marked as regression because -9.661876571224541 (T) = (0 -191948.17569261498) / Math.Sqrt((59027755.506887525 / (34)) + (84866198.73007105 / (8))) is less than -2.0210753903043583 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (34) + (8) - 2, .025) and -0.21484971788902285 = (158001.58066147697 - 191948.17569261498) / 158001.58066147697 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### Exceptions.Handling.ThrowAndCatch(kind: ReflectionSoftware)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 194.67386000881837 > 152.1390775286404.
IsChangePoint: Marked as a change because one of 12/15/2021 12:53:06 PM, 4/8/2022 2:40:20 PM, 4/11/2022 8:24:09 AM falls between 4/2/2022 3:48:06 PM and 4/11/2022 8:24:09 AM.
IsRegressionStdDev: Marked as regression because -10.725699310913228 (T) = (0 -185399.5862782386) / Math.Sqrt((26777781.95699754 / (34)) + (115336193.60303703 / (8))) is less than -2.0210753903043583 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (34) + (8) - 2, .025) and -0.29129229933273026 = (143576.77682585348 - 185399.5862782386) / 143576.77682585348 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### Exceptions.Handling.ThrowAndCatchDeep(kind: ReflectionSoftware)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 212.9751569739382 > 190.0410284837456.
IsChangePoint: Marked as a change because one of 12/15/2021 12:53:06 PM, 4/8/2022 2:40:20 PM, 4/11/2022 8:24:09 AM falls between 4/2/2022 3:48:06 PM and 4/11/2022 8:24:09 AM.
IsRegressionStdDev: Marked as regression because -8.67411647240045 (T) = (0 -213109.4341152507) / Math.Sqrt((75190686.5521037 / (33)) + (153086210.26949957 / (8))) is less than -2.0226909200346674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (8) - 2, .025) and -0.23206388536217887 = (172969.46744981883 - 213109.4341152507) / 172969.46744981883 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

### Run Information

Architecture	arm64
OS	ubuntu 18.04
Baseline	8e8a62156ea459945b1d953c4fbe950d276bbc9b
Compare	d09f42d1075ce9cedd0101df07c6f4861e03901c
Diff	Diff

Regressions in System.Memory.Span<Byte>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
GetPinnableReference - Duration of single invocation	2.82 ns	4.23 ns	1.50	0.33	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Memory.Span<Byte>*'

Payloads

Baseline
Compare

Histogram

System.Memory.Span<Byte>.GetPinnableReference(Size: 512)

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 4.232256806317 > 2.938326942346519.
IsChangePoint: Marked as a change because one of 4/2/2022 3:48:06 PM, 4/4/2022 4:14:58 AM, 4/8/2022 2:40:20 PM, 4/11/2022 8:24:09 AM falls between 4/2/2022 3:48:06 PM and 4/11/2022 8:24:09 AM.
IsRegressionStdDev: Marked as regression because -5.407755931233472 (T) = (0 -4.013249878291649) / Math.Sqrt((0.27747980703504177 / (34)) + (0.2015364050966107 / (8))) is less than -2.0210753903043583 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (34) + (8) - 2, .025) and -0.32641409381740416 = (3.025638748108868 - 4.013249878291649) / 3.025638748108868 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository