Performance regression: few Span Indexer benchmarks are 30% slower

[adamsitnik]

Some of the Span Indexer benchmarks are 30% slower when compared to 2.2.

https://github.com/dotnet/performance/blob/master/src/benchmarks/micro/coreclr/Span/Indexer.cs

Repro

git clone https://github.com/dotnet/performance.git
cd performance
# if you don't have cli installed and want python script to download the latest cli for you
py .\scripts\benchmarks_ci.py -f netcoreapp2.2 netcoreapp3.0 --filter *IndexerBench*
# if you do
dotnet run -p .\src\benchmarks\micro\MicroBenchmarks.csproj -c Release -f netcoreapp2.2 --filter *IndexerBench* --runtimes netcoreapp2.2 netcoreapp3.0

BenchmarkDotNet=v0.11.3.1003-nightly, OS=Windows 10.0.18362
Intel Xeon CPU E5-1650 v4 3.60GHz, 1 CPU, 12 logical and 6 physical cores
.NET Core SDK=3.0.100-preview8-013262
   [Host]     : .NET Core 2.2.6 (CoreCLR 4.6.27817.03, CoreFX 4.6.27818.02), 64bit RyuJIT
   Job-BYJCMJ : .NET Core 2.2.6 (CoreCLR 4.6.27817.03, CoreFX 4.6.27818.02), 64bit RyuJIT
   Job-JSSCYO : .NET Core 3.0.0-preview8-27916-02 (CoreCLR 4.700.19.36302, CoreFX 4.700.19.36514), 64bit RyuJIT

Method	Toolchain	length	Mean	Ratio
Ref	netcoreapp2.2	1024	426.5 ns	1.00
Ref	netcoreapp3.0	1024	548.0 ns	1.28
Fixed1	netcoreapp2.2	1024	422.8 ns	1.00
Fixed1	netcoreapp3.0	1024	545.8 ns	1.29
Fixed2	netcoreapp2.2	1024	424.3 ns	1.00
Fixed2	netcoreapp3.0	1024	546.4 ns	1.29
Indexer1	netcoreapp2.2	1024	424.2 ns	1.00
Indexer1	netcoreapp3.0	1024	546.5 ns	1.29
Indexer2	netcoreapp2.2	1024	425.0 ns	1.00
Indexer2	netcoreapp3.0	1024	545.6 ns	1.28
Indexer3	netcoreapp2.2	1024	421.0 ns	1.00
Indexer3	netcoreapp3.0	1024	545.0 ns	1.29
Indexer4	netcoreapp2.2	1024	4,162.4 ns	1.00
Indexer4	netcoreapp3.0	1024	5,453.6 ns	1.31
Indexer5	netcoreapp2.2	1024	492.8 ns	1.00
Indexer5	netcoreapp3.0	1024	551.0 ns	1.12
Indexer6	netcoreapp2.2	1024	548.7 ns	1.00
Indexer6	netcoreapp3.0	1024	550.4 ns	1.00
ReadOnlyIndexer1	netcoreapp2.2	1024	422.7 ns	1.00
ReadOnlyIndexer1	netcoreapp3.0	1024	547.6 ns	1.29
ReadOnlyIndexer2	netcoreapp2.2	1024	419.7 ns	1.00
ReadOnlyIndexer2	netcoreapp3.0	1024	546.9 ns	1.30
WriteViaIndexer1	netcoreapp2.2	1024	1,602.3 ns	1.00
WriteViaIndexer1	netcoreapp3.0	1024	1,607.8 ns	1.00
WriteViaIndexer2	netcoreapp2.2	1024	581.7 ns	1.00
WriteViaIndexer2	netcoreapp3.0	1024	583.5 ns	1.00
KnownSizeArray	netcoreapp2.2	1024	416.8 ns	1.00
KnownSizeArray	netcoreapp3.0	1024	545.5 ns	1.31
KnownSizeCtor	netcoreapp2.2	1024	417.5 ns	1.00
KnownSizeCtor	netcoreapp3.0	1024	544.0 ns	1.30
KnownSizeCtor2	netcoreapp2.2	1024	426.4 ns	1.00
KnownSizeCtor2	netcoreapp3.0	1024	486.2 ns	1.14
SameIndex1	netcoreapp2.2	1024	693.3 ns	1.00
SameIndex1	netcoreapp3.0	1024	787.4 ns	1.14
SameIndex2	netcoreapp2.2	1024	820.6 ns	1.00
SameIndex2	netcoreapp3.0	1024	821.9 ns	1.00
CoveredIndex1	netcoreapp2.2	1024	977.9 ns	1.00
CoveredIndex1	netcoreapp3.0	1024	978.1 ns	1.00
CoveredIndex2	netcoreapp2.2	1024	833.1 ns	1.00
CoveredIndex2	netcoreapp3.0	1024	825.5 ns	0.99
CoveredIndex3	netcoreapp2.2	1024	1,098.8 ns	1.00

/cc @AndyAyersMS @danmosemsft

category:cq
theme:register-allocator
skill-level:expert
cost:large

[adamsitnik]

I've verified that this is not an array alignment issue. I've sent dotnet/performance#667 to make sure we always use unaligned arrays and compare apples to apples.

[adamsitnik]

/cc @billwert @DrewScoggins

[AndyAyersMS]

This shows up pretty clearly in the old benchview data (showing ubuntu here as windows had an outage around this time that is too wide to pin down the root cause -- but both platforms see similar impact).

The likely culprit is dotnet/coreclr#19429. These tests have fairly tight loops so are sensitive to small changes in the in-loop codegen. Will follow-up with some diffs shortly.

cc @CarolEidt

[adamsitnik]

I've found another very similar regression:

https://github.com/dotnet/performance/blob/9aa77fc38d6e1e0cabede6b5de29c156989781dc/src/benchmarks/micro/corefx/System.Runtime/Perf.String.cs#L313-L331

--filter *IndexerCheckPathLength 

Method	Toolchain	Mean	Ratio
IndexerCheckPathLength	netcoreapp2.2	119.0 ns	1.00
IndexerCheckPathLength	netcoreapp3.0	155.2 ns	1.31

I am not going to create a new issue for it since it's most probably the same problem

[adamsitnik]

Another similar regression:

--filter *SeekUnroll*

Method	Toolchain	boxedIndex	Mean	Ratio
SeekUnroll	netcoreapp2.2	1	794.6 ms	1.00
SeekUnroll	netcoreapp3.0	1	1,061.0 ms	1.33
SeekUnroll	netcoreapp2.2	3	797.1 ms	1.00
SeekUnroll	netcoreapp3.0	3	1,080.2 ms	1.36
SeekUnroll	netcoreapp2.2	11	1,193.5 ms	1.00
SeekUnroll	netcoreapp3.0	11	1,398.3 ms	1.17
SeekUnroll	netcoreapp2.2	19	1,455.7 ms	1.00
SeekUnroll	netcoreapp3.0	19	1,595.3 ms	1.10
SeekUnroll	netcoreapp2.2	27	1,791.4 ms	1.00
SeekUnroll	netcoreapp3.0	27	2,122.3 ms	1.18

[AndyAyersMS]

Seek unroll seems to be "bi-stable": via xunit-perf:

Via BDN we also see two stable levels

So perhaps no regression?

[AndyAyersMS]

For TestIndexer1 the 2.2 codegen is:

;; 2.2 TestIndexer1

G_M36437_IG01:

G_M36437_IG02:
       488B01               mov      rax, bword ptr [rcx]
       8B5108               mov      edx, dword ptr [rcx+8]
       33C9                 xor      ecx, ecx
       4533C0               xor      r8d, r8d
       85D2                 test     edx, edx
       7E17                 jle      SHORT G_M36437_IG04

G_M36437_IG03:
       4D63C8               movsxd   r9, r8d
       460FB60C08           movzx    r9, byte  ptr [rax+r9]
       4433C9               xor      r9d, ecx
       410FB6C9             movzx    rcx, r9b
       41FFC0               inc      r8d
       443BC2               cmp      r8d, edx
       7CE9                 jl       SHORT G_M36437_IG03

G_M36437_IG04:
       8BC1                 mov      eax, ecx

G_M36437_IG05:
       C3                   ret      

and for 3.0:

;; 3.0 TestIndexer1

G_M36437_IG01:
       0F1F440000           nop      

G_M36437_IG02:
       488B01               mov      rax, bword ptr [rcx]
       8B5108               mov      edx, dword ptr [rcx+8]
       33C9                 xor      ecx, ecx
       4533C0               xor      r8d, r8d
       85D2                 test     edx, edx
       7E16                 jle      SHORT G_M36437_IG04

G_M36437_IG03:
       4D63C8               movsxd   r9, r8d
       460FB60C08           movzx    r9, byte  ptr [rax+r9]
       4133C9               xor      ecx, r9d
       0FB6C9               movzx    rcx, cl
       41FFC0               inc      r8d
       443BC2               cmp      r8d, edx
       7CEA                 jl       SHORT G_M36437_IG03

G_M36437_IG04:
       8BC1                 mov      eax, ecx

G_M36437_IG05:
       C3                   ret      

The 3.0 loop body is one byte shorter and starts at a different offset because 3.0 includes a rejit nop pad at entry. So loop top alignment seems like a likely culprit to explain perf differences. But not sure this holds up. The method entry should be 16 byte aligned, and by my math that means the 2.2 loop body spans 3 cache lines and the 3.0 version only spans two. So I don't see any obvious reason for 3.0 being slower. Will need to drill in with a low-level profiler.

[AndyAyersMS]

I can repro this on a variety of machines. The loop head offset doesn't seem to be a factor; best guess it is something about slightly different instruction sequence in the loop. Still trying to pin down what that is....

[AndyAyersMS]

CPI on new hw is really good (0.22 for 2.2, 0.29 for 3.0), so the perf delta is some small micro-architectural detail. I think we exceed the theoretical best 0.25 because of macro fusion of the cmp/jl.

On old enough HW there is no difference:

'BenchmarkDotNet=v0.11.3.1003-nightly, OS=Windows 10.0.18362
Intel Xeon CPU E5645 2.40GHz, 1 CPU, 6 logical and 6 physical cores
.NET Core SDK=3.0.100-preview8-013317
  [Host]     : .NET Core 2.2.6 (CoreCLR 4.6.27817.03, CoreFX 4.6.27818.02), 64bit RyuJIT
  Job-LZZMHT : .NET Core 2.2.6 (CoreCLR 4.6.27817.03, CoreFX 4.6.27818.02), 64bit RyuJIT
  Job-TYGJWX : .NET Core 3.0.0-preview8-27917-07 (CoreCLR 4.700.19.36603, CoreFX 4.700.19.36703), 64bit RyuJIT

Runtime=Core  IterationTime=250.0000 ms  MaxIterationCount=20
MinIterationCount=15  WarmupCount=1

|   Method |     Toolchain | length |      Mean |
|--------- |-------------- |------- |----------:|
| Indexer1 | netcoreapp2.2 |   1024 |  1.170 us |
| Indexer1 | netcoreapp3.0 |   1024 |  1.115 us |
|          |               |        |           |
| Indexer2 | netcoreapp2.2 |   1024 |  1.115 us |
| Indexer2 | netcoreapp3.0 |   1024 |  1.116 us |
|          |               |        |           |
| Indexer3 | netcoreapp2.2 |   1024 |  1.124 us |
| Indexer3 | netcoreapp3.0 |   1024 |  1.117 us |
|          |               |        |           |
| Indexer4 | netcoreapp2.2 |   1024 | 11.254 us |
| Indexer4 | netcoreapp3.0 |   1024 | 11.119 us |
|          |               |        |           |
| Indexer5 | netcoreapp2.2 |   1024 |  1.122 us |
| Indexer5 | netcoreapp3.0 |   1024 |  1.112 us |
|          |               |        |           |
| Indexer6 | netcoreapp2.2 |   1024 |  1.123 us |
| Indexer6 | netcoreapp3.0 |   1024 |  1.115 us |

The second movzx is not needed and may be a contributor to the perf impact. I will look into why the peephole added in dotnet/coreclr#22454 is not getting rid of this (edit: the peephole only applies for 32 bit sources, here we have an 8 bit source; would be tricky to deduce the upper 56 bits of RCX are always zero).

[mikedn]

The second movzx is not needed and may be a contributor to the perf impact. I will look into why the peephole added in dotnet/coreclr#22454 is not getting rid of this.

Not sure how 22454 is related to this as this is a byte zero extend. Anyway, the ideal code is probably xor cl, byte ptr [rax+r9] which is more difficult to produce (and even the fact that it's ideal would be difficult to prove).

[AndyAyersMS]

@mikedn yep, realized that.

Seems like the perf issue here could be "mov elimination" introduced in Ivy Bridge, which evidently can optimize 2.2's movzx rcx, r9b but not 3.0's movzx rcx, cl.

Intel docs on "Zero-Latency MOV Instructions" don't mention the restrictions on same-register movs but other sources do. That would also explain why older HW does not see a difference. Changing the data type to int, I don't see any perf differences even on newer machines.

Looks like this perf issue is just restricted to the way these benchmarks are coded to accumulate bytes, jit codegen for that particular case, and limitations on optimization of some sign extending moves in HW, and is not a reflection on Span perf. So I'm going to mark this as future.

Perhaps for reg-reg sign extension on x86/x64 we should anti-preference SRC and DST?

@CarolEidt is this feasible?

[CarolEidt]

Perhaps for reg-reg sign extension on x86/x64 we should anti-preference SRC and DST? is this feasible?

That's not something the register allocator is currently set up to do, though limited cases could possibly be handled by either

• avoiding preferencing for movzx (not sure if this case was actually preferenced), or
• adding anti-preferencing of a single-reg source (i.e. if the source was constrained to be cl, then the target could exclude that from its preferences)

[mikedn]

Anyway, the ideal code is probably xor cl, byte ptr [rax+r9] which is more difficult to produce (and even the fact that it's ideal would be difficult to prove).

Actually producing this byte xor should be pretty easy - detect that it has a byte indir operand, change the xor type to byte as well and contain the indir. What's difficult to remove is the subsequent movzx. But it seems a rather exotic case, considering that this optimization only works with xor and or. Though and could be done too if we detect that it is used by movzx.

[adamsitnik]

@AndyAyersMS in case you are interested we have run all the benchmarks for more OSes and hardware configurations. It looks like AMD is not affected and newer Intels are less affected:

/cc @tannergooding

Details

Legend

• Statistical Test threshold: 5%, the noise filter: 0.3 ns
• Base is Median Base in ns
• Diff is Median Diff in ns

Span.IndexerBench.KnownSizeCtor(length: 1024)

conclusion	Base	Diff	Base/Diff	Modality	Operating System	Arch	Processor Name	Base Runtime	Diff Runtime
Slower	398.24	517.31	0.77		ubuntu 18.04	64bit	Intel Xeon CPU E5-1650 v4 3.60GHz	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Slower	400.01	535.09	0.75		Windows 10.0.18362	64bit	Intel Xeon CPU E5-1650 v4 3.60GHz	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Slower	615.50	820.70	0.75		ubuntu 16.04	64bit	Intel Xeon CPU E5-2673 v4 2.30GHz	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-01
Slower	577.29	845.66	0.68		ubuntu 18.04	64bit	Intel Xeon CPU E5-2673 v4 2.30GHz	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-01
Slower	466.16	633.82	0.74		macOS Mojave 10.14.5	64bit	Intel Core i7-5557U CPU 3.10GHz (Broadwell)	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Slower	467.71	606.87	0.77		Windows 10.0.18362	64bit	Intel Core i7-5557U CPU 3.10GHz (Broadwell)	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Slower	389.39	511.89	0.76		Windows 10.0.18362	64bit	Intel Core i7-7700 CPU 3.60GHz (Kaby Lake)	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Same	630.56	633.13	1.00		Windows 10.0.18362	64bit	AMD Ryzen 7 1800X	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Slower	356.37	518.44	0.69		Windows 10.0.18362	32bit	Intel Xeon CPU E5-1650 v4 3.60GHz	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09

Span.IndexerBench.ReadOnlyIndexer2(length: 1024)

conclusion	Base	Diff	Base/Diff	Modality	Operating System	Arch	Processor Name	Base Runtime	Diff Runtime
Slower	398.60	521.36	0.76		ubuntu 18.04	64bit	Intel Xeon CPU E5-1650 v4 3.60GHz	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Slower	401.34	541.02	0.74		Windows 10.0.18362	64bit	Intel Xeon CPU E5-1650 v4 3.60GHz	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Slower	603.52	824.07	0.73		ubuntu 16.04	64bit	Intel Xeon CPU E5-2673 v4 2.30GHz	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-01
Slower	599.26	856.29	0.70		ubuntu 18.04	64bit	Intel Xeon CPU E5-2673 v4 2.30GHz	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-01
Slower	466.89	609.11	0.77		macOS Mojave 10.14.5	64bit	Intel Core i7-5557U CPU 3.10GHz (Broadwell)	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Slower	468.24	608.90	0.77		Windows 10.0.18362	64bit	Intel Core i7-5557U CPU 3.10GHz (Broadwell)	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Same	503.68	513.55	0.98		Windows 10.0.18362	64bit	Intel Core i7-7700 CPU 3.60GHz (Kaby Lake)	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Slower	572.90	613.56	0.93		Windows 10.0.18362	64bit	AMD Ryzen 7 1800X	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Slower	354.29	519.75	0.68		Windows 10.0.18362	32bit	Intel Xeon CPU E5-1650 v4 3.60GHz	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09

Span.IndexerBench.Indexer3(length: 1024)

conclusion	Base	Diff	Base/Diff	Modality	Operating System	Arch	Processor Name	Base Runtime	Diff Runtime
Slower	398.35	521.52	0.76		ubuntu 18.04	64bit	Intel Xeon CPU E5-1650 v4 3.60GHz	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Slower	400.15	545.82	0.73		Windows 10.0.18362	64bit	Intel Xeon CPU E5-1650 v4 3.60GHz	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Slower	608.93	823.04	0.74		ubuntu 16.04	64bit	Intel Xeon CPU E5-2673 v4 2.30GHz	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-01
Slower	622.11	850.75	0.73		ubuntu 18.04	64bit	Intel Xeon CPU E5-2673 v4 2.30GHz	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-01
Slower	466.33	612.49	0.76		macOS Mojave 10.14.5	64bit	Intel Core i7-5557U CPU 3.10GHz (Broadwell)	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Slower	467.75	609.18	0.77		Windows 10.0.18362	64bit	Intel Core i7-5557U CPU 3.10GHz (Broadwell)	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Same	502.33	513.35	0.98		Windows 10.0.18362	64bit	Intel Core i7-7700 CPU 3.60GHz (Kaby Lake)	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Slower	573.14	613.74	0.93		Windows 10.0.18362	64bit	AMD Ryzen 7 1800X	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Slower	361.86	543.83	0.67		Windows 10.0.18362	32bit	Intel Xeon CPU E5-1650 v4 3.60GHz	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09

Span.IndexerBench.Indexer2(length: 1024)

conclusion	Base	Diff	Base/Diff	Modality	Operating System	Arch	Processor Name	Base Runtime	Diff Runtime
Slower	398.91	522.09	0.76		ubuntu 18.04	64bit	Intel Xeon CPU E5-1650 v4 3.60GHz	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Slower	401.10	539.98	0.74		Windows 10.0.18362	64bit	Intel Xeon CPU E5-1650 v4 3.60GHz	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Slower	615.45	828.66	0.74		ubuntu 16.04	64bit	Intel Xeon CPU E5-2673 v4 2.30GHz	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-01
Slower	602.65	850.12	0.71		ubuntu 18.04	64bit	Intel Xeon CPU E5-2673 v4 2.30GHz	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-01
Slower	466.98	611.69	0.76		macOS Mojave 10.14.5	64bit	Intel Core i7-5557U CPU 3.10GHz (Broadwell)	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Slower	468.32	608.27	0.77		Windows 10.0.18362	64bit	Intel Core i7-5557U CPU 3.10GHz (Broadwell)	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Same	504.56	512.59	0.98		Windows 10.0.18362	64bit	Intel Core i7-7700 CPU 3.60GHz (Kaby Lake)	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Slower	573.10	613.95	0.93		Windows 10.0.18362	64bit	AMD Ryzen 7 1800X	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Slower	354.09	519.80	0.68		Windows 10.0.18362	32bit	Intel Xeon CPU E5-1650 v4 3.60GHz	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09

Span.IndexerBench.Ref(length: 1024)

conclusion	Base	Diff	Base/Diff	Modality	Operating System	Arch	Processor Name	Base Runtime	Diff Runtime
Slower	399.19	521.49	0.77		ubuntu 18.04	64bit	Intel Xeon CPU E5-1650 v4 3.60GHz	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Slower	419.01	535.09	0.78		Windows 10.0.18362	64bit	Intel Xeon CPU E5-1650 v4 3.60GHz	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Slower	625.04	837.85	0.75		ubuntu 16.04	64bit	Intel Xeon CPU E5-2673 v4 2.30GHz	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-01
Slower	608.25	852.45	0.71	several?	ubuntu 18.04	64bit	Intel Xeon CPU E5-2673 v4 2.30GHz	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-01
Slower	467.22	615.19	0.76		macOS Mojave 10.14.5	64bit	Intel Core i7-5557U CPU 3.10GHz (Broadwell)	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Slower	467.13	607.31	0.77		Windows 10.0.18362	64bit	Intel Core i7-5557U CPU 3.10GHz (Broadwell)	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Same	505.50	515.87	0.98		Windows 10.0.18362	64bit	Intel Core i7-7700 CPU 3.60GHz (Kaby Lake)	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Slower	573.74	629.88	0.91		Windows 10.0.18362	64bit	AMD Ryzen 7 1800X	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Slower	347.24	519.61	0.67		Windows 10.0.18362	32bit	Intel Xeon CPU E5-1650 v4 3.60GHz	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09

Span.IndexerBench.KnownSizeArray(length: 1024)

conclusion	Base	Diff	Base/Diff	Modality	Operating System	Arch	Processor Name	Base Runtime	Diff Runtime
Slower	398.81	521.80	0.76		ubuntu 18.04	64bit	Intel Xeon CPU E5-1650 v4 3.60GHz	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Slower	415.71	542.60	0.77	bimodal	Windows 10.0.18362	64bit	Intel Xeon CPU E5-1650 v4 3.60GHz	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Slower	618.45	830.41	0.74		ubuntu 16.04	64bit	Intel Xeon CPU E5-2673 v4 2.30GHz	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-01
Slower	616.57	853.14	0.72	bimodal	ubuntu 18.04	64bit	Intel Xeon CPU E5-2673 v4 2.30GHz	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-01
Slower	466.67	609.96	0.77		macOS Mojave 10.14.5	64bit	Intel Core i7-5557U CPU 3.10GHz (Broadwell)	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Slower	467.38	609.53	0.77		Windows 10.0.18362	64bit	Intel Core i7-5557U CPU 3.10GHz (Broadwell)	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Same	503.60	512.49	0.98		Windows 10.0.18362	64bit	Intel Core i7-7700 CPU 3.60GHz (Kaby Lake)	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Slower	572.36	613.80	0.93		Windows 10.0.18362	64bit	AMD Ryzen 7 1800X	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Slower	354.24	520.18	0.68		Windows 10.0.18362	32bit	Intel Xeon CPU E5-1650 v4 3.60GHz	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09

Span.IndexerBench.Indexer1(length: 1024)

conclusion	Base	Diff	Base/Diff	Modality	Operating System	Arch	Processor Name	Base Runtime	Diff Runtime
Slower	398.97	521.87	0.76		ubuntu 18.04	64bit	Intel Xeon CPU E5-1650 v4 3.60GHz	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Slower	400.64	539.44	0.74		Windows 10.0.18362	64bit	Intel Xeon CPU E5-1650 v4 3.60GHz	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Slower	602.35	828.72	0.73		ubuntu 16.04	64bit	Intel Xeon CPU E5-2673 v4 2.30GHz	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-01
Slower	589.19	859.12	0.69		ubuntu 18.04	64bit	Intel Xeon CPU E5-2673 v4 2.30GHz	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-01
Slower	466.83	612.29	0.76		macOS Mojave 10.14.5	64bit	Intel Core i7-5557U CPU 3.10GHz (Broadwell)	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Slower	467.46	608.55	0.77		Windows 10.0.18362	64bit	Intel Core i7-5557U CPU 3.10GHz (Broadwell)	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Same	501.33	511.54	0.98		Windows 10.0.18362	64bit	Intel Core i7-7700 CPU 3.60GHz (Kaby Lake)	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Slower	572.90	613.57	0.93		Windows 10.0.18362	64bit	AMD Ryzen 7 1800X	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Slower	428.42	525.23	0.82		Windows 10.0.18362	32bit	Intel Xeon CPU E5-1650 v4 3.60GHz	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09

Span.IndexerBench.Indexer4(length: 1024)

conclusion	Base	Diff	Base/Diff	Modality	Operating System	Arch	Processor Name	Base Runtime	Diff Runtime
Slower	3972.34	5188.56	0.77		ubuntu 18.04	64bit	Intel Xeon CPU E5-1650 v4 3.60GHz	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Slower	3996.93	5433.27	0.74		Windows 10.0.18362	64bit	Intel Xeon CPU E5-1650 v4 3.60GHz	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Slower	6131.97	8279.67	0.74		ubuntu 16.04	64bit	Intel Xeon CPU E5-2673 v4 2.30GHz	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-01
Slower	6151.58	8454.14	0.73		ubuntu 18.04	64bit	Intel Xeon CPU E5-2673 v4 2.30GHz	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-01
Slower	4647.49	6054.22	0.77		macOS Mojave 10.14.5	64bit	Intel Core i7-5557U CPU 3.10GHz (Broadwell)	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Slower	4665.63	6055.60	0.77		Windows 10.0.18362	64bit	Intel Core i7-5557U CPU 3.10GHz (Broadwell)	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Slower	3804.46	5062.46	0.75		Windows 10.0.18362	64bit	Intel Core i7-7700 CPU 3.60GHz (Kaby Lake)	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Faster	6174.15	5687.63	1.09		Windows 10.0.18362	64bit	AMD Ryzen 7 1800X	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Slower	4636.43	5428.14	0.85		Windows 10.0.18362	32bit	Intel Xeon CPU E5-1650 v4 3.60GHz	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09

Span.IndexerBench.Fixed1(length: 1024)

conclusion	Base	Diff	Base/Diff	Modality	Operating System	Arch	Processor Name	Base Runtime	Diff Runtime
Slower	420.13	521.20	0.81		ubuntu 18.04	64bit	Intel Xeon CPU E5-1650 v4 3.60GHz	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Slower	400.80	533.08	0.75		Windows 10.0.18362	64bit	Intel Xeon CPU E5-1650 v4 3.60GHz	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Slower	642.95	823.73	0.78		ubuntu 16.04	64bit	Intel Xeon CPU E5-2673 v4 2.30GHz	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-01
Slower	639.33	847.92	0.75		ubuntu 18.04	64bit	Intel Xeon CPU E5-2673 v4 2.30GHz	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-01
Slower	491.45	611.75	0.80		macOS Mojave 10.14.5	64bit	Intel Core i7-5557U CPU 3.10GHz (Broadwell)	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Slower	468.35	608.89	0.77		Windows 10.0.18362	64bit	Intel Core i7-5557U CPU 3.10GHz (Broadwell)	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Slower	381.31	510.91	0.75		Windows 10.0.18362	64bit	Intel Core i7-7700 CPU 3.60GHz (Kaby Lake)	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Faster	623.19	569.85	1.09		Windows 10.0.18362	64bit	AMD Ryzen 7 1800X	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Slower	365.03	520.36	0.70		Windows 10.0.18362	32bit	Intel Xeon CPU E5-1650 v4 3.60GHz	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09

Span.IndexerBench.Fixed2(length: 1024)

conclusion	Base	Diff	Base/Diff	Modality	Operating System	Arch	Processor Name	Base Runtime	Diff Runtime
Slower	420.51	521.18	0.81		ubuntu 18.04	64bit	Intel Xeon CPU E5-1650 v4 3.60GHz	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Slower	402.37	538.17	0.75		Windows 10.0.18362	64bit	Intel Xeon CPU E5-1650 v4 3.60GHz	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Slower	639.55	828.50	0.77		ubuntu 16.04	64bit	Intel Xeon CPU E5-2673 v4 2.30GHz	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-01
Slower	677.64	846.10	0.80		ubuntu 18.04	64bit	Intel Xeon CPU E5-2673 v4 2.30GHz	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-01
Slower	491.73	612.01	0.80		macOS Mojave 10.14.5	64bit	Intel Core i7-5557U CPU 3.10GHz (Broadwell)	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Slower	468.36	610.51	0.77		Windows 10.0.18362	64bit	Intel Core i7-5557U CPU 3.10GHz (Broadwell)	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Slower	380.45	510.97	0.74		Windows 10.0.18362	64bit	Intel Core i7-7700 CPU 3.60GHz (Kaby Lake)	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Faster	623.16	570.02	1.09		Windows 10.0.18362	64bit	AMD Ryzen 7 1800X	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Slower	353.62	520.61	0.68		Windows 10.0.18362	32bit	Intel Xeon CPU E5-1650 v4 3.60GHz	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09

Span.IndexerBench.ReadOnlyIndexer1(length: 1024)

conclusion	Base	Diff	Base/Diff	Modality	Operating System	Arch	Processor Name	Base Runtime	Diff Runtime
Slower	398.95	520.83	0.77		ubuntu 18.04	64bit	Intel Xeon CPU E5-1650 v4 3.60GHz	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Slower	419.13	546.08	0.77	several?	Windows 10.0.18362	64bit	Intel Xeon CPU E5-1650 v4 3.60GHz	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Slower	609.47	827.16	0.74		ubuntu 16.04	64bit	Intel Xeon CPU E5-2673 v4 2.30GHz	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-01
Slower	600.26	852.35	0.70		ubuntu 18.04	64bit	Intel Xeon CPU E5-2673 v4 2.30GHz	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-01
Slower	467.02	608.92	0.77		macOS Mojave 10.14.5	64bit	Intel Core i7-5557U CPU 3.10GHz (Broadwell)	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Slower	467.26	608.47	0.77		Windows 10.0.18362	64bit	Intel Core i7-5557U CPU 3.10GHz (Broadwell)	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Same	503.19	513.62	0.98		Windows 10.0.18362	64bit	Intel Core i7-7700 CPU 3.60GHz (Kaby Lake)	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Slower	572.38	613.86	0.93		Windows 10.0.18362	64bit	AMD Ryzen 7 1800X	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Slower	423.68	520.98	0.81	bimodal	Windows 10.0.18362	32bit	Intel Xeon CPU E5-1650 v4 3.60GHz	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09

Span.IndexerBench.KnownSizeCtor2(length: 1024)

conclusion	Base	Diff	Base/Diff	Modality	Operating System	Arch	Processor Name	Base Runtime	Diff Runtime
Slower	408.16	485.92	0.84		ubuntu 18.04	64bit	Intel Xeon CPU E5-1650 v4 3.60GHz	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Slower	418.60	481.79	0.87	bimodal	Windows 10.0.18362	64bit	Intel Xeon CPU E5-1650 v4 3.60GHz	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Slower	634.84	772.33	0.82		ubuntu 16.04	64bit	Intel Xeon CPU E5-2673 v4 2.30GHz	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-01
Slower	610.34	758.47	0.80		ubuntu 18.04	64bit	Intel Xeon CPU E5-2673 v4 2.30GHz	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-01
Slower	478.02	540.33	0.88		macOS Mojave 10.14.5	64bit	Intel Core i7-5557U CPU 3.10GHz (Broadwell)	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Slower	478.21	541.53	0.88		Windows 10.0.18362	64bit	Intel Core i7-5557U CPU 3.10GHz (Broadwell)	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Same	507.32	513.82	0.99		Windows 10.0.18362	64bit	Intel Core i7-7700 CPU 3.60GHz (Kaby Lake)	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Same	618.65	609.41	1.02		Windows 10.0.18362	64bit	AMD Ryzen 7 1800X	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Slower	359.62	436.63	0.82		Windows 10.0.18362	32bit	Intel Xeon CPU E5-1650 v4 3.60GHz	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09

Span.IndexerBench.SameIndex1(length: 1024)

conclusion	Base	Diff	Base/Diff	Modality	Operating System	Arch	Processor Name	Base Runtime	Diff Runtime
Same	657.81	659.89	1.00		ubuntu 18.04	64bit	Intel Xeon CPU E5-1650 v4 3.60GHz	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Slower	661.20	773.44	0.85		Windows 10.0.18362	64bit	Intel Xeon CPU E5-1650 v4 3.60GHz	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Same	1026.46	1046.39	0.98		ubuntu 16.04	64bit	Intel Xeon CPU E5-2673 v4 2.30GHz	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-01
Slower	957.95	1077.67	0.89		ubuntu 18.04	64bit	Intel Xeon CPU E5-2673 v4 2.30GHz	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-01
Same	769.67	771.83	1.00		macOS Mojave 10.14.5	64bit	Intel Core i7-5557U CPU 3.10GHz (Broadwell)	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Slower	770.23	872.50	0.88		Windows 10.0.18362	64bit	Intel Core i7-5557U CPU 3.10GHz (Broadwell)	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Slower	624.48	710.11	0.88		Windows 10.0.18362	64bit	Intel Core i7-7700 CPU 3.60GHz (Kaby Lake)	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Same	690.25	694.49	0.99		Windows 10.0.18362	64bit	AMD Ryzen 7 1800X	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Slower	701.73	1304.76	0.54	bimodal	Windows 10.0.18362	32bit	Intel Xeon CPU E5-1650 v4 3.60GHz	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09

Span.IndexerBench.Indexer5(length: 1024)

conclusion	Base	Diff	Base/Diff	Modality	Operating System	Arch	Processor Name	Base Runtime	Diff Runtime
Slower	468.31	525.20	0.89		ubuntu 18.04	64bit	Intel Xeon CPU E5-1650 v4 3.60GHz	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Slower	469.55	536.04	0.88		Windows 10.0.18362	64bit	Intel Xeon CPU E5-1650 v4 3.60GHz	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Slower	726.27	831.06	0.87		ubuntu 16.04	64bit	Intel Xeon CPU E5-2673 v4 2.30GHz	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-01
Slower	698.31	853.37	0.82		ubuntu 18.04	64bit	Intel Xeon CPU E5-2673 v4 2.30GHz	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-01
Slower	548.91	636.59	0.86		macOS Mojave 10.14.5	64bit	Intel Core i7-5557U CPU 3.10GHz (Broadwell)	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Slower	548.80	611.24	0.90		Windows 10.0.18362	64bit	Intel Core i7-5557U CPU 3.10GHz (Broadwell)	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Same	523.78	511.01	1.02		Windows 10.0.18362	64bit	Intel Core i7-7700 CPU 3.60GHz (Kaby Lake)	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Same	641.20	634.45	1.01		Windows 10.0.18362	64bit	AMD Ryzen 7 1800X	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Slower	461.45	522.35	0.88		Windows 10.0.18362	32bit	Intel Xeon CPU E5-1650 v4 3.60GHz	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09

Span.IndexerBench.CoveredIndex2(length: 1024)

conclusion	Base	Diff	Base/Diff	Modality	Operating System	Arch	Processor Name	Base Runtime	Diff Runtime
Same	788.04	787.27	1.00		ubuntu 18.04	64bit	Intel Xeon CPU E5-1650 v4 3.60GHz	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Same	825.55	820.79	1.01		Windows 10.0.18362	64bit	Intel Xeon CPU E5-1650 v4 3.60GHz	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Same	1211.44	1243.19	0.97		ubuntu 16.04	64bit	Intel Xeon CPU E5-2673 v4 2.30GHz	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-01
Slower	1147.60	1278.93	0.90		ubuntu 18.04	64bit	Intel Xeon CPU E5-2673 v4 2.30GHz	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-01
Same	920.77	920.90	1.00		macOS Mojave 10.14.5	64bit	Intel Core i7-5557U CPU 3.10GHz (Broadwell)	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Same	921.72	925.10	1.00		Windows 10.0.18362	64bit	Intel Core i7-5557U CPU 3.10GHz (Broadwell)	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Slower	694.50	742.79	0.93		Windows 10.0.18362	64bit	Intel Core i7-7700 CPU 3.60GHz (Kaby Lake)	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Same	829.12	845.88	0.98		Windows 10.0.18362	64bit	AMD Ryzen 7 1800X	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Slower	971.68	1307.68	0.74	several?	Windows 10.0.18362	32bit	Intel Xeon CPU E5-1650 v4 3.60GHz	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09

Span.IndexerBench.CoveredIndex1(length: 1024)

conclusion	Base	Diff	Base/Diff	Modality	Operating System	Arch	Processor Name	Base Runtime	Diff Runtime
Same	923.26	924.73	1.00		ubuntu 18.04	64bit	Intel Xeon CPU E5-1650 v4 3.60GHz	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Same	932.80	958.87	0.97		Windows 10.0.18362	64bit	Intel Xeon CPU E5-1650 v4 3.60GHz	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Same	1459.93	1461.07	1.00		ubuntu 16.04	64bit	Intel Xeon CPU E5-2673 v4 2.30GHz	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-01
Slower	1359.89	1534.14	0.89		ubuntu 18.04	64bit	Intel Xeon CPU E5-2673 v4 2.30GHz	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-01
Same	1081.03	1081.87	1.00		macOS Mojave 10.14.5	64bit	Intel Core i7-5557U CPU 3.10GHz (Broadwell)	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Same	1092.06	1091.26	1.00		Windows 10.0.18362	64bit	Intel Core i7-5557U CPU 3.10GHz (Broadwell)	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Same	864.12	877.16	0.99		Windows 10.0.18362	64bit	Intel Core i7-7700 CPU 3.60GHz (Kaby Lake)	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Same	1076.79	1077.75	1.00		Windows 10.0.18362	64bit	AMD Ryzen 7 1800X	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Slower	1075.66	1310.84	0.82		Windows 10.0.18362	32bit	Intel Xeon CPU E5-1650 v4 3.60GHz	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09

Span.IndexerBench.CoveredIndex3(length: 1024)

conclusion	Base	Diff	Base/Diff	Modality	Operating System	Arch	Processor Name	Base Runtime	Diff Runtime
Same	1045.62	1044.12	1.00		ubuntu 18.04	64bit	Intel Xeon CPU E5-1650 v4 3.60GHz	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Same	1097.08	1090.55	1.01		Windows 10.0.18362	64bit	Intel Xeon CPU E5-1650 v4 3.60GHz	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Same	1671.09	1669.45	1.00		ubuntu 16.04	64bit	Intel Xeon CPU E5-2673 v4 2.30GHz	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-01
Slower	1546.95	1703.10	0.91		ubuntu 18.04	64bit	Intel Xeon CPU E5-2673 v4 2.30GHz	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-01
Same	1222.73	1222.78	1.00		macOS Mojave 10.14.5	64bit	Intel Core i7-5557U CPU 3.10GHz (Broadwell)	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Same	1223.02	1227.78	1.00		Windows 10.0.18362	64bit	Intel Core i7-5557U CPU 3.10GHz (Broadwell)	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Same	947.79	959.48	0.99		Windows 10.0.18362	64bit	Intel Core i7-7700 CPU 3.60GHz (Kaby Lake)	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Same	973.04	971.47	1.00		Windows 10.0.18362	64bit	AMD Ryzen 7 1800X	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Slower	1568.51	1817.35	0.86		Windows 10.0.18362	32bit	Intel Xeon CPU E5-1650 v4 3.60GHz	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09

Span.IndexerBench.Indexer6(length: 1024)

conclusion	Base	Diff	Base/Diff	Modality	Operating System	Arch	Processor Name	Base Runtime	Diff Runtime
Same	524.49	525.30	1.00		ubuntu 18.04	64bit	Intel Xeon CPU E5-1650 v4 3.60GHz	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Same	524.74	550.83	0.95		Windows 10.0.18362	64bit	Intel Xeon CPU E5-1650 v4 3.60GHz	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Same	820.63	847.23	0.97		ubuntu 16.04	64bit	Intel Xeon CPU E5-2673 v4 2.30GHz	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-01
Slower	761.34	859.80	0.89		ubuntu 18.04	64bit	Intel Xeon CPU E5-2673 v4 2.30GHz	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-01
Same	612.82	617.78	0.99		macOS Mojave 10.14.5	64bit	Intel Core i7-5557U CPU 3.10GHz (Broadwell)	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Same	612.32	614.26	1.00		Windows 10.0.18362	64bit	Intel Core i7-5557U CPU 3.10GHz (Broadwell)	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Same	503.50	511.92	0.98		Windows 10.0.18362	64bit	Intel Core i7-7700 CPU 3.60GHz (Kaby Lake)	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Same	590.17	579.93	1.02		Windows 10.0.18362	64bit	AMD Ryzen 7 1800X	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Same	547.29	529.78	1.03		Windows 10.0.18362	32bit	Intel Xeon CPU E5-1650 v4 3.60GHz	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09

Span.IndexerBench.WriteViaIndexer2(length: 1024)

conclusion	Base	Diff	Base/Diff	Modality	Operating System	Arch	Processor Name	Base Runtime	Diff Runtime
Same	558.46	556.47	1.00		ubuntu 18.04	64bit	Intel Xeon CPU E5-1650 v4 3.60GHz	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Same	557.77	574.42	0.97		Windows 10.0.18362	64bit	Intel Xeon CPU E5-1650 v4 3.60GHz	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Same	888.84	898.23	0.99		ubuntu 16.04	64bit	Intel Xeon CPU E5-2673 v4 2.30GHz	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-01
Slower	867.14	923.61	0.94		ubuntu 18.04	64bit	Intel Xeon CPU E5-2673 v4 2.30GHz	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-01
Same	652.82	658.22	0.99		macOS Mojave 10.14.5	64bit	Intel Core i7-5557U CPU 3.10GHz (Broadwell)	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Same	651.38	651.99	1.00		Windows 10.0.18362	64bit	Intel Core i7-5557U CPU 3.10GHz (Broadwell)	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Same	534.85	543.10	0.98		Windows 10.0.18362	64bit	Intel Core i7-7700 CPU 3.60GHz (Kaby Lake)	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Same	719.30	720.51	1.00		Windows 10.0.18362	64bit	AMD Ryzen 7 1800X	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Same	569.83	592.66	0.96	bimodal	Windows 10.0.18362	32bit	Intel Xeon CPU E5-1650 v4 3.60GHz	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09

Span.IndexerBench.SameIndex2(length: 1024)

conclusion	Base	Diff	Base/Diff	Modality	Operating System	Arch	Processor Name	Base Runtime	Diff Runtime
Same	781.74	783.14	1.00		ubuntu 18.04	64bit	Intel Xeon CPU E5-1650 v4 3.60GHz	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Same	805.61	803.76	1.00		Windows 10.0.18362	64bit	Intel Xeon CPU E5-1650 v4 3.60GHz	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Same	1186.70	1238.72	0.96		ubuntu 16.04	64bit	Intel Xeon CPU E5-2673 v4 2.30GHz	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-01
Slower	1129.68	1281.30	0.88		ubuntu 18.04	64bit	Intel Xeon CPU E5-2673 v4 2.30GHz	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-01
Same	914.39	917.36	1.00		macOS Mojave 10.14.5	64bit	Intel Core i7-5557U CPU 3.10GHz (Broadwell)	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Same	917.81	917.99	1.00		Windows 10.0.18362	64bit	Intel Core i7-5557U CPU 3.10GHz (Broadwell)	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Same	690.57	708.05	0.98		Windows 10.0.18362	64bit	Intel Core i7-7700 CPU 3.60GHz (Kaby Lake)	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Same	864.34	868.16	1.00		Windows 10.0.18362	64bit	AMD Ryzen 7 1800X	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Same	1375.74	1318.25	1.04		Windows 10.0.18362	32bit	Intel Xeon CPU E5-1650 v4 3.60GHz	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09

Span.IndexerBench.WriteViaIndexer1(length: 1024)

conclusion	Base	Diff	Base/Diff	Modality	Operating System	Arch	Processor Name	Base Runtime	Diff Runtime
Same	1531.16	1528.97	1.00		ubuntu 18.04	64bit	Intel Xeon CPU E5-1650 v4 3.60GHz	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Same	1538.66	1572.06	0.98		Windows 10.0.18362	64bit	Intel Xeon CPU E5-1650 v4 3.60GHz	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Same	2380.71	2435.27	0.98		ubuntu 16.04	64bit	Intel Xeon CPU E5-2673 v4 2.30GHz	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-01
Same	2343.10	2497.86	0.94		ubuntu 18.04	64bit	Intel Xeon CPU E5-2673 v4 2.30GHz	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-01
Same	1789.46	1806.14	0.99		macOS Mojave 10.14.5	64bit	Intel Core i7-5557U CPU 3.10GHz (Broadwell)	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Same	1791.95	1791.49	1.00		Windows 10.0.18362	64bit	Intel Core i7-5557U CPU 3.10GHz (Broadwell)	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Same	1344.73	1391.71	0.97		Windows 10.0.18362	64bit	Intel Core i7-7700 CPU 3.60GHz (Kaby Lake)	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Same	1915.16	1914.12	1.00		Windows 10.0.18362	64bit	AMD Ryzen 7 1800X	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09
Same	1605.37	1531.14	1.05		Windows 10.0.18362	32bit	Intel Xeon CPU E5-1650 v4 3.60GHz	.NET Core 2.2.6	.NET Core 3.0.0-preview8-27919-09