Add bench_overhead.jl

[tkf]

from #307

[codecov]

Codecov Report

Merging #308 into master will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##           master     #308   +/-   ##
=======================================
  Coverage   89.98%   89.98%           
=======================================
  Files          24       24           
  Lines        1448     1448           
=======================================
  Hits         1303     1303           
  Misses        145      145           

---

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update dcd0770...e0f417c. Read the comment docs.

[github-actions]

Benchmark result

Judge result

Benchmark Report for /home/runner/work/Transducers.jl/Transducers.jl

Job Properties

• Time of benchmarks:
  • Target: 23 Jun 2020 - 00:44
  • Baseline: 23 Jun 2020 - 00:48
• Package commits:
  • Target: 359c69
  • Baseline: dcd077
• Julia commits:
  • Target: 44fa15
  • Baseline: 44fa15
• Julia command flags:
  • Target: None
  • Baseline: None
• Environment variables:
  • Target: OMP_NUM_THREADS => 1 JULIA_NUM_THREADS => 1
  • Baseline: OMP_NUM_THREADS => 1 JULIA_NUM_THREADS => 1

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).

ID	time ratio	memory ratio
["cat", "base"]	1.07 (5%) ❌	1.00 (1%)
["collect", "identity-float"]	1.07 (5%) ❌	1.00 (1%)
["dot", "blas"]	1.06 (5%) ❌	1.00 (1%)
["filter_map_map!", "man"]	1.20 (5%) ❌	1.00 (1%)
["filter_map_reduce", "xf"]	1.13 (5%) ❌	1.00 (1%)
["gemm", "fusedmul", "xf", "16"]	1.19 (5%) ❌	1.00 (1%)
["gemm", "fusedmul", "xf", "2"]	0.83 (5%) ✅	1.00 (1%)
["gemm", "fusedmul", "xf", "32"]	0.84 (5%) ✅	1.00 (1%)
["gemm", "fusedmul", "xf", "8"]	1.14 (5%) ❌	1.00 (1%)
["gemm", "mul", "linalg", "8"]	0.67 (5%) ✅	1.00 (1%)
["gemm", "mul", "man", "false", "32"]	0.88 (5%) ✅	1.00 (1%)
["gemm", "mul", "man", "false", "8"]	0.87 (5%) ✅	1.00 (1%)
["gemm", "mul", "man", "ivdep", "32"]	0.88 (5%) ✅	1.00 (1%)
["gemm", "mul", "man", "ivdep", "8"]	0.79 (5%) ✅	1.00 (1%)
["gemm", "mul", "man", "true", "256"]	0.94 (5%) ✅	1.00 (1%)
["gemm", "mul", "man", "true", "8"]	0.83 (5%) ✅	1.00 (1%)
["gemm", "mul", "xf", "false", "256"]	0.93 (5%) ✅	1.00 (1%)
["gemm", "mul", "xf", "false", "32"]	0.88 (5%) ✅	1.00 (1%)
["gemm", "mul", "xf", "false", "8"]	0.79 (5%) ✅	1.00 (1%)
["gemm", "mul", "xf", "true", "32"]	0.87 (5%) ✅	1.00 (1%)
["gemm", "mul", "xf", "true", "8"]	0.89 (5%) ✅	1.00 (1%)
["missing_dot", "xf_nota"]	1.06 (5%) ❌	1.00 (1%)

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

• ["cat"]
• ["collect"]
• ["dot"]
• ["filter_map_map!"]
• ["filter_map_reduce"]
• ["findall"]
• ["gemm", "fusedmul", "blas"]
• ["gemm", "fusedmul", "xf"]
• ["gemm", "mul", "linalg"]
• ["gemm", "mul", "man", "false"]
• ["gemm", "mul", "man", "ivdep"]
• ["gemm", "mul", "man", "true"]
• ["gemm", "mul", "xf", "false"]
• ["gemm", "mul", "xf", "ivdep"]
• ["gemm", "mul", "xf", "true"]
• ["groupby", "sum"]
• ["missing_argmax"]
• ["missing_dot"]
• ["partition_by"]

Julia versioninfo

Target

Julia Version 1.4.2
Commit 44fa15b150* (2020-05-23 18:35 UTC)
Platform Info:
  OS: Linux (x86_64-pc-linux-gnu)
      Ubuntu 18.04.4 LTS
  uname: Linux 5.3.0-1028-azure #29~18.04.1-Ubuntu SMP Fri Jun 5 14:32:34 UTC 2020 x86_64 x86_64
  CPU: Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz: 
              speed         user         nice          sys         idle          irq
       #1  2095 MHz      39644 s          0 s       1222 s      20668 s          0 s
       #2  2095 MHz      15652 s          0 s       1460 s      44373 s          0 s
       
  Memory: 6.764884948730469 GB (3307.3203125 MB free)
  Uptime: 630.0 sec
  Load Avg:  1.18115234375  1.015625  0.58935546875
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-8.0.1 (ORCJIT, skylake)

Baseline

Julia Version 1.4.2
Commit 44fa15b150* (2020-05-23 18:35 UTC)
Platform Info:
  OS: Linux (x86_64-pc-linux-gnu)
      Ubuntu 18.04.4 LTS
  uname: Linux 5.3.0-1028-azure #29~18.04.1-Ubuntu SMP Fri Jun 5 14:32:34 UTC 2020 x86_64 x86_64
  CPU: Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz: 
              speed         user         nice          sys         idle          irq
       #1  2095 MHz      47167 s          0 s       1310 s      35379 s          0 s
       #2  2095 MHz      30541 s          0 s       1560 s      51742 s          0 s
       
  Memory: 6.764884948730469 GB (3240.73046875 MB free)
  Uptime: 855.0 sec
  Load Avg:  1.02490234375  1.0283203125  0.70068359375
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-8.0.1 (ORCJIT, skylake)

---

Target result

Benchmark Report for /home/runner/work/Transducers.jl/Transducers.jl

Job Properties

• Time of benchmark: 23 Jun 2020 - 0:44
• Package commit: 359c69
• Julia commit: 44fa15
• Julia command flags: None
• Environment variables: OMP_NUM_THREADS => 1 JULIA_NUM_THREADS => 1

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID	time	GC time	memory	allocations
["cat", "base"]	1.670 μs (5%)
["cat", "xf"]	1.630 μs (5%)		80 bytes (1%)	3
["collect", "filter-missing"]	91.712 μs (5%)		345.36 KiB (1%)	10018
["collect", "identity-float"]	70.009 μs (5%)		569.20 KiB (1%)	10018
["collect", "identity-union"]	267.535 μs (5%)		705.19 KiB (1%)	16671
["dot", "blas"]	1.100 μs (5%)
["dot", "man"]	1.030 μs (5%)
["dot", "rf"]	1.810 μs (5%)
["dot", "xf"]	1.800 μs (5%)
["filter_map_map!", "man"]	70.004 μs (5%)
["filter_map_map!", "xf"]	589.739 μs (5%)		304 bytes (1%)	17
["filter_map_reduce", "man"]	192.822 μs (5%)
["filter_map_reduce", "xf"]	217.524 μs (5%)
["findall", "base"]	695.784 μs (5%)		2.00 MiB (1%)	21
["findall", "xf-array"]	636.475 μs (5%)		3.04 MiB (1%)	99664
["findall", "xf-iter"]	2.790 ms (5%)		9.63 MiB (1%)	299935
["gemm", "fusedmul", "blas", "16"]	3.795 ms (5%)
["gemm", "fusedmul", "blas", "2"]	2.933 ms (5%)
["gemm", "fusedmul", "blas", "32"]	5.158 ms (5%)
["gemm", "fusedmul", "blas", "8"]	3.120 ms (5%)
["gemm", "fusedmul", "xf", "16"]	4.628 ms (5%)		160 bytes (1%)	6
["gemm", "fusedmul", "xf", "2"]	471.433 μs (5%)		160 bytes (1%)	6
["gemm", "fusedmul", "xf", "32"]	8.564 ms (5%)		160 bytes (1%)	6
["gemm", "fusedmul", "xf", "8"]	2.163 ms (5%)		160 bytes (1%)	6
["gemm", "mul", "linalg", "256"]	755.675 μs (5%)
["gemm", "mul", "linalg", "32"]	2.489 μs (5%)
["gemm", "mul", "linalg", "8"]	201.883 ns (5%)
["gemm", "mul", "man", "false", "256"]	1.390 ms (5%)
["gemm", "mul", "man", "false", "32"]	3.950 μs (5%)
["gemm", "mul", "man", "false", "8"]	347.000 ns (5%)
["gemm", "mul", "man", "ivdep", "256"]	1.376 ms (5%)
["gemm", "mul", "man", "ivdep", "32"]	3.250 μs (5%)
["gemm", "mul", "man", "ivdep", "8"]	317.415 ns (5%)
["gemm", "mul", "man", "true", "256"]	1.383 ms (5%)
["gemm", "mul", "man", "true", "32"]	3.925 μs (5%)
["gemm", "mul", "man", "true", "8"]	332.537 ns (5%)
["gemm", "mul", "xf", "false", "256"]	1.392 ms (5%)		48 bytes (1%)	2
["gemm", "mul", "xf", "false", "32"]	3.963 μs (5%)		48 bytes (1%)	2
["gemm", "mul", "xf", "false", "8"]	315.966 ns (5%)		48 bytes (1%)	2
["gemm", "mul", "xf", "ivdep", "256"]	1.378 ms (5%)		48 bytes (1%)	2
["gemm", "mul", "xf", "ivdep", "32"]	3.138 μs (5%)		48 bytes (1%)	2
["gemm", "mul", "xf", "ivdep", "8"]	300.024 ns (5%)		48 bytes (1%)	2
["gemm", "mul", "xf", "true", "256"]	1.402 ms (5%)		48 bytes (1%)	2
["gemm", "mul", "xf", "true", "32"]	4.015 μs (5%)		48 bytes (1%)	2
["gemm", "mul", "xf", "true", "8"]	355.009 ns (5%)		48 bytes (1%)	2
["groupby", "sum", "sac"]	209.714 μs (5%)		313.14 KiB (1%)	10007
["groupby", "sum", "xf-with-init"]	156.510 μs (5%)		157.44 KiB (1%)	10008
["groupby", "sum", "xf-without-init"]	154.109 μs (5%)		157.44 KiB (1%)	10008
["missing_argmax", "man"]	2.234 μs (5%)		32 bytes (1%)	1
["missing_argmax", "rf"]	2.122 μs (5%)		32 bytes (1%)	1
["missing_argmax", "xf"]	2.178 μs (5%)		32 bytes (1%)	1
["missing_dot", "equiv"]	1.180 μs (5%)		16 bytes (1%)	1
["missing_dot", "man"]	1.130 μs (5%)		16 bytes (1%)	1
["missing_dot", "naive"]	3.958 μs (5%)		16 bytes (1%)	1
["missing_dot", "rf"]	1.140 μs (5%)		16 bytes (1%)	1
["missing_dot", "rf_nota"]	1.220 μs (5%)		16 bytes (1%)	1
["missing_dot", "xf"]	175.219 μs (5%)		71.98 KiB (1%)	3735
["missing_dot", "xf_nota"]	180.019 μs (5%)		72.34 KiB (1%)	3752
["overhead", "basecase"]	2.967 μs (5%)		1.17 KiB (1%)	21
["partition_by", "man"]	1.656 ms (5%)		352 bytes (1%)	4
["partition_by", "xf"]	2.561 ms (5%)		6.10 MiB (1%)	200007

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

• ["cat"]
• ["collect"]
• ["dot"]
• ["filter_map_map!"]
• ["filter_map_reduce"]
• ["findall"]
• ["gemm", "fusedmul", "blas"]
• ["gemm", "fusedmul", "xf"]
• ["gemm", "mul", "linalg"]
• ["gemm", "mul", "man", "false"]
• ["gemm", "mul", "man", "ivdep"]
• ["gemm", "mul", "man", "true"]
• ["gemm", "mul", "xf", "false"]
• ["gemm", "mul", "xf", "ivdep"]
• ["gemm", "mul", "xf", "true"]
• ["groupby", "sum"]
• ["missing_argmax"]
• ["missing_dot"]
• ["overhead"]
• ["partition_by"]

Julia versioninfo

Julia Version 1.4.2
Commit 44fa15b150* (2020-05-23 18:35 UTC)
Platform Info:
  OS: Linux (x86_64-pc-linux-gnu)
      Ubuntu 18.04.4 LTS
  uname: Linux 5.3.0-1028-azure #29~18.04.1-Ubuntu SMP Fri Jun 5 14:32:34 UTC 2020 x86_64 x86_64
  CPU: Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz: 
              speed         user         nice          sys         idle          irq
       #1  2095 MHz      39644 s          0 s       1222 s      20668 s          0 s
       #2  2095 MHz      15652 s          0 s       1460 s      44373 s          0 s
       
  Memory: 6.764884948730469 GB (3307.3203125 MB free)
  Uptime: 630.0 sec
  Load Avg:  1.18115234375  1.015625  0.58935546875
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-8.0.1 (ORCJIT, skylake)

---

Baseline result

Benchmark Report for /home/runner/work/Transducers.jl/Transducers.jl

Job Properties

• Time of benchmark: 23 Jun 2020 - 0:48
• Package commit: dcd077
• Julia commit: 44fa15
• Julia command flags: None
• Environment variables: OMP_NUM_THREADS => 1 JULIA_NUM_THREADS => 1

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID	time	GC time	memory	allocations
["cat", "base"]	1.560 μs (5%)
["cat", "xf"]	1.630 μs (5%)		80 bytes (1%)	3
["collect", "filter-missing"]	90.005 μs (5%)		345.36 KiB (1%)	10018
["collect", "identity-float"]	65.503 μs (5%)		569.20 KiB (1%)	10018
["collect", "identity-union"]	255.013 μs (5%)		705.44 KiB (1%)	16685
["dot", "blas"]	1.040 μs (5%)
["dot", "man"]	1.020 μs (5%)
["dot", "rf"]	1.790 μs (5%)
["dot", "xf"]	1.810 μs (5%)
["filter_map_map!", "man"]	58.503 μs (5%)
["filter_map_map!", "xf"]	579.926 μs (5%)		304 bytes (1%)	17
["filter_map_reduce", "man"]	192.110 μs (5%)
["filter_map_reduce", "xf"]	191.710 μs (5%)
["findall", "base"]	681.936 μs (5%)		2.00 MiB (1%)	21
["findall", "xf-array"]	637.033 μs (5%)		3.05 MiB (1%)	99955
["findall", "xf-iter"]	2.747 ms (5%)		9.63 MiB (1%)	299927
["gemm", "fusedmul", "blas", "16"]	3.978 ms (5%)
["gemm", "fusedmul", "blas", "2"]	3.086 ms (5%)
["gemm", "fusedmul", "blas", "32"]	5.202 ms (5%)
["gemm", "fusedmul", "blas", "8"]	3.117 ms (5%)
["gemm", "fusedmul", "xf", "16"]	3.880 ms (5%)		160 bytes (1%)	6
["gemm", "fusedmul", "xf", "2"]	568.925 μs (5%)		160 bytes (1%)	6
["gemm", "fusedmul", "xf", "32"]	10.209 ms (5%)		160 bytes (1%)	6
["gemm", "fusedmul", "xf", "8"]	1.896 ms (5%)		160 bytes (1%)	6
["gemm", "mul", "linalg", "256"]	760.237 μs (5%)
["gemm", "mul", "linalg", "32"]	2.500 μs (5%)
["gemm", "mul", "linalg", "8"]	300.000 ns (5%)
["gemm", "mul", "man", "false", "256"]	1.463 ms (5%)
["gemm", "mul", "man", "false", "32"]	4.500 μs (5%)
["gemm", "mul", "man", "false", "8"]	400.000 ns (5%)
["gemm", "mul", "man", "ivdep", "256"]	1.445 ms (5%)
["gemm", "mul", "man", "ivdep", "32"]	3.700 μs (5%)
["gemm", "mul", "man", "ivdep", "8"]	400.000 ns (5%)
["gemm", "mul", "man", "true", "256"]	1.467 ms (5%)
["gemm", "mul", "man", "true", "32"]	4.000 μs (5%)
["gemm", "mul", "man", "true", "8"]	400.000 ns (5%)
["gemm", "mul", "xf", "false", "256"]	1.490 ms (5%)		48 bytes (1%)	2
["gemm", "mul", "xf", "false", "32"]	4.500 μs (5%)		48 bytes (1%)	2
["gemm", "mul", "xf", "false", "8"]	400.000 ns (5%)		48 bytes (1%)	2
["gemm", "mul", "xf", "ivdep", "256"]	1.443 ms (5%)		48 bytes (1%)	2
["gemm", "mul", "xf", "ivdep", "32"]	3.200 μs (5%)		48 bytes (1%)	2
["gemm", "mul", "xf", "ivdep", "8"]	300.000 ns (5%)		48 bytes (1%)	2
["gemm", "mul", "xf", "true", "256"]	1.451 ms (5%)		48 bytes (1%)	2
["gemm", "mul", "xf", "true", "32"]	4.600 μs (5%)		48 bytes (1%)	2
["gemm", "mul", "xf", "true", "8"]	400.000 ns (5%)		48 bytes (1%)	2
["groupby", "sum", "sac"]	216.909 μs (5%)		313.14 KiB (1%)	10007
["groupby", "sum", "xf-with-init"]	158.106 μs (5%)		157.44 KiB (1%)	10008
["groupby", "sum", "xf-without-init"]	153.807 μs (5%)		157.44 KiB (1%)	10008
["missing_argmax", "man"]	2.233 μs (5%)		32 bytes (1%)	1
["missing_argmax", "rf"]	2.078 μs (5%)		32 bytes (1%)	1
["missing_argmax", "xf"]	2.078 μs (5%)		32 bytes (1%)	1
["missing_dot", "equiv"]	1.200 μs (5%)		16 bytes (1%)	1
["missing_dot", "man"]	1.130 μs (5%)		16 bytes (1%)	1
["missing_dot", "naive"]	3.943 μs (5%)		16 bytes (1%)	1
["missing_dot", "rf"]	1.150 μs (5%)		16 bytes (1%)	1
["missing_dot", "rf_nota"]	1.210 μs (5%)		16 bytes (1%)	1
["missing_dot", "xf"]	168.208 μs (5%)		72.17 KiB (1%)	3745
["missing_dot", "xf_nota"]	170.109 μs (5%)		72.25 KiB (1%)	3745
["partition_by", "man"]	1.655 ms (5%)		352 bytes (1%)	4
["partition_by", "xf"]	2.482 ms (5%)		6.10 MiB (1%)	200007

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

• ["cat"]
• ["collect"]
• ["dot"]
• ["filter_map_map!"]
• ["filter_map_reduce"]
• ["findall"]
• ["gemm", "fusedmul", "blas"]
• ["gemm", "fusedmul", "xf"]
• ["gemm", "mul", "linalg"]
• ["gemm", "mul", "man", "false"]
• ["gemm", "mul", "man", "ivdep"]
• ["gemm", "mul", "man", "true"]
• ["gemm", "mul", "xf", "false"]
• ["gemm", "mul", "xf", "ivdep"]
• ["gemm", "mul", "xf", "true"]
• ["groupby", "sum"]
• ["missing_argmax"]
• ["missing_dot"]
• ["partition_by"]

Julia versioninfo

Julia Version 1.4.2
Commit 44fa15b150* (2020-05-23 18:35 UTC)
Platform Info:
  OS: Linux (x86_64-pc-linux-gnu)
      Ubuntu 18.04.4 LTS
  uname: Linux 5.3.0-1028-azure #29~18.04.1-Ubuntu SMP Fri Jun 5 14:32:34 UTC 2020 x86_64 x86_64
  CPU: Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz: 
              speed         user         nice          sys         idle          irq
       #1  2095 MHz      47167 s          0 s       1310 s      35379 s          0 s
       #2  2095 MHz      30541 s          0 s       1560 s      51742 s          0 s
       
  Memory: 6.764884948730469 GB (3240.73046875 MB free)
  Uptime: 855.0 sec
  Load Avg:  1.02490234375  1.0283203125  0.70068359375
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-8.0.1 (ORCJIT, skylake)

---

Runtime information

Runtime Info
BLAS #threads	2
BLAS.vendor()	openblas64
Sys.CPU_THREADS	2

lscpu output:

Architecture:        x86_64
CPU op-mode(s):      32-bit, 64-bit
Byte Order:          Little Endian
CPU(s):              2
On-line CPU(s) list: 0,1
Thread(s) per core:  1
Core(s) per socket:  2
Socket(s):           1
NUMA node(s):        1
Vendor ID:           GenuineIntel
CPU family:          6
Model:               85
Model name:          Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz
Stepping:            4
CPU MHz:             2095.243
BogoMIPS:            4190.48
Hypervisor vendor:   Microsoft
Virtualization type: full
L1d cache:           32K
L1i cache:           32K
L2 cache:            1024K
L3 cache:            36608K
NUMA node0 CPU(s):   0,1
Flags:               fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology cpuid pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch invpcid_single pti fsgsbase bmi1 hle avx2 smep bmi2 erms invpcid rtm mpx avx512f avx512dq rdseed adx smap clflushopt avx512cd avx512bw avx512vl xsaveopt xsavec xsaves

Cpu Property	Value
Brand	Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz
Vendor	:Intel
Architecture	:Skylake
Model	Family: 0x06, Model: 0x55, Stepping: 0x04, Type: 0x00
Cores	2 physical cores, 2 logical cores (on executing CPU)
	No Hyperthreading detected
Clock Frequencies	Not supported by CPU
Data Cache	Level 1:3 : (32, 1024, 36608) kbytes
	64 byte cache line size
Address Size	48 bits virtual, 44 bits physical
SIMD	512 bit = 64 byte max. SIMD vector size
Time Stamp Counter	TSC is accessible via rdtsc
	TSC increased at every clock cycle (non-invariant TSC)
Perf. Monitoring	Performance Monitoring Counters (PMC) are not supported
Hypervisor	Yes, Microsoft

[github-actions]

Multi-thread benchmark result

Judge result

Benchmark Report for /home/runner/work/Transducers.jl/Transducers.jl

Job Properties

• Time of benchmarks:
  • Target: 23 Jun 2020 - 00:46
  • Baseline: 23 Jun 2020 - 00:51
• Package commits:
  • Target: 359c69
  • Baseline: dcd077
• Julia commits:
  • Target: 44fa15
  • Baseline: 44fa15
• Julia command flags:
  • Target: None
  • Baseline: None
• Environment variables:
  • Target: JULIA_NUM_THREADS => 2
  • Baseline: JULIA_NUM_THREADS => 2

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).

ID	time ratio	memory ratio
["collect", "unordered", "basesize=1024"]	1.16 (5%) ❌	1.08 (1%) ❌
["findfirst", "n=500", "foldl"]	0.94 (5%) ✅	1.00 (1%)
["findfirst", "n=500", "reduce", "basesize=128"]	0.93 (5%) ✅	1.00 (1%)
["findfirst", "n=500", "reduce", "basesize=512"]	0.92 (5%) ✅	1.00 (1%)
["overhead", "default"]	0.90 (5%) ✅	1.00 (1%)
["parallel_histogram", "assoc", "basesize=8192"]	0.94 (5%) ✅	1.00 (1%)
["parallel_histogram", "comm", "basesize=4096"]	1.01 (5%)	0.96 (1%) ✅
["parallel_histogram", "comm", "basesize=8192"]	1.13 (5%) ❌	1.02 (1%) ❌
["sum", "random", "foldl"]	0.91 (5%) ✅	1.00 (1%)
["sum", "random", "reduce", "basesize=128"]	0.88 (5%) ✅	1.00 (1%)
["sum", "random", "reduce", "basesize=256"]	0.90 (5%) ✅	1.00 (1%)
["sum", "random", "reduce", "basesize=512"]	0.95 (5%) ✅	1.00 (1%)
["sum", "uniform", "foldl"]	0.86 (5%) ✅	1.00 (1%)
["sum", "uniform", "reduce", "basesize=128"]	0.88 (5%) ✅	1.00 (1%)
["sum", "uniform", "reduce", "basesize=256"]	0.87 (5%) ✅	1.00 (1%)
["sum", "uniform", "reduce", "basesize=512"]	0.91 (5%) ✅	1.00 (1%)
["sum", "valley", "foldl"]	0.90 (5%) ✅	1.00 (1%)
["sum", "valley", "reduce", "basesize=128"]	0.95 (5%) ✅	1.00 (1%)
["sum", "valley", "reduce", "basesize=256"]	1.08 (5%) ❌	1.00 (1%)
["words", "nthreads=2"]	0.92 (5%) ✅	1.00 (1%)
["words", "nthreads=4"]	0.93 (5%) ✅	1.01 (1%)

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

• ["collect", "assoc"]
• ["collect"]
• ["collect", "unordered"]
• ["findfirst", "n=1000"]
• ["findfirst", "n=1000", "reduce"]
• ["findfirst", "n=400"]
• ["findfirst", "n=400", "reduce"]
• ["findfirst", "n=500"]
• ["findfirst", "n=500", "reduce"]
• ["overhead"]
• ["parallel_histogram", "assoc"]
• ["parallel_histogram", "comm"]
• ["parallel_histogram"]
• ["sum", "random"]
• ["sum", "random", "reduce"]
• ["sum", "uniform"]
• ["sum", "uniform", "reduce"]
• ["sum", "valley"]
• ["sum", "valley", "reduce"]
• ["words"]

Julia versioninfo

Target

Julia Version 1.4.2
Commit 44fa15b150* (2020-05-23 18:35 UTC)
Platform Info:
  OS: Linux (x86_64-pc-linux-gnu)
      Ubuntu 18.04.4 LTS
  uname: Linux 5.3.0-1028-azure #29~18.04.1-Ubuntu SMP Fri Jun 5 14:32:34 UTC 2020 x86_64 x86_64
  CPU: Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz: 
              speed         user         nice          sys         idle          irq
       #1  2095 MHz      46514 s          0 s       2262 s      20523 s          0 s
       #2  2095 MHz      51024 s          0 s       2398 s      16380 s          0 s
       
  Memory: 6.764884948730469 GB (3387.64453125 MB free)
  Uptime: 712.0 sec
  Load Avg:  1.66552734375  1.55908203125  0.951171875
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-8.0.1 (ORCJIT, skylake)

Baseline

Julia Version 1.4.2
Commit 44fa15b150* (2020-05-23 18:35 UTC)
Platform Info:
  OS: Linux (x86_64-pc-linux-gnu)
      Ubuntu 18.04.4 LTS
  uname: Linux 5.3.0-1028-azure #29~18.04.1-Ubuntu SMP Fri Jun 5 14:32:34 UTC 2020 x86_64 x86_64
  CPU: Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz: 
              speed         user         nice          sys         idle          irq
       #1  2095 MHz      66936 s          0 s       2800 s      27912 s          0 s
       #2  2095 MHz      74630 s          0 s       2868 s      20551 s          0 s
       
  Memory: 6.764884948730469 GB (3360.33203125 MB free)
  Uptime: 997.0 sec
  Load Avg:  1.7353515625  1.63037109375  1.142578125
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-8.0.1 (ORCJIT, skylake)

---

Target result

Benchmark Report for /home/runner/work/Transducers.jl/Transducers.jl

Job Properties

• Time of benchmark: 23 Jun 2020 - 0:46
• Package commit: 359c69
• Julia commit: 44fa15
• Julia command flags: None
• Environment variables: JULIA_NUM_THREADS => 2

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID	time	GC time	memory	allocations
["collect", "assoc", "basesize=1"]	346.857 ms (5%)	10.053 ms	87.55 MiB (1%)	1590809
["collect", "assoc", "basesize=1024"]	226.548 ms (5%)		1.84 MiB (1%)	1826
["collect", "assoc", "basesize=32"]	230.453 ms (5%)		5.64 MiB (1%)	54030
["collect", "seq"]	442.056 ms (5%)		1.50 MiB (1%)	32787
["collect", "unordered", "basesize=1"]	436.778 ms (5%)		29.15 MiB (1%)	402613
["collect", "unordered", "basesize=1024"]	304.080 ms (5%)		833.64 KiB (1%)	6400
["collect", "unordered", "basesize=32"]	254.974 ms (5%)		1.46 MiB (1%)	16255
["findfirst", "n=1000", "foldl"]	691.297 ms (5%)
["findfirst", "n=1000", "reduce", "basesize=128"]	357.627 ms (5%)		565.22 KiB (1%)	10247
["findfirst", "n=1000", "reduce", "basesize=256"]	358.894 ms (5%)		288.41 KiB (1%)	5242
["findfirst", "n=1000", "reduce", "basesize=512"]	361.227 ms (5%)		150.61 KiB (1%)	2750
["findfirst", "n=400", "foldl"]	519.790 ms (5%)
["findfirst", "n=400", "reduce", "basesize=128"]	268.408 ms (5%)		1.02 MiB (1%)	18916
["findfirst", "n=400", "reduce", "basesize=256"]	269.326 ms (5%)		526.77 KiB (1%)	9555
["findfirst", "n=400", "reduce", "basesize=512"]	273.288 ms (5%)		268.47 KiB (1%)	4901
["findfirst", "n=500", "foldl"]	84.272 ms (5%)
["findfirst", "n=500", "reduce", "basesize=128"]	43.941 ms (5%)		158.41 KiB (1%)	2861
["findfirst", "n=500", "reduce", "basesize=256"]	44.771 ms (5%)		85.69 KiB (1%)	1552
["findfirst", "n=500", "reduce", "basesize=512"]	46.123 ms (5%)		49.45 KiB (1%)	898
["overhead", "default"]	176.006 μs (5%)		147.05 KiB (1%)	2646
["overhead", "stoppable=false"]	174.306 μs (5%)		146.23 KiB (1%)	2631
["overhead", "stoppable=true"]	325.911 μs (5%)		146.48 KiB (1%)	2648
["parallel_histogram", "assoc", "basesize=16384"]	4.504 ms (5%)		732.86 KiB (1%)	118
["parallel_histogram", "assoc", "basesize=4096"]	5.601 ms (5%)		1.80 MiB (1%)	512
["parallel_histogram", "assoc", "basesize=8192"]	4.975 ms (5%)		1.43 MiB (1%)	257
["parallel_histogram", "comm", "basesize=16384"]	15.176 ms (5%)		1.22 MiB (1%)	222
["parallel_histogram", "comm", "basesize=4096"]	25.505 ms (5%)		1.01 MiB (1%)	2852
["parallel_histogram", "comm", "basesize=8192"]	20.206 ms (5%)		1.26 MiB (1%)	2829
["parallel_histogram", "seq"]	7.920 ms (5%)		364.64 KiB (1%)	26
["sum", "random", "foldl"]	14.945 ms (5%)
["sum", "random", "reduce", "basesize=128"]	8.120 ms (5%)		314.14 KiB (1%)	6084
["sum", "random", "reduce", "basesize=256"]	8.261 ms (5%)		155.86 KiB (1%)	3025
["sum", "random", "reduce", "basesize=512"]	8.572 ms (5%)		77.02 KiB (1%)	1498
["sum", "uniform", "foldl"]	14.416 ms (5%)
["sum", "uniform", "reduce", "basesize=128"]	8.036 ms (5%)		314.13 KiB (1%)	6083
["sum", "uniform", "reduce", "basesize=256"]	7.754 ms (5%)		155.83 KiB (1%)	3023
["sum", "uniform", "reduce", "basesize=512"]	7.824 ms (5%)		77.00 KiB (1%)	1497
["sum", "valley", "foldl"]	15.647 ms (5%)
["sum", "valley", "reduce", "basesize=128"]	8.596 ms (5%)		314.00 KiB (1%)	6075
["sum", "valley", "reduce", "basesize=256"]	8.866 ms (5%)		155.83 KiB (1%)	3023
["sum", "valley", "reduce", "basesize=512"]	9.033 ms (5%)		77.02 KiB (1%)	1498
["words", "nthreads=1"]	38.160 ms (5%)	7.070 ms	64.86 MiB (1%)	2098727
["words", "nthreads=2"]	21.120 ms (5%)		65.21 MiB (1%)	2098803
["words", "nthreads=4"]	21.751 ms (5%)		65.93 MiB (1%)	2098959

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

• ["collect", "assoc"]
• ["collect"]
• ["collect", "unordered"]
• ["findfirst", "n=1000"]
• ["findfirst", "n=1000", "reduce"]
• ["findfirst", "n=400"]
• ["findfirst", "n=400", "reduce"]
• ["findfirst", "n=500"]
• ["findfirst", "n=500", "reduce"]
• ["overhead"]
• ["parallel_histogram", "assoc"]
• ["parallel_histogram", "comm"]
• ["parallel_histogram"]
• ["sum", "random"]
• ["sum", "random", "reduce"]
• ["sum", "uniform"]
• ["sum", "uniform", "reduce"]
• ["sum", "valley"]
• ["sum", "valley", "reduce"]
• ["words"]

Julia versioninfo

Julia Version 1.4.2
Commit 44fa15b150* (2020-05-23 18:35 UTC)
Platform Info:
  OS: Linux (x86_64-pc-linux-gnu)
      Ubuntu 18.04.4 LTS
  uname: Linux 5.3.0-1028-azure #29~18.04.1-Ubuntu SMP Fri Jun 5 14:32:34 UTC 2020 x86_64 x86_64
  CPU: Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz: 
              speed         user         nice          sys         idle          irq
       #1  2095 MHz      46514 s          0 s       2262 s      20523 s          0 s
       #2  2095 MHz      51024 s          0 s       2398 s      16380 s          0 s
       
  Memory: 6.764884948730469 GB (3387.64453125 MB free)
  Uptime: 712.0 sec
  Load Avg:  1.66552734375  1.55908203125  0.951171875
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-8.0.1 (ORCJIT, skylake)

---

Baseline result

Benchmark Report for /home/runner/work/Transducers.jl/Transducers.jl

Job Properties

• Time of benchmark: 23 Jun 2020 - 0:51
• Package commit: dcd077
• Julia commit: 44fa15
• Julia command flags: None
• Environment variables: JULIA_NUM_THREADS => 2

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID	time	GC time	memory	allocations
["collect", "assoc", "basesize=1"]	359.477 ms (5%)	11.569 ms	87.55 MiB (1%)	1590792
["collect", "assoc", "basesize=1024"]	226.114 ms (5%)		1.84 MiB (1%)	1827
["collect", "assoc", "basesize=32"]	229.991 ms (5%)		5.64 MiB (1%)	54027
["collect", "seq"]	455.131 ms (5%)		1.50 MiB (1%)	32787
["collect", "unordered", "basesize=1"]	437.524 ms (5%)		29.14 MiB (1%)	402123
["collect", "unordered", "basesize=1024"]	261.417 ms (5%)		768.64 KiB (1%)	2240
["collect", "unordered", "basesize=32"]	259.498 ms (5%)		1.46 MiB (1%)	16340
["findfirst", "n=1000", "foldl"]	725.590 ms (5%)
["findfirst", "n=1000", "reduce", "basesize=128"]	363.214 ms (5%)		565.13 KiB (1%)	10241
["findfirst", "n=1000", "reduce", "basesize=256"]	361.208 ms (5%)		288.41 KiB (1%)	5242
["findfirst", "n=1000", "reduce", "basesize=512"]	378.206 ms (5%)		150.50 KiB (1%)	2743
["findfirst", "n=400", "foldl"]	541.112 ms (5%)
["findfirst", "n=400", "reduce", "basesize=128"]	277.558 ms (5%)		1.02 MiB (1%)	18912
["findfirst", "n=400", "reduce", "basesize=256"]	277.519 ms (5%)		527.02 KiB (1%)	9571
["findfirst", "n=400", "reduce", "basesize=512"]	274.693 ms (5%)		268.39 KiB (1%)	4896
["findfirst", "n=500", "foldl"]	89.868 ms (5%)
["findfirst", "n=500", "reduce", "basesize=128"]	47.132 ms (5%)		158.47 KiB (1%)	2865
["findfirst", "n=500", "reduce", "basesize=256"]	47.040 ms (5%)		85.72 KiB (1%)	1554
["findfirst", "n=500", "reduce", "basesize=512"]	50.161 ms (5%)		49.45 KiB (1%)	898
["overhead", "default"]	195.505 μs (5%)		147.05 KiB (1%)	2646
["overhead", "stoppable=false"]	172.204 μs (5%)		146.23 KiB (1%)	2631
["overhead", "stoppable=true"]	324.508 μs (5%)		146.47 KiB (1%)	2647
["parallel_histogram", "assoc", "basesize=16384"]	4.358 ms (5%)		732.86 KiB (1%)	118
["parallel_histogram", "assoc", "basesize=4096"]	5.633 ms (5%)		1.80 MiB (1%)	512
["parallel_histogram", "assoc", "basesize=8192"]	5.298 ms (5%)		1.43 MiB (1%)	258
["parallel_histogram", "comm", "basesize=16384"]	15.485 ms (5%)		1.22 MiB (1%)	160
["parallel_histogram", "comm", "basesize=4096"]	25.207 ms (5%)		1.06 MiB (1%)	5586
["parallel_histogram", "comm", "basesize=8192"]	17.825 ms (5%)		1.24 MiB (1%)	1319
["parallel_histogram", "seq"]	7.583 ms (5%)		364.64 KiB (1%)	26
["sum", "random", "foldl"]	16.438 ms (5%)
["sum", "random", "reduce", "basesize=128"]	9.269 ms (5%)		314.09 KiB (1%)	6081
["sum", "random", "reduce", "basesize=256"]	9.137 ms (5%)		155.83 KiB (1%)	3023
["sum", "random", "reduce", "basesize=512"]	9.054 ms (5%)		77.00 KiB (1%)	1497
["sum", "uniform", "foldl"]	16.789 ms (5%)
["sum", "uniform", "reduce", "basesize=128"]	9.121 ms (5%)		314.11 KiB (1%)	6082
["sum", "uniform", "reduce", "basesize=256"]	8.883 ms (5%)		155.84 KiB (1%)	3024
["sum", "uniform", "reduce", "basesize=512"]	8.592 ms (5%)		77.02 KiB (1%)	1498
["sum", "valley", "foldl"]	17.349 ms (5%)
["sum", "valley", "reduce", "basesize=128"]	9.071 ms (5%)		313.97 KiB (1%)	6073
["sum", "valley", "reduce", "basesize=256"]	8.210 ms (5%)		155.84 KiB (1%)	3024
["sum", "valley", "reduce", "basesize=512"]	9.020 ms (5%)		77.00 KiB (1%)	1497
["words", "nthreads=1"]	37.370 ms (5%)	7.004 ms	64.34 MiB (1%)	2082328
["words", "nthreads=2"]	22.959 ms (5%)		65.06 MiB (1%)	2082483
["words", "nthreads=4"]	23.458 ms (5%)		65.51 MiB (1%)	2082631

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

• ["collect", "assoc"]
• ["collect"]
• ["collect", "unordered"]
• ["findfirst", "n=1000"]
• ["findfirst", "n=1000", "reduce"]
• ["findfirst", "n=400"]
• ["findfirst", "n=400", "reduce"]
• ["findfirst", "n=500"]
• ["findfirst", "n=500", "reduce"]
• ["overhead"]
• ["parallel_histogram", "assoc"]
• ["parallel_histogram", "comm"]
• ["parallel_histogram"]
• ["sum", "random"]
• ["sum", "random", "reduce"]
• ["sum", "uniform"]
• ["sum", "uniform", "reduce"]
• ["sum", "valley"]
• ["sum", "valley", "reduce"]
• ["words"]

Julia versioninfo

Julia Version 1.4.2
Commit 44fa15b150* (2020-05-23 18:35 UTC)
Platform Info:
  OS: Linux (x86_64-pc-linux-gnu)
      Ubuntu 18.04.4 LTS
  uname: Linux 5.3.0-1028-azure #29~18.04.1-Ubuntu SMP Fri Jun 5 14:32:34 UTC 2020 x86_64 x86_64
  CPU: Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz: 
              speed         user         nice          sys         idle          irq
       #1  2095 MHz      66936 s          0 s       2800 s      27912 s          0 s
       #2  2095 MHz      74630 s          0 s       2868 s      20551 s          0 s
       
  Memory: 6.764884948730469 GB (3360.33203125 MB free)
  Uptime: 997.0 sec
  Load Avg:  1.7353515625  1.63037109375  1.142578125
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-8.0.1 (ORCJIT, skylake)

---

Runtime information

Runtime Info
BLAS #threads	2
BLAS.vendor()	openblas64
Sys.CPU_THREADS	2

lscpu output:

Architecture:        x86_64
CPU op-mode(s):      32-bit, 64-bit
Byte Order:          Little Endian
CPU(s):              2
On-line CPU(s) list: 0,1
Thread(s) per core:  1
Core(s) per socket:  2
Socket(s):           1
NUMA node(s):        1
Vendor ID:           GenuineIntel
CPU family:          6
Model:               85
Model name:          Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz
Stepping:            4
CPU MHz:             2095.144
BogoMIPS:            4190.28
Hypervisor vendor:   Microsoft
Virtualization type: full
L1d cache:           32K
L1i cache:           32K
L2 cache:            1024K
L3 cache:            36608K
NUMA node0 CPU(s):   0,1
Flags:               fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology cpuid pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch invpcid_single pti fsgsbase bmi1 hle avx2 smep bmi2 erms invpcid rtm mpx avx512f avx512dq rdseed adx smap clflushopt avx512cd avx512bw avx512vl xsaveopt xsavec xsaves

Cpu Property	Value
Brand	Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz
Vendor	:Intel
Architecture	:Skylake
Model	Family: 0x06, Model: 0x55, Stepping: 0x04, Type: 0x00
Cores	2 physical cores, 2 logical cores (on executing CPU)
	No Hyperthreading detected
Clock Frequencies	Not supported by CPU
Data Cache	Level 1:3 : (32, 1024, 36608) kbytes
	64 byte cache line size
Address Size	48 bits virtual, 44 bits physical
SIMD	512 bit = 64 byte max. SIMD vector size
Time Stamp Counter	TSC is accessible via rdtsc
	TSC increased at every clock cycle (non-invariant TSC)
Perf. Monitoring	Performance Monitoring Counters (PMC) are not supported
Hypervisor	Yes, Microsoft

[github-actions]

Benchmark result

Judge result

Benchmark Report for /home/runner/work/Transducers.jl/Transducers.jl

Job Properties

• Time of benchmarks:
  • Target: 23 Jun 2020 - 00:50
  • Baseline: 23 Jun 2020 - 00:53
• Package commits:
  • Target: e0a77d
  • Baseline: dcd077
• Julia commits:
  • Target: 44fa15
  • Baseline: 44fa15
• Julia command flags:
  • Target: None
  • Baseline: None
• Environment variables:
  • Target: OMP_NUM_THREADS => 1 JULIA_NUM_THREADS => 1
  • Baseline: OMP_NUM_THREADS => 1 JULIA_NUM_THREADS => 1

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).

ID	time ratio	memory ratio
["cat", "base"]	0.93 (5%) ✅	1.00 (1%)
["cat", "xf"]	0.93 (5%) ✅	1.00 (1%)
["gemm", "fusedmul", "xf", "16"]	1.05 (5%) ❌	1.00 (1%)
["gemm", "fusedmul", "xf", "32"]	0.86 (5%) ✅	1.00 (1%)
["gemm", "fusedmul", "xf", "8"]	1.10 (5%) ❌	1.00 (1%)
["gemm", "mul", "linalg", "8"]	1.18 (5%) ❌	1.00 (1%)
["gemm", "mul", "man", "false", "8"]	0.94 (5%) ✅	1.00 (1%)
["gemm", "mul", "man", "ivdep", "8"]	1.09 (5%) ❌	1.00 (1%)
["gemm", "mul", "xf", "false", "8"]	1.22 (5%) ❌	1.00 (1%)
["gemm", "mul", "xf", "ivdep", "8"]	1.16 (5%) ❌	1.00 (1%)
["gemm", "mul", "xf", "true", "8"]	0.92 (5%) ✅	1.00 (1%)
["missing_dot", "xf"]	1.07 (5%) ❌	1.00 (1%)
["missing_dot", "xf_nota"]	1.07 (5%) ❌	1.00 (1%)

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

• ["cat"]
• ["collect"]
• ["dot"]
• ["filter_map_map!"]
• ["filter_map_reduce"]
• ["findall"]
• ["gemm", "fusedmul", "blas"]
• ["gemm", "fusedmul", "xf"]
• ["gemm", "mul", "linalg"]
• ["gemm", "mul", "man", "false"]
• ["gemm", "mul", "man", "ivdep"]
• ["gemm", "mul", "man", "true"]
• ["gemm", "mul", "xf", "false"]
• ["gemm", "mul", "xf", "ivdep"]
• ["gemm", "mul", "xf", "true"]
• ["groupby", "sum"]
• ["missing_argmax"]
• ["missing_dot"]
• ["partition_by"]

Julia versioninfo

Target

Julia Version 1.4.2
Commit 44fa15b150* (2020-05-23 18:35 UTC)
Platform Info:
  OS: Linux (x86_64-pc-linux-gnu)
      Ubuntu 18.04.4 LTS
  uname: Linux 5.3.0-1028-azure #29~18.04.1-Ubuntu SMP Fri Jun 5 14:32:34 UTC 2020 x86_64 x86_64
  CPU: Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz: 
              speed         user         nice          sys         idle          irq
       #1  2095 MHz      24777 s          0 s       1315 s      40206 s          0 s
       #2  2095 MHz      31656 s          0 s       1563 s      31351 s          0 s
       
  Memory: 6.764884948730469 GB (3372.234375 MB free)
  Uptime: 710.0 sec
  Load Avg:  1.1005859375  1.015625  0.65234375
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-8.0.1 (ORCJIT, skylake)

Baseline

Julia Version 1.4.2
Commit 44fa15b150* (2020-05-23 18:35 UTC)
Platform Info:
  OS: Linux (x86_64-pc-linux-gnu)
      Ubuntu 18.04.4 LTS
  uname: Linux 5.3.0-1028-azure #29~18.04.1-Ubuntu SMP Fri Jun 5 14:32:34 UTC 2020 x86_64 x86_64
  CPU: Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz: 
              speed         user         nice          sys         idle          irq
       #1  2095 MHz      43090 s          0 s       1404 s      43824 s          0 s
       #2  2095 MHz      35436 s          0 s       1678 s      49419 s          0 s
       
  Memory: 6.764884948730469 GB (3350.83984375 MB free)
  Uptime: 931.0 sec
  Load Avg:  1.09423828125  1.04052734375  0.751953125
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-8.0.1 (ORCJIT, skylake)

---

Target result

Benchmark Report for /home/runner/work/Transducers.jl/Transducers.jl

Job Properties

• Time of benchmark: 23 Jun 2020 - 0:50
• Package commit: e0a77d
• Julia commit: 44fa15
• Julia command flags: None
• Environment variables: OMP_NUM_THREADS => 1 JULIA_NUM_THREADS => 1

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID	time	GC time	memory	allocations
["cat", "base"]	1.680 μs (5%)
["cat", "xf"]	1.745 μs (5%)		80 bytes (1%)	3
["collect", "filter-missing"]	104.412 μs (5%)		345.36 KiB (1%)	10018
["collect", "identity-float"]	75.309 μs (5%)		569.20 KiB (1%)	10018
["collect", "identity-union"]	296.136 μs (5%)		705.47 KiB (1%)	16687
["dot", "blas"]	1.150 μs (5%)
["dot", "man"]	1.160 μs (5%)
["dot", "rf"]	2.078 μs (5%)
["dot", "xf"]	2.078 μs (5%)
["filter_map_map!", "man"]	60.204 μs (5%)
["filter_map_map!", "xf"]	679.851 μs (5%)		304 bytes (1%)	17
["filter_map_reduce", "man"]	222.524 μs (5%)
["filter_map_reduce", "xf"]	222.624 μs (5%)
["findall", "base"]	801.192 μs (5%)		2.00 MiB (1%)	21
["findall", "xf-array"]	741.884 μs (5%)		3.05 MiB (1%)	99803
["findall", "xf-iter"]	3.097 ms (5%)		9.63 MiB (1%)	299928
["gemm", "fusedmul", "blas", "16"]	4.261 ms (5%)
["gemm", "fusedmul", "blas", "2"]	3.255 ms (5%)
["gemm", "fusedmul", "blas", "32"]	5.792 ms (5%)
["gemm", "fusedmul", "blas", "8"]	3.380 ms (5%)
["gemm", "fusedmul", "xf", "16"]	4.882 ms (5%)		160 bytes (1%)	6
["gemm", "fusedmul", "xf", "2"]	589.945 μs (5%)		160 bytes (1%)	6
["gemm", "fusedmul", "xf", "32"]	9.333 ms (5%)		160 bytes (1%)	6
["gemm", "fusedmul", "xf", "8"]	2.600 ms (5%)		160 bytes (1%)	6
["gemm", "mul", "linalg", "256"]	872.685 μs (5%)
["gemm", "mul", "linalg", "32"]	2.888 μs (5%)
["gemm", "mul", "linalg", "8"]	235.805 ns (5%)
["gemm", "mul", "man", "false", "256"]	1.553 ms (5%)
["gemm", "mul", "man", "false", "32"]	4.500 μs (5%)
["gemm", "mul", "man", "false", "8"]	374.402 ns (5%)
["gemm", "mul", "man", "ivdep", "256"]	1.575 ms (5%)
["gemm", "mul", "man", "ivdep", "32"]	3.800 μs (5%)
["gemm", "mul", "man", "ivdep", "8"]	436.306 ns (5%)
["gemm", "mul", "man", "true", "256"]	1.559 ms (5%)
["gemm", "mul", "man", "true", "32"]	4.434 μs (5%)
["gemm", "mul", "man", "true", "8"]	388.919 ns (5%)
["gemm", "mul", "xf", "false", "256"]	1.555 ms (5%)		48 bytes (1%)	2
["gemm", "mul", "xf", "false", "32"]	4.517 μs (5%)		48 bytes (1%)	2
["gemm", "mul", "xf", "false", "8"]	365.859 ns (5%)		48 bytes (1%)	2
["gemm", "mul", "xf", "ivdep", "256"]	1.578 ms (5%)		48 bytes (1%)	2
["gemm", "mul", "xf", "ivdep", "32"]	3.657 μs (5%)		48 bytes (1%)	2
["gemm", "mul", "xf", "ivdep", "8"]	348.030 ns (5%)		48 bytes (1%)	2
["gemm", "mul", "xf", "true", "256"]	1.553 ms (5%)		48 bytes (1%)	2
["gemm", "mul", "xf", "true", "32"]	4.529 μs (5%)		48 bytes (1%)	2
["gemm", "mul", "xf", "true", "8"]	366.362 ns (5%)		48 bytes (1%)	2
["groupby", "sum", "sac"]	248.318 μs (5%)		313.14 KiB (1%)	10007
["groupby", "sum", "xf-with-init"]	185.213 μs (5%)		157.44 KiB (1%)	10008
["groupby", "sum", "xf-without-init"]	177.512 μs (5%)		157.44 KiB (1%)	10008
["missing_argmax", "man"]	2.600 μs (5%)		32 bytes (1%)	1
["missing_argmax", "rf"]	2.411 μs (5%)		32 bytes (1%)	1
["missing_argmax", "xf"]	2.467 μs (5%)		32 bytes (1%)	1
["missing_dot", "equiv"]	1.410 μs (5%)		16 bytes (1%)	1
["missing_dot", "man"]	1.310 μs (5%)		16 bytes (1%)	1
["missing_dot", "naive"]	4.567 μs (5%)		16 bytes (1%)	1
["missing_dot", "rf"]	1.310 μs (5%)		16 bytes (1%)	1
["missing_dot", "rf_nota"]	1.360 μs (5%)		16 bytes (1%)	1
["missing_dot", "xf"]	199.020 μs (5%)		72.20 KiB (1%)	3743
["missing_dot", "xf_nota"]	199.720 μs (5%)		71.97 KiB (1%)	3735
["overhead", "foldl"]	4.200 ns (5%)
["overhead", "reduce_basecase"]	3.325 μs (5%)		1.17 KiB (1%)	21
["partition_by", "man"]	1.909 ms (5%)		352 bytes (1%)	4
["partition_by", "xf"]	2.917 ms (5%)		6.10 MiB (1%)	200007

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

• ["cat"]
• ["collect"]
• ["dot"]
• ["filter_map_map!"]
• ["filter_map_reduce"]
• ["findall"]
• ["gemm", "fusedmul", "blas"]
• ["gemm", "fusedmul", "xf"]
• ["gemm", "mul", "linalg"]
• ["gemm", "mul", "man", "false"]
• ["gemm", "mul", "man", "ivdep"]
• ["gemm", "mul", "man", "true"]
• ["gemm", "mul", "xf", "false"]
• ["gemm", "mul", "xf", "ivdep"]
• ["gemm", "mul", "xf", "true"]
• ["groupby", "sum"]
• ["missing_argmax"]
• ["missing_dot"]
• ["overhead"]
• ["partition_by"]

Julia versioninfo

Julia Version 1.4.2
Commit 44fa15b150* (2020-05-23 18:35 UTC)
Platform Info:
  OS: Linux (x86_64-pc-linux-gnu)
      Ubuntu 18.04.4 LTS
  uname: Linux 5.3.0-1028-azure #29~18.04.1-Ubuntu SMP Fri Jun 5 14:32:34 UTC 2020 x86_64 x86_64
  CPU: Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz: 
              speed         user         nice          sys         idle          irq
       #1  2095 MHz      24777 s          0 s       1315 s      40206 s          0 s
       #2  2095 MHz      31656 s          0 s       1563 s      31351 s          0 s
       
  Memory: 6.764884948730469 GB (3372.234375 MB free)
  Uptime: 710.0 sec
  Load Avg:  1.1005859375  1.015625  0.65234375
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-8.0.1 (ORCJIT, skylake)

---

Baseline result

Benchmark Report for /home/runner/work/Transducers.jl/Transducers.jl

Job Properties

• Time of benchmark: 23 Jun 2020 - 0:53
• Package commit: dcd077
• Julia commit: 44fa15
• Julia command flags: None
• Environment variables: OMP_NUM_THREADS => 1 JULIA_NUM_THREADS => 1

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID	time	GC time	memory	allocations
["cat", "base"]	1.810 μs (5%)
["cat", "xf"]	1.878 μs (5%)		80 bytes (1%)	3
["collect", "filter-missing"]	104.807 μs (5%)		345.36 KiB (1%)	10018
["collect", "identity-float"]	76.205 μs (5%)		569.20 KiB (1%)	10018
["collect", "identity-union"]	293.619 μs (5%)		705.42 KiB (1%)	16686
["dot", "blas"]	1.190 μs (5%)
["dot", "man"]	1.140 μs (5%)
["dot", "rf"]	2.078 μs (5%)
["dot", "xf"]	2.078 μs (5%)
["filter_map_map!", "man"]	61.204 μs (5%)
["filter_map_map!", "xf"]	659.638 μs (5%)		304 bytes (1%)	17
["filter_map_reduce", "man"]	222.614 μs (5%)
["filter_map_reduce", "xf"]	222.614 μs (5%)
["findall", "base"]	798.951 μs (5%)		2.00 MiB (1%)	21
["findall", "xf-array"]	741.447 μs (5%)		3.04 MiB (1%)	99652
["findall", "xf-iter"]	3.150 ms (5%)		9.63 MiB (1%)	299938
["gemm", "fusedmul", "blas", "16"]	4.195 ms (5%)
["gemm", "fusedmul", "blas", "2"]	3.203 ms (5%)
["gemm", "fusedmul", "blas", "32"]	5.759 ms (5%)
["gemm", "fusedmul", "blas", "8"]	3.362 ms (5%)
["gemm", "fusedmul", "xf", "16"]	4.631 ms (5%)		160 bytes (1%)	6
["gemm", "fusedmul", "xf", "2"]	581.933 μs (5%)		160 bytes (1%)	6
["gemm", "fusedmul", "xf", "32"]	10.893 ms (5%)		160 bytes (1%)	6
["gemm", "fusedmul", "xf", "8"]	2.360 ms (5%)		160 bytes (1%)	6
["gemm", "mul", "linalg", "256"]	873.953 μs (5%)
["gemm", "mul", "linalg", "32"]	2.900 μs (5%)
["gemm", "mul", "linalg", "8"]	200.000 ns (5%)
["gemm", "mul", "man", "false", "256"]	1.615 ms (5%)
["gemm", "mul", "man", "false", "32"]	4.500 μs (5%)
["gemm", "mul", "man", "false", "8"]	400.000 ns (5%)
["gemm", "mul", "man", "ivdep", "256"]	1.613 ms (5%)
["gemm", "mul", "man", "ivdep", "32"]	3.700 μs (5%)
["gemm", "mul", "man", "ivdep", "8"]	400.000 ns (5%)
["gemm", "mul", "man", "true", "256"]	1.616 ms (5%)
["gemm", "mul", "man", "true", "32"]	4.500 μs (5%)
["gemm", "mul", "man", "true", "8"]	400.000 ns (5%)
["gemm", "mul", "xf", "false", "256"]	1.617 ms (5%)		48 bytes (1%)	2
["gemm", "mul", "xf", "false", "32"]	4.500 μs (5%)		48 bytes (1%)	2
["gemm", "mul", "xf", "false", "8"]	300.000 ns (5%)		48 bytes (1%)	2
["gemm", "mul", "xf", "ivdep", "256"]	1.607 ms (5%)		48 bytes (1%)	2
["gemm", "mul", "xf", "ivdep", "32"]	3.600 μs (5%)		48 bytes (1%)	2
["gemm", "mul", "xf", "ivdep", "8"]	300.000 ns (5%)		48 bytes (1%)	2
["gemm", "mul", "xf", "true", "256"]	1.608 ms (5%)		48 bytes (1%)	2
["gemm", "mul", "xf", "true", "32"]	4.600 μs (5%)		48 bytes (1%)	2
["gemm", "mul", "xf", "true", "8"]	400.000 ns (5%)		48 bytes (1%)	2
["groupby", "sum", "sac"]	240.513 μs (5%)		313.14 KiB (1%)	10007
["groupby", "sum", "xf-with-init"]	179.710 μs (5%)		157.44 KiB (1%)	10008
["groupby", "sum", "xf-without-init"]	176.410 μs (5%)		157.44 KiB (1%)	10008
["missing_argmax", "man"]	2.589 μs (5%)		32 bytes (1%)	1
["missing_argmax", "rf"]	2.411 μs (5%)		32 bytes (1%)	1
["missing_argmax", "xf"]	2.478 μs (5%)		32 bytes (1%)	1
["missing_dot", "equiv"]	1.420 μs (5%)		16 bytes (1%)	1
["missing_dot", "man"]	1.310 μs (5%)		16 bytes (1%)	1
["missing_dot", "naive"]	4.583 μs (5%)		16 bytes (1%)	1
["missing_dot", "rf"]	1.330 μs (5%)		16 bytes (1%)	1
["missing_dot", "rf_nota"]	1.370 μs (5%)		16 bytes (1%)	1
["missing_dot", "xf"]	185.811 μs (5%)		72.00 KiB (1%)	3735
["missing_dot", "xf_nota"]	187.312 μs (5%)		72.16 KiB (1%)	3743
["partition_by", "man"]	1.911 ms (5%)		352 bytes (1%)	4
["partition_by", "xf"]	2.848 ms (5%)		6.10 MiB (1%)	200007

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

• ["cat"]
• ["collect"]
• ["dot"]
• ["filter_map_map!"]
• ["filter_map_reduce"]
• ["findall"]
• ["gemm", "fusedmul", "blas"]
• ["gemm", "fusedmul", "xf"]
• ["gemm", "mul", "linalg"]
• ["gemm", "mul", "man", "false"]
• ["gemm", "mul", "man", "ivdep"]
• ["gemm", "mul", "man", "true"]
• ["gemm", "mul", "xf", "false"]
• ["gemm", "mul", "xf", "ivdep"]
• ["gemm", "mul", "xf", "true"]
• ["groupby", "sum"]
• ["missing_argmax"]
• ["missing_dot"]
• ["partition_by"]

Julia versioninfo

Julia Version 1.4.2
Commit 44fa15b150* (2020-05-23 18:35 UTC)
Platform Info:
  OS: Linux (x86_64-pc-linux-gnu)
      Ubuntu 18.04.4 LTS
  uname: Linux 5.3.0-1028-azure #29~18.04.1-Ubuntu SMP Fri Jun 5 14:32:34 UTC 2020 x86_64 x86_64
  CPU: Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz: 
              speed         user         nice          sys         idle          irq
       #1  2095 MHz      43090 s          0 s       1404 s      43824 s          0 s
       #2  2095 MHz      35436 s          0 s       1678 s      49419 s          0 s
       
  Memory: 6.764884948730469 GB (3350.83984375 MB free)
  Uptime: 931.0 sec
  Load Avg:  1.09423828125  1.04052734375  0.751953125
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-8.0.1 (ORCJIT, skylake)

---

Runtime information

Runtime Info
BLAS #threads	2
BLAS.vendor()	openblas64
Sys.CPU_THREADS	2

lscpu output:

Architecture:        x86_64
CPU op-mode(s):      32-bit, 64-bit
Byte Order:          Little Endian
CPU(s):              2
On-line CPU(s) list: 0,1
Thread(s) per core:  1
Core(s) per socket:  2
Socket(s):           1
NUMA node(s):        1
Vendor ID:           GenuineIntel
CPU family:          6
Model:               85
Model name:          Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz
Stepping:            4
CPU MHz:             2095.244
BogoMIPS:            4190.48
Hypervisor vendor:   Microsoft
Virtualization type: full
L1d cache:           32K
L1i cache:           32K
L2 cache:            1024K
L3 cache:            36608K
NUMA node0 CPU(s):   0,1
Flags:               fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology cpuid pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch invpcid_single pti fsgsbase bmi1 hle avx2 smep bmi2 erms invpcid rtm mpx avx512f avx512dq rdseed adx smap clflushopt avx512cd avx512bw avx512vl xsaveopt xsavec xsaves

Cpu Property	Value
Brand	Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz
Vendor	:Intel
Architecture	:Skylake
Model	Family: 0x06, Model: 0x55, Stepping: 0x04, Type: 0x00
Cores	2 physical cores, 2 logical cores (on executing CPU)
	No Hyperthreading detected
Clock Frequencies	Not supported by CPU
Data Cache	Level 1:3 : (32, 1024, 36608) kbytes
	64 byte cache line size
Address Size	48 bits virtual, 44 bits physical
SIMD	512 bit = 64 byte max. SIMD vector size
Time Stamp Counter	TSC is accessible via rdtsc
	TSC increased at every clock cycle (non-invariant TSC)
Perf. Monitoring	Performance Monitoring Counters (PMC) are not supported
Hypervisor	Yes, Microsoft

[github-actions]

Multi-thread benchmark result

Judge result

Benchmark Report for /home/runner/work/Transducers.jl/Transducers.jl

Job Properties

• Time of benchmarks:
  • Target: 23 Jun 2020 - 00:50
  • Baseline: 23 Jun 2020 - 00:55
• Package commits:
  • Target: e0a77d
  • Baseline: dcd077
• Julia commits:
  • Target: 44fa15
  • Baseline: 44fa15
• Julia command flags:
  • Target: None
  • Baseline: None
• Environment variables:
  • Target: JULIA_NUM_THREADS => 2
  • Baseline: JULIA_NUM_THREADS => 2

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).

ID	time ratio	memory ratio
["collect", "unordered", "basesize=1024"]	1.07 (5%) ❌	1.02 (1%) ❌
["overhead", "stoppable=true"]	0.94 (5%) ✅	1.00 (1%)
["parallel_histogram", "assoc", "basesize=4096"]	1.01 (5%)	1.15 (1%) ❌
["parallel_histogram", "comm", "basesize=4096"]	1.00 (5%)	0.99 (1%) ✅
["words", "nthreads=2"]	1.06 (5%) ❌	1.01 (1%)
["words", "nthreads=4"]	1.05 (5%) ❌	1.00 (1%)

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

• ["collect", "assoc"]
• ["collect"]
• ["collect", "unordered"]
• ["findfirst", "n=1000"]
• ["findfirst", "n=1000", "reduce"]
• ["findfirst", "n=400"]
• ["findfirst", "n=400", "reduce"]
• ["findfirst", "n=500"]
• ["findfirst", "n=500", "reduce"]
• ["overhead"]
• ["parallel_histogram", "assoc"]
• ["parallel_histogram", "comm"]
• ["parallel_histogram"]
• ["sum", "random"]
• ["sum", "random", "reduce"]
• ["sum", "uniform"]
• ["sum", "uniform", "reduce"]
• ["sum", "valley"]
• ["sum", "valley", "reduce"]
• ["words"]

Julia versioninfo

Target

Julia Version 1.4.2
Commit 44fa15b150* (2020-05-23 18:35 UTC)
Platform Info:
  OS: Linux (x86_64-pc-linux-gnu)
      Ubuntu 18.04.4 LTS
  uname: Linux 5.3.0-1028-azure #29~18.04.1-Ubuntu SMP Fri Jun 5 14:32:34 UTC 2020 x86_64 x86_64
  CPU: Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz: 
              speed         user         nice          sys         idle          irq
       #1  2593 MHz      47126 s          0 s       2114 s      16996 s          0 s
       #2  2593 MHz      47885 s          0 s       2444 s      16003 s          0 s
       
  Memory: 6.791572570800781 GB (3562.16015625 MB free)
  Uptime: 679.0 sec
  Load Avg:  1.78955078125  1.65185546875  1.04541015625
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-8.0.1 (ORCJIT, skylake)

Baseline

Julia Version 1.4.2
Commit 44fa15b150* (2020-05-23 18:35 UTC)
Platform Info:
  OS: Linux (x86_64-pc-linux-gnu)
      Ubuntu 18.04.4 LTS
  uname: Linux 5.3.0-1028-azure #29~18.04.1-Ubuntu SMP Fri Jun 5 14:32:34 UTC 2020 x86_64 x86_64
  CPU: Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz: 
              speed         user         nice          sys         idle          irq
       #1  2593 MHz      68958 s          0 s       2730 s      21783 s          0 s
       #2  2593 MHz      68804 s          0 s       2974 s      21876 s          0 s
       
  Memory: 6.791572570800781 GB (3574.1953125 MB free)
  Uptime: 952.0 sec
  Load Avg:  1.716796875  1.64501953125  1.1943359375
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-8.0.1 (ORCJIT, skylake)

---

Target result

Benchmark Report for /home/runner/work/Transducers.jl/Transducers.jl

Job Properties

• Time of benchmark: 23 Jun 2020 - 0:50
• Package commit: e0a77d
• Julia commit: 44fa15
• Julia command flags: None
• Environment variables: JULIA_NUM_THREADS => 2

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID	time	GC time	memory	allocations
["collect", "assoc", "basesize=1"]	313.773 ms (5%)	10.338 ms	87.55 MiB (1%)	1590728
["collect", "assoc", "basesize=1024"]	198.446 ms (5%)		1.84 MiB (1%)	1826
["collect", "assoc", "basesize=32"]	201.774 ms (5%)		5.64 MiB (1%)	54031
["collect", "seq"]	395.400 ms (5%)		1.50 MiB (1%)	32787
["collect", "unordered", "basesize=1"]	419.865 ms (5%)		29.19 MiB (1%)	405312
["collect", "unordered", "basesize=1024"]	235.401 ms (5%)		784.61 KiB (1%)	3307
["collect", "unordered", "basesize=32"]	224.420 ms (5%)		1.47 MiB (1%)	16543
["findfirst", "n=1000", "foldl"]	627.647 ms (5%)
["findfirst", "n=1000", "reduce", "basesize=128"]	318.586 ms (5%)		564.34 KiB (1%)	10191
["findfirst", "n=1000", "reduce", "basesize=256"]	317.101 ms (5%)		288.06 KiB (1%)	5220
["findfirst", "n=1000", "reduce", "basesize=512"]	322.067 ms (5%)		150.41 KiB (1%)	2737
["findfirst", "n=400", "foldl"]	471.205 ms (5%)
["findfirst", "n=400", "reduce", "basesize=128"]	240.950 ms (5%)		1.02 MiB (1%)	18852
["findfirst", "n=400", "reduce", "basesize=256"]	239.149 ms (5%)		526.38 KiB (1%)	9530
["findfirst", "n=400", "reduce", "basesize=512"]	240.060 ms (5%)		268.03 KiB (1%)	4873
["findfirst", "n=500", "foldl"]	81.715 ms (5%)
["findfirst", "n=500", "reduce", "basesize=128"]	42.125 ms (5%)		158.38 KiB (1%)	2859
["findfirst", "n=500", "reduce", "basesize=256"]	41.792 ms (5%)		85.64 KiB (1%)	1549
["findfirst", "n=500", "reduce", "basesize=512"]	44.389 ms (5%)		49.45 KiB (1%)	898
["overhead", "default"]	179.703 μs (5%)		147.05 KiB (1%)	2646
["overhead", "stoppable=false"]	176.503 μs (5%)		146.25 KiB (1%)	2632
["overhead", "stoppable=true"]	305.805 μs (5%)		146.47 KiB (1%)	2647
["parallel_histogram", "assoc", "basesize=16384"]	4.484 ms (5%)		732.86 KiB (1%)	118
["parallel_histogram", "assoc", "basesize=4096"]	5.159 ms (5%)		2.07 MiB (1%)	518
["parallel_histogram", "assoc", "basesize=8192"]	4.803 ms (5%)		1.43 MiB (1%)	257
["parallel_histogram", "comm", "basesize=16384"]	13.351 ms (5%)		1.22 MiB (1%)	160
["parallel_histogram", "comm", "basesize=4096"]	21.493 ms (5%)		1.06 MiB (1%)	5493
["parallel_histogram", "comm", "basesize=8192"]	18.094 ms (5%)		1.26 MiB (1%)	2425
["parallel_histogram", "seq"]	8.120 ms (5%)		364.64 KiB (1%)	26
["sum", "random", "foldl"]	16.033 ms (5%)
["sum", "random", "reduce", "basesize=128"]	8.420 ms (5%)		314.13 KiB (1%)	6083
["sum", "random", "reduce", "basesize=256"]	8.221 ms (5%)		155.83 KiB (1%)	3023
["sum", "random", "reduce", "basesize=512"]	8.151 ms (5%)		77.05 KiB (1%)	1500
["sum", "uniform", "foldl"]	15.496 ms (5%)
["sum", "uniform", "reduce", "basesize=128"]	8.155 ms (5%)		314.08 KiB (1%)	6080
["sum", "uniform", "reduce", "basesize=256"]	7.956 ms (5%)		155.83 KiB (1%)	3023
["sum", "uniform", "reduce", "basesize=512"]	7.869 ms (5%)		77.00 KiB (1%)	1497
["sum", "valley", "foldl"]	16.034 ms (5%)
["sum", "valley", "reduce", "basesize=128"]	8.443 ms (5%)		314.02 KiB (1%)	6076
["sum", "valley", "reduce", "basesize=256"]	8.249 ms (5%)		155.83 KiB (1%)	3023
["sum", "valley", "reduce", "basesize=512"]	8.161 ms (5%)		77.02 KiB (1%)	1498
["words", "nthreads=1"]	34.489 ms (5%)	6.117 ms	64.64 MiB (1%)	2091818
["words", "nthreads=2"]	19.381 ms (5%)		65.36 MiB (1%)	2091972
["words", "nthreads=4"]	19.977 ms (5%)		65.81 MiB (1%)	2092119

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

• ["collect", "assoc"]
• ["collect"]
• ["collect", "unordered"]
• ["findfirst", "n=1000"]
• ["findfirst", "n=1000", "reduce"]
• ["findfirst", "n=400"]
• ["findfirst", "n=400", "reduce"]
• ["findfirst", "n=500"]
• ["findfirst", "n=500", "reduce"]
• ["overhead"]
• ["parallel_histogram", "assoc"]
• ["parallel_histogram", "comm"]
• ["parallel_histogram"]
• ["sum", "random"]
• ["sum", "random", "reduce"]
• ["sum", "uniform"]
• ["sum", "uniform", "reduce"]
• ["sum", "valley"]
• ["sum", "valley", "reduce"]
• ["words"]

Julia versioninfo

Julia Version 1.4.2
Commit 44fa15b150* (2020-05-23 18:35 UTC)
Platform Info:
  OS: Linux (x86_64-pc-linux-gnu)
      Ubuntu 18.04.4 LTS
  uname: Linux 5.3.0-1028-azure #29~18.04.1-Ubuntu SMP Fri Jun 5 14:32:34 UTC 2020 x86_64 x86_64
  CPU: Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz: 
              speed         user         nice          sys         idle          irq
       #1  2593 MHz      47126 s          0 s       2114 s      16996 s          0 s
       #2  2593 MHz      47885 s          0 s       2444 s      16003 s          0 s
       
  Memory: 6.791572570800781 GB (3562.16015625 MB free)
  Uptime: 679.0 sec
  Load Avg:  1.78955078125  1.65185546875  1.04541015625
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-8.0.1 (ORCJIT, skylake)

---

Baseline result

Benchmark Report for /home/runner/work/Transducers.jl/Transducers.jl

Job Properties

• Time of benchmark: 23 Jun 2020 - 0:55
• Package commit: dcd077
• Julia commit: 44fa15
• Julia command flags: None
• Environment variables: JULIA_NUM_THREADS => 2

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID	time	GC time	memory	allocations
["collect", "assoc", "basesize=1"]	312.522 ms (5%)	8.246 ms	87.55 MiB (1%)	1590782
["collect", "assoc", "basesize=1024"]	198.459 ms (5%)		1.84 MiB (1%)	1826
["collect", "assoc", "basesize=32"]	201.694 ms (5%)		5.64 MiB (1%)	54023
["collect", "seq"]	395.176 ms (5%)		1.50 MiB (1%)	32787
["collect", "unordered", "basesize=1"]	441.938 ms (5%)		29.22 MiB (1%)	407258
["collect", "unordered", "basesize=1024"]	219.173 ms (5%)		768.20 KiB (1%)	2212
["collect", "unordered", "basesize=32"]	223.236 ms (5%)		1.47 MiB (1%)	16869
["findfirst", "n=1000", "foldl"]	622.422 ms (5%)
["findfirst", "n=1000", "reduce", "basesize=128"]	316.084 ms (5%)		564.11 KiB (1%)	10176
["findfirst", "n=1000", "reduce", "basesize=256"]	314.962 ms (5%)		287.97 KiB (1%)	5214
["findfirst", "n=1000", "reduce", "basesize=512"]	319.864 ms (5%)		150.34 KiB (1%)	2733
["findfirst", "n=400", "foldl"]	467.256 ms (5%)
["findfirst", "n=400", "reduce", "basesize=128"]	239.354 ms (5%)		1.02 MiB (1%)	18846
["findfirst", "n=400", "reduce", "basesize=256"]	237.412 ms (5%)		526.28 KiB (1%)	9524
["findfirst", "n=400", "reduce", "basesize=512"]	238.461 ms (5%)		268.00 KiB (1%)	4871
["findfirst", "n=500", "foldl"]	80.998 ms (5%)
["findfirst", "n=500", "reduce", "basesize=128"]	41.813 ms (5%)		158.36 KiB (1%)	2858
["findfirst", "n=500", "reduce", "basesize=256"]	41.538 ms (5%)		85.64 KiB (1%)	1549
["findfirst", "n=500", "reduce", "basesize=512"]	44.095 ms (5%)		49.45 KiB (1%)	898
["overhead", "default"]	180.302 μs (5%)		147.03 KiB (1%)	2645
["overhead", "stoppable=false"]	175.902 μs (5%)		146.25 KiB (1%)	2632
["overhead", "stoppable=true"]	324.104 μs (5%)		146.47 KiB (1%)	2647
["parallel_histogram", "assoc", "basesize=16384"]	4.484 ms (5%)		732.86 KiB (1%)	118
["parallel_histogram", "assoc", "basesize=4096"]	5.092 ms (5%)		1.80 MiB (1%)	512
["parallel_histogram", "assoc", "basesize=8192"]	4.790 ms (5%)		1.43 MiB (1%)	257
["parallel_histogram", "comm", "basesize=16384"]	13.289 ms (5%)		1.22 MiB (1%)	160
["parallel_histogram", "comm", "basesize=4096"]	21.574 ms (5%)		1.07 MiB (1%)	5423
["parallel_histogram", "comm", "basesize=8192"]	17.844 ms (5%)		1.26 MiB (1%)	2462
["parallel_histogram", "seq"]	8.105 ms (5%)		364.64 KiB (1%)	26
["sum", "random", "foldl"]	15.918 ms (5%)
["sum", "random", "reduce", "basesize=128"]	8.350 ms (5%)		314.13 KiB (1%)	6083
["sum", "random", "reduce", "basesize=256"]	8.140 ms (5%)		155.83 KiB (1%)	3023
["sum", "random", "reduce", "basesize=512"]	8.076 ms (5%)		77.03 KiB (1%)	1499
["sum", "uniform", "foldl"]	15.461 ms (5%)
["sum", "uniform", "reduce", "basesize=128"]	8.139 ms (5%)		314.13 KiB (1%)	6083
["sum", "uniform", "reduce", "basesize=256"]	7.948 ms (5%)		155.83 KiB (1%)	3023
["sum", "uniform", "reduce", "basesize=512"]	7.865 ms (5%)		77.00 KiB (1%)	1497
["sum", "valley", "foldl"]	15.984 ms (5%)
["sum", "valley", "reduce", "basesize=128"]	8.402 ms (5%)		314.03 KiB (1%)	6077
["sum", "valley", "reduce", "basesize=256"]	8.253 ms (5%)		155.84 KiB (1%)	3024
["sum", "valley", "reduce", "basesize=512"]	8.141 ms (5%)		77.03 KiB (1%)	1499
["words", "nthreads=1"]	33.680 ms (5%)	5.666 ms	64.58 MiB (1%)	2089851
["words", "nthreads=2"]	18.265 ms (5%)		64.94 MiB (1%)	2089927
["words", "nthreads=4"]	18.954 ms (5%)		65.66 MiB (1%)	2090083

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

• ["collect", "assoc"]
• ["collect"]
• ["collect", "unordered"]
• ["findfirst", "n=1000"]
• ["findfirst", "n=1000", "reduce"]
• ["findfirst", "n=400"]
• ["findfirst", "n=400", "reduce"]
• ["findfirst", "n=500"]
• ["findfirst", "n=500", "reduce"]
• ["overhead"]
• ["parallel_histogram", "assoc"]
• ["parallel_histogram", "comm"]
• ["parallel_histogram"]
• ["sum", "random"]
• ["sum", "random", "reduce"]
• ["sum", "uniform"]
• ["sum", "uniform", "reduce"]
• ["sum", "valley"]
• ["sum", "valley", "reduce"]
• ["words"]

Julia versioninfo

Julia Version 1.4.2
Commit 44fa15b150* (2020-05-23 18:35 UTC)
Platform Info:
  OS: Linux (x86_64-pc-linux-gnu)
      Ubuntu 18.04.4 LTS
  uname: Linux 5.3.0-1028-azure #29~18.04.1-Ubuntu SMP Fri Jun 5 14:32:34 UTC 2020 x86_64 x86_64
  CPU: Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz: 
              speed         user         nice          sys         idle          irq
       #1  2593 MHz      68958 s          0 s       2730 s      21783 s          0 s
       #2  2593 MHz      68804 s          0 s       2974 s      21876 s          0 s
       
  Memory: 6.791572570800781 GB (3574.1953125 MB free)
  Uptime: 952.0 sec
  Load Avg:  1.716796875  1.64501953125  1.1943359375
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-8.0.1 (ORCJIT, skylake)

---

Runtime information

Runtime Info
BLAS #threads	2
BLAS.vendor()	openblas64
Sys.CPU_THREADS	2

lscpu output:

Architecture:        x86_64
CPU op-mode(s):      32-bit, 64-bit
Byte Order:          Little Endian
CPU(s):              2
On-line CPU(s) list: 0,1
Thread(s) per core:  1
Core(s) per socket:  2
Socket(s):           1
NUMA node(s):        1
Vendor ID:           GenuineIntel
CPU family:          6
Model:               85
Model name:          Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Stepping:            7
CPU MHz:             2593.906
BogoMIPS:            5187.81
Hypervisor vendor:   Microsoft
Virtualization type: full
L1d cache:           32K
L1i cache:           32K
L2 cache:            1024K
L3 cache:            36608K
NUMA node0 CPU(s):   0,1
Flags:               fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology cpuid pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch invpcid_single pti fsgsbase bmi1 hle avx2 smep bmi2 erms invpcid rtm mpx avx512f avx512dq rdseed adx smap clflushopt avx512cd avx512bw avx512vl xsaveopt xsavec xsaves md_clear

Cpu Property	Value
Brand	Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Vendor	:Intel
Architecture	:Skylake
Model	Family: 0x06, Model: 0x55, Stepping: 0x07, Type: 0x00
Cores	2 physical cores, 2 logical cores (on executing CPU)
	No Hyperthreading detected
Clock Frequencies	Not supported by CPU
Data Cache	Level 1:3 : (32, 1024, 36608) kbytes
	64 byte cache line size
Address Size	48 bits virtual, 46 bits physical
SIMD	512 bit = 64 byte max. SIMD vector size
Time Stamp Counter	TSC is accessible via rdtsc
	TSC increased at every clock cycle (non-invariant TSC)
Perf. Monitoring	Performance Monitoring Counters (PMC) are not supported
Hypervisor	Yes, Microsoft

[github-actions]

Benchmark result

Judge result

Benchmark Report for /home/runner/work/Transducers.jl/Transducers.jl

Job Properties

• Time of benchmarks:
  • Target: 23 Jun 2020 - 00:53
  • Baseline: 23 Jun 2020 - 00:57
• Package commits:
  • Target: eb6991
  • Baseline: dcd077
• Julia commits:
  • Target: 44fa15
  • Baseline: 44fa15
• Julia command flags:
  • Target: None
  • Baseline: None
• Environment variables:
  • Target: OMP_NUM_THREADS => 1 JULIA_NUM_THREADS => 1
  • Baseline: OMP_NUM_THREADS => 1 JULIA_NUM_THREADS => 1

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).

ID	time ratio	memory ratio
["cat", "base"]	0.87 (5%) ✅	1.00 (1%)
["cat", "xf"]	0.82 (5%) ✅	1.00 (1%)
["collect", "filter-missing"]	1.07 (5%) ❌	1.00 (1%)
["collect", "identity-float"]	1.08 (5%) ❌	1.00 (1%)
["dot", "blas"]	1.11 (5%) ❌	1.00 (1%)
["filter_map_map!", "man"]	1.13 (5%) ❌	1.00 (1%)
["filter_map_map!", "xf"]	1.22 (5%) ❌	1.00 (1%)
["filter_map_reduce", "man"]	0.86 (5%) ✅	1.00 (1%)
["filter_map_reduce", "xf"]	0.75 (5%) ✅	1.00 (1%)
["findall", "base"]	1.13 (5%) ❌	1.00 (1%)
["findall", "xf-array"]	1.12 (5%) ❌	1.01 (1%)
["gemm", "fusedmul", "blas", "32"]	0.95 (5%) ✅	1.00 (1%)
["gemm", "fusedmul", "xf", "2"]	1.12 (5%) ❌	1.00 (1%)
["gemm", "mul", "linalg", "256"]	0.85 (5%) ✅	1.00 (1%)
["gemm", "mul", "linalg", "32"]	0.81 (5%) ✅	1.00 (1%)
["gemm", "mul", "linalg", "8"]	0.79 (5%) ✅	1.00 (1%)
["gemm", "mul", "man", "false", "256"]	0.82 (5%) ✅	1.00 (1%)
["gemm", "mul", "man", "false", "32"]	1.07 (5%) ❌	1.00 (1%)
["gemm", "mul", "man", "false", "8"]	0.79 (5%) ✅	1.00 (1%)
["gemm", "mul", "man", "ivdep", "256"]	0.87 (5%) ✅	1.00 (1%)
["gemm", "mul", "man", "ivdep", "8"]	0.74 (5%) ✅	1.00 (1%)
["gemm", "mul", "man", "true", "256"]	1.12 (5%) ❌	1.00 (1%)
["gemm", "mul", "man", "true", "32"]	1.19 (5%) ❌	1.00 (1%)
["gemm", "mul", "man", "true", "8"]	0.91 (5%) ✅	1.00 (1%)
["gemm", "mul", "xf", "false", "32"]	0.93 (5%) ✅	1.00 (1%)
["gemm", "mul", "xf", "false", "8"]	0.79 (5%) ✅	1.00 (1%)
["gemm", "mul", "xf", "ivdep", "256"]	1.13 (5%) ❌	1.00 (1%)
["gemm", "mul", "xf", "ivdep", "32"]	1.13 (5%) ❌	1.00 (1%)
["gemm", "mul", "xf", "true", "256"]	1.14 (5%) ❌	1.00 (1%)
["gemm", "mul", "xf", "true", "32"]	0.83 (5%) ✅	1.00 (1%)
["gemm", "mul", "xf", "true", "8"]	1.05 (5%) ❌	1.00 (1%)
["groupby", "sum", "sac"]	0.89 (5%) ✅	1.00 (1%)
["groupby", "sum", "xf-with-init"]	1.16 (5%) ❌	1.00 (1%)
["groupby", "sum", "xf-without-init"]	0.91 (5%) ✅	1.00 (1%)
["missing_argmax", "man"]	0.75 (5%) ✅	1.00 (1%)
["missing_argmax", "xf"]	0.90 (5%) ✅	1.00 (1%)
["missing_dot", "equiv"]	0.84 (5%) ✅	1.00 (1%)
["missing_dot", "naive"]	1.15 (5%) ❌	1.00 (1%)
["missing_dot", "rf"]	0.88 (5%) ✅	1.00 (1%)
["missing_dot", "xf"]	0.90 (5%) ✅	1.00 (1%)
["missing_dot", "xf_nota"]	0.90 (5%) ✅	1.00 (1%)
["partition_by", "man"]	1.06 (5%) ❌	1.00 (1%)
["partition_by", "xf"]	1.06 (5%) ❌	1.00 (1%)

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

• ["cat"]
• ["collect"]
• ["dot"]
• ["filter_map_map!"]
• ["filter_map_reduce"]
• ["findall"]
• ["gemm", "fusedmul", "blas"]
• ["gemm", "fusedmul", "xf"]
• ["gemm", "mul", "linalg"]
• ["gemm", "mul", "man", "false"]
• ["gemm", "mul", "man", "ivdep"]
• ["gemm", "mul", "man", "true"]
• ["gemm", "mul", "xf", "false"]
• ["gemm", "mul", "xf", "ivdep"]
• ["gemm", "mul", "xf", "true"]
• ["groupby", "sum"]
• ["missing_argmax"]
• ["missing_dot"]
• ["partition_by"]

Julia versioninfo

Target

Julia Version 1.4.2
Commit 44fa15b150* (2020-05-23 18:35 UTC)
Platform Info:
  OS: Linux (x86_64-pc-linux-gnu)
      Ubuntu 18.04.4 LTS
  uname: Linux 5.3.0-1028-azure #29~18.04.1-Ubuntu SMP Fri Jun 5 14:32:34 UTC 2020 x86_64 x86_64
  CPU: Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz: 
              speed         user         nice          sys         idle          irq
       #1  2095 MHz      38912 s          0 s       1410 s      21175 s          0 s
       #2  2095 MHz      19496 s          0 s       1440 s      40625 s          0 s
       
  Memory: 6.764884948730469 GB (3299.96875 MB free)
  Uptime: 629.0 sec
  Load Avg:  1.36669921875  1.09130859375  0.63720703125
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-8.0.1 (ORCJIT, skylake)

Baseline

Julia Version 1.4.2
Commit 44fa15b150* (2020-05-23 18:35 UTC)
Platform Info:
  OS: Linux (x86_64-pc-linux-gnu)
      Ubuntu 18.04.4 LTS
  uname: Linux 5.3.0-1028-azure #29~18.04.1-Ubuntu SMP Fri Jun 5 14:32:34 UTC 2020 x86_64 x86_64
  CPU: Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz: 
              speed         user         nice          sys         idle          irq
       #1  2095 MHz      45363 s          0 s       1550 s      38061 s          0 s
       #2  2095 MHz      36541 s          0 s       1588 s      46896 s          0 s
       
  Memory: 6.764884948730469 GB (3265.9921875 MB free)
  Uptime: 865.0 sec
  Load Avg:  1.07763671875  1.10595703125  0.75830078125
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-8.0.1 (ORCJIT, skylake)

---

Target result

Benchmark Report for /home/runner/work/Transducers.jl/Transducers.jl

Job Properties

• Time of benchmark: 23 Jun 2020 - 0:53
• Package commit: eb6991
• Julia commit: 44fa15
• Julia command flags: None
• Environment variables: OMP_NUM_THREADS => 1 JULIA_NUM_THREADS => 1

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID	time	GC time	memory	allocations
["cat", "base"]	1.822 μs (5%)
["cat", "xf"]	1.767 μs (5%)		80 bytes (1%)	3
["collect", "filter-missing"]	115.201 μs (5%)		345.36 KiB (1%)	10018
["collect", "identity-float"]	89.101 μs (5%)		569.20 KiB (1%)	10018
["collect", "identity-union"]	310.702 μs (5%)		705.13 KiB (1%)	16667
["dot", "blas"]	1.420 μs (5%)
["dot", "man"]	1.300 μs (5%)
["dot", "rf"]	1.844 μs (5%)
["dot", "xf"]	1.833 μs (5%)
["filter_map_map!", "man"]	62.101 μs (5%)
["filter_map_map!", "xf"]	710.809 μs (5%)		304 bytes (1%)	17
["filter_map_reduce", "man"]	195.404 μs (5%)
["filter_map_reduce", "xf"]	192.604 μs (5%)
["findall", "base"]	830.505 μs (5%)		2.00 MiB (1%)	21
["findall", "xf-array"]	824.805 μs (5%)		3.05 MiB (1%)	99874
["findall", "xf-iter"]	3.437 ms (5%)		9.63 MiB (1%)	299932
["gemm", "fusedmul", "blas", "16"]	5.082 ms (5%)
["gemm", "fusedmul", "blas", "2"]	3.634 ms (5%)
["gemm", "fusedmul", "blas", "32"]	6.636 ms (5%)
["gemm", "fusedmul", "blas", "8"]	3.871 ms (5%)
["gemm", "fusedmul", "xf", "16"]	4.668 ms (5%)		160 bytes (1%)	6
["gemm", "fusedmul", "xf", "2"]	577.207 μs (5%)		160 bytes (1%)	6
["gemm", "fusedmul", "xf", "32"]	8.581 ms (5%)		160 bytes (1%)	6
["gemm", "fusedmul", "xf", "8"]	2.325 ms (5%)		160 bytes (1%)	6
["gemm", "mul", "linalg", "256"]	759.414 μs (5%)
["gemm", "mul", "linalg", "32"]	2.913 μs (5%)
["gemm", "mul", "linalg", "8"]	235.691 ns (5%)
["gemm", "mul", "man", "false", "256"]	1.426 ms (5%)
["gemm", "mul", "man", "false", "32"]	5.133 μs (5%)
["gemm", "mul", "man", "false", "8"]	317.332 ns (5%)
["gemm", "mul", "man", "ivdep", "256"]	1.472 ms (5%)
["gemm", "mul", "man", "ivdep", "32"]	4.229 μs (5%)
["gemm", "mul", "man", "ivdep", "8"]	368.533 ns (5%)
["gemm", "mul", "man", "true", "256"]	1.833 ms (5%)
["gemm", "mul", "man", "true", "32"]	5.117 μs (5%)
["gemm", "mul", "man", "true", "8"]	363.136 ns (5%)
["gemm", "mul", "xf", "false", "256"]	1.597 ms (5%)		48 bytes (1%)	2
["gemm", "mul", "xf", "false", "32"]	4.483 μs (5%)		48 bytes (1%)	2
["gemm", "mul", "xf", "false", "8"]	315.947 ns (5%)		48 bytes (1%)	2
["gemm", "mul", "xf", "ivdep", "256"]	1.609 ms (5%)		48 bytes (1%)	2
["gemm", "mul", "xf", "ivdep", "32"]	4.075 μs (5%)		48 bytes (1%)	2
["gemm", "mul", "xf", "ivdep", "8"]	408.679 ns (5%)		48 bytes (1%)	2
["gemm", "mul", "xf", "true", "256"]	1.720 ms (5%)		48 bytes (1%)	2
["gemm", "mul", "xf", "true", "32"]	4.567 μs (5%)		48 bytes (1%)	2
["gemm", "mul", "xf", "true", "8"]	421.744 ns (5%)		48 bytes (1%)	2
["groupby", "sum", "sac"]	217.503 μs (5%)		313.14 KiB (1%)	10007
["groupby", "sum", "xf-with-init"]	186.102 μs (5%)		157.44 KiB (1%)	10008
["groupby", "sum", "xf-without-init"]	181.202 μs (5%)		157.44 KiB (1%)	10008
["missing_argmax", "man"]	2.244 μs (5%)		32 bytes (1%)	1
["missing_argmax", "rf"]	2.800 μs (5%)		32 bytes (1%)	1
["missing_argmax", "xf"]	2.511 μs (5%)		32 bytes (1%)	1
["missing_dot", "equiv"]	1.270 μs (5%)		16 bytes (1%)	1
["missing_dot", "man"]	1.350 μs (5%)		16 bytes (1%)	1
["missing_dot", "naive"]	4.572 μs (5%)		16 bytes (1%)	1
["missing_dot", "rf"]	1.350 μs (5%)		16 bytes (1%)	1
["missing_dot", "rf_nota"]	1.480 μs (5%)		16 bytes (1%)	1
["missing_dot", "xf"]	182.304 μs (5%)		72.14 KiB (1%)	3743
["missing_dot", "xf_nota"]	181.503 μs (5%)		72.05 KiB (1%)	3739
["overhead", "foldl"]	4.800 ns (5%)
["overhead", "reduce_basecase"]	3.462 μs (5%)		1.17 KiB (1%)	21
["partition_by", "man"]	1.927 ms (5%)		352 bytes (1%)	4
["partition_by", "xf"]	3.274 ms (5%)		6.10 MiB (1%)	200007

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

• ["cat"]
• ["collect"]
• ["dot"]
• ["filter_map_map!"]
• ["filter_map_reduce"]
• ["findall"]
• ["gemm", "fusedmul", "blas"]
• ["gemm", "fusedmul", "xf"]
• ["gemm", "mul", "linalg"]
• ["gemm", "mul", "man", "false"]
• ["gemm", "mul", "man", "ivdep"]
• ["gemm", "mul", "man", "true"]
• ["gemm", "mul", "xf", "false"]
• ["gemm", "mul", "xf", "ivdep"]
• ["gemm", "mul", "xf", "true"]
• ["groupby", "sum"]
• ["missing_argmax"]
• ["missing_dot"]
• ["overhead"]
• ["partition_by"]

Julia versioninfo

Julia Version 1.4.2
Commit 44fa15b150* (2020-05-23 18:35 UTC)
Platform Info:
  OS: Linux (x86_64-pc-linux-gnu)
      Ubuntu 18.04.4 LTS
  uname: Linux 5.3.0-1028-azure #29~18.04.1-Ubuntu SMP Fri Jun 5 14:32:34 UTC 2020 x86_64 x86_64
  CPU: Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz: 
              speed         user         nice          sys         idle          irq
       #1  2095 MHz      38912 s          0 s       1410 s      21175 s          0 s
       #2  2095 MHz      19496 s          0 s       1440 s      40625 s          0 s
       
  Memory: 6.764884948730469 GB (3299.96875 MB free)
  Uptime: 629.0 sec
  Load Avg:  1.36669921875  1.09130859375  0.63720703125
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-8.0.1 (ORCJIT, skylake)

---

Baseline result

Benchmark Report for /home/runner/work/Transducers.jl/Transducers.jl

Job Properties

• Time of benchmark: 23 Jun 2020 - 0:57
• Package commit: dcd077
• Julia commit: 44fa15
• Julia command flags: None
• Environment variables: OMP_NUM_THREADS => 1 JULIA_NUM_THREADS => 1

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID	time	GC time	memory	allocations
["cat", "base"]	2.089 μs (5%)
["cat", "xf"]	2.167 μs (5%)		80 bytes (1%)	3
["collect", "filter-missing"]	107.801 μs (5%)		345.36 KiB (1%)	10018
["collect", "identity-float"]	82.800 μs (5%)		569.20 KiB (1%)	10018
["collect", "identity-union"]	321.503 μs (5%)		705.63 KiB (1%)	16697
["dot", "blas"]	1.280 μs (5%)
["dot", "man"]	1.280 μs (5%)
["dot", "rf"]	1.856 μs (5%)
["dot", "xf"]	1.889 μs (5%)
["filter_map_map!", "man"]	55.101 μs (5%)
["filter_map_map!", "xf"]	580.604 μs (5%)		304 bytes (1%)	17
["filter_map_reduce", "man"]	227.402 μs (5%)
["filter_map_reduce", "xf"]	256.402 μs (5%)
["findall", "base"]	733.907 μs (5%)		2.00 MiB (1%)	21
["findall", "xf-array"]	734.807 μs (5%)		3.03 MiB (1%)	99203
["findall", "xf-iter"]	3.547 ms (5%)		9.63 MiB (1%)	299929
["gemm", "fusedmul", "blas", "16"]	4.954 ms (5%)
["gemm", "fusedmul", "blas", "2"]	3.748 ms (5%)
["gemm", "fusedmul", "blas", "32"]	6.994 ms (5%)
["gemm", "fusedmul", "blas", "8"]	3.964 ms (5%)
["gemm", "fusedmul", "xf", "16"]	4.607 ms (5%)		160 bytes (1%)	6
["gemm", "fusedmul", "xf", "2"]	517.104 μs (5%)		160 bytes (1%)	6
["gemm", "fusedmul", "xf", "32"]	8.793 ms (5%)		160 bytes (1%)	6
["gemm", "fusedmul", "xf", "8"]	2.248 ms (5%)		160 bytes (1%)	6
["gemm", "mul", "linalg", "256"]	893.008 μs (5%)
["gemm", "mul", "linalg", "32"]	3.600 μs (5%)
["gemm", "mul", "linalg", "8"]	300.000 ns (5%)
["gemm", "mul", "man", "false", "256"]	1.731 ms (5%)
["gemm", "mul", "man", "false", "32"]	4.800 μs (5%)
["gemm", "mul", "man", "false", "8"]	400.000 ns (5%)
["gemm", "mul", "man", "ivdep", "256"]	1.683 ms (5%)
["gemm", "mul", "man", "ivdep", "32"]	4.300 μs (5%)
["gemm", "mul", "man", "ivdep", "8"]	500.000 ns (5%)
["gemm", "mul", "man", "true", "256"]	1.632 ms (5%)
["gemm", "mul", "man", "true", "32"]	4.300 μs (5%)
["gemm", "mul", "man", "true", "8"]	400.000 ns (5%)
["gemm", "mul", "xf", "false", "256"]	1.576 ms (5%)		48 bytes (1%)	2
["gemm", "mul", "xf", "false", "32"]	4.800 μs (5%)		48 bytes (1%)	2
["gemm", "mul", "xf", "false", "8"]	400.000 ns (5%)		48 bytes (1%)	2
["gemm", "mul", "xf", "ivdep", "256"]	1.423 ms (5%)		48 bytes (1%)	2
["gemm", "mul", "xf", "ivdep", "32"]	3.600 μs (5%)		48 bytes (1%)	2
["gemm", "mul", "xf", "ivdep", "8"]	400.000 ns (5%)		48 bytes (1%)	2
["gemm", "mul", "xf", "true", "256"]	1.514 ms (5%)		48 bytes (1%)	2
["gemm", "mul", "xf", "true", "32"]	5.500 μs (5%)		48 bytes (1%)	2
["gemm", "mul", "xf", "true", "8"]	400.000 ns (5%)		48 bytes (1%)	2
["groupby", "sum", "sac"]	244.202 μs (5%)		313.14 KiB (1%)	10007
["groupby", "sum", "xf-with-init"]	160.101 μs (5%)		157.44 KiB (1%)	10008
["groupby", "sum", "xf-without-init"]	198.501 μs (5%)		157.44 KiB (1%)	10008
["missing_argmax", "man"]	2.978 μs (5%)		32 bytes (1%)	1
["missing_argmax", "rf"]	2.945 μs (5%)		32 bytes (1%)	1
["missing_argmax", "xf"]	2.800 μs (5%)		32 bytes (1%)	1
["missing_dot", "equiv"]	1.510 μs (5%)		16 bytes (1%)	1
["missing_dot", "man"]	1.330 μs (5%)		16 bytes (1%)	1
["missing_dot", "naive"]	3.986 μs (5%)		16 bytes (1%)	1
["missing_dot", "rf"]	1.540 μs (5%)		16 bytes (1%)	1
["missing_dot", "rf_nota"]	1.430 μs (5%)		16 bytes (1%)	1
["missing_dot", "xf"]	203.401 μs (5%)		71.95 KiB (1%)	3735
["missing_dot", "xf_nota"]	202.401 μs (5%)		72.03 KiB (1%)	3735
["partition_by", "man"]	1.812 ms (5%)		352 bytes (1%)	4
["partition_by", "xf"]	3.087 ms (5%)		6.10 MiB (1%)	200007

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

• ["cat"]
• ["collect"]
• ["dot"]
• ["filter_map_map!"]
• ["filter_map_reduce"]
• ["findall"]
• ["gemm", "fusedmul", "blas"]
• ["gemm", "fusedmul", "xf"]
• ["gemm", "mul", "linalg"]
• ["gemm", "mul", "man", "false"]
• ["gemm", "mul", "man", "ivdep"]
• ["gemm", "mul", "man", "true"]
• ["gemm", "mul", "xf", "false"]
• ["gemm", "mul", "xf", "ivdep"]
• ["gemm", "mul", "xf", "true"]
• ["groupby", "sum"]
• ["missing_argmax"]
• ["missing_dot"]
• ["partition_by"]

Julia versioninfo

Julia Version 1.4.2
Commit 44fa15b150* (2020-05-23 18:35 UTC)
Platform Info:
  OS: Linux (x86_64-pc-linux-gnu)
      Ubuntu 18.04.4 LTS
  uname: Linux 5.3.0-1028-azure #29~18.04.1-Ubuntu SMP Fri Jun 5 14:32:34 UTC 2020 x86_64 x86_64
  CPU: Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz: 
              speed         user         nice          sys         idle          irq
       #1  2095 MHz      45363 s          0 s       1550 s      38061 s          0 s
       #2  2095 MHz      36541 s          0 s       1588 s      46896 s          0 s
       
  Memory: 6.764884948730469 GB (3265.9921875 MB free)
  Uptime: 865.0 sec
  Load Avg:  1.07763671875  1.10595703125  0.75830078125
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-8.0.1 (ORCJIT, skylake)

---

Runtime information

Runtime Info
BLAS #threads	2
BLAS.vendor()	openblas64
Sys.CPU_THREADS	2

lscpu output:

Architecture:        x86_64
CPU op-mode(s):      32-bit, 64-bit
Byte Order:          Little Endian
CPU(s):              2
On-line CPU(s) list: 0,1
Thread(s) per core:  1
Core(s) per socket:  2
Socket(s):           1
NUMA node(s):        1
Vendor ID:           GenuineIntel
CPU family:          6
Model:               85
Model name:          Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz
Stepping:            4
CPU MHz:             2095.079
BogoMIPS:            4190.15
Hypervisor vendor:   Microsoft
Virtualization type: full
L1d cache:           32K
L1i cache:           32K
L2 cache:            1024K
L3 cache:            36608K
NUMA node0 CPU(s):   0,1
Flags:               fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology cpuid pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch invpcid_single pti fsgsbase bmi1 hle avx2 smep bmi2 erms invpcid rtm mpx avx512f avx512dq rdseed adx smap clflushopt avx512cd avx512bw avx512vl xsaveopt xsavec xsaves

Cpu Property	Value
Brand	Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz
Vendor	:Intel
Architecture	:Skylake
Model	Family: 0x06, Model: 0x55, Stepping: 0x04, Type: 0x00
Cores	2 physical cores, 2 logical cores (on executing CPU)
	No Hyperthreading detected
Clock Frequencies	Not supported by CPU
Data Cache	Level 1:3 : (32, 1024, 36608) kbytes
	64 byte cache line size
Address Size	48 bits virtual, 44 bits physical
SIMD	512 bit = 64 byte max. SIMD vector size
Time Stamp Counter	TSC is accessible via rdtsc
	TSC increased at every clock cycle (non-invariant TSC)
Perf. Monitoring	Performance Monitoring Counters (PMC) are not supported
Hypervisor	Yes, Microsoft

[github-actions]

Multi-thread benchmark result

Judge result

Benchmark Report for /home/runner/work/Transducers.jl/Transducers.jl

Job Properties

• Time of benchmarks:
  • Target: 23 Jun 2020 - 00:54
  • Baseline: 23 Jun 2020 - 00:59
• Package commits:
  • Target: eb6991
  • Baseline: dcd077
• Julia commits:
  • Target: 44fa15
  • Baseline: 44fa15
• Julia command flags:
  • Target: None
  • Baseline: None
• Environment variables:
  • Target: JULIA_NUM_THREADS => 2
  • Baseline: JULIA_NUM_THREADS => 2

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).

ID	time ratio	memory ratio
["collect", "unordered", "basesize=1024"]	1.21 (5%) ❌	1.13 (1%) ❌
["findfirst", "n=500", "reduce", "basesize=128"]	0.95 (5%) ✅	1.00 (1%)
["overhead", "stoppable=false"]	0.95 (5%) ✅	1.00 (1%)
["overhead", "stoppable=true"]	1.15 (5%) ❌	1.00 (1%)
["parallel_histogram", "comm", "basesize=4096"]	1.07 (5%) ❌	0.98 (1%) ✅
["parallel_histogram", "comm", "basesize=8192"]	0.99 (5%)	1.03 (1%) ❌
["sum", "uniform", "reduce", "basesize=256"]	0.95 (5%) ✅	1.00 (1%)
["words", "nthreads=2"]	0.92 (5%) ✅	0.99 (1%)

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

• ["collect", "assoc"]
• ["collect"]
• ["collect", "unordered"]
• ["findfirst", "n=1000"]
• ["findfirst", "n=1000", "reduce"]
• ["findfirst", "n=400"]
• ["findfirst", "n=400", "reduce"]
• ["findfirst", "n=500"]
• ["findfirst", "n=500", "reduce"]
• ["overhead"]
• ["parallel_histogram", "assoc"]
• ["parallel_histogram", "comm"]
• ["parallel_histogram"]
• ["sum", "random"]
• ["sum", "random", "reduce"]
• ["sum", "uniform"]
• ["sum", "uniform", "reduce"]
• ["sum", "valley"]
• ["sum", "valley", "reduce"]
• ["words"]

Julia versioninfo

Target

Julia Version 1.4.2
Commit 44fa15b150* (2020-05-23 18:35 UTC)
Platform Info:
  OS: Linux (x86_64-pc-linux-gnu)
      Ubuntu 18.04.4 LTS
  uname: Linux 5.3.0-1028-azure #29~18.04.1-Ubuntu SMP Fri Jun 5 14:32:34 UTC 2020 x86_64 x86_64
  CPU: Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz: 
              speed         user         nice          sys         idle          irq
       #1  2095 MHz      51100 s          0 s       2100 s      35088 s          0 s
       #2  2095 MHz      47019 s          0 s       2425 s      38420 s          0 s
       
  Memory: 6.764884948730469 GB (3353.62109375 MB free)
  Uptime: 898.0 sec
  Load Avg:  1.77099609375  1.52490234375  0.8857421875
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-8.0.1 (ORCJIT, skylake)

Baseline

Julia Version 1.4.2
Commit 44fa15b150* (2020-05-23 18:35 UTC)
Platform Info:
  OS: Linux (x86_64-pc-linux-gnu)
      Ubuntu 18.04.4 LTS
  uname: Linux 5.3.0-1028-azure #29~18.04.1-Ubuntu SMP Fri Jun 5 14:32:34 UTC 2020 x86_64 x86_64
  CPU: Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz: 
              speed         user         nice          sys         idle          irq
       #1  2095 MHz      73872 s          0 s       2612 s      40064 s          0 s
       #2  2095 MHz      68256 s          0 s       2863 s      44938 s          0 s
       
  Memory: 6.764884948730469 GB (3385.9296875 MB free)
  Uptime: 1183.0 sec
  Load Avg:  1.7431640625  1.60986328125  1.09326171875
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-8.0.1 (ORCJIT, skylake)

---

Target result

Benchmark Report for /home/runner/work/Transducers.jl/Transducers.jl

Job Properties

• Time of benchmark: 23 Jun 2020 - 0:54
• Package commit: eb6991
• Julia commit: 44fa15
• Julia command flags: None
• Environment variables: JULIA_NUM_THREADS => 2

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID	time	GC time	memory	allocations
["collect", "assoc", "basesize=1"]	363.952 ms (5%)	11.240 ms	87.55 MiB (1%)	1590753
["collect", "assoc", "basesize=1024"]	227.177 ms (5%)		1.84 MiB (1%)	1827
["collect", "assoc", "basesize=32"]	235.278 ms (5%)		5.64 MiB (1%)	54021
["collect", "seq"]	446.096 ms (5%)		1.50 MiB (1%)	32787
["collect", "unordered", "basesize=1"]	480.332 ms (5%)		29.16 MiB (1%)	403121
["collect", "unordered", "basesize=1024"]	347.284 ms (5%)		906.00 KiB (1%)	11076
["collect", "unordered", "basesize=32"]	260.158 ms (5%)		1.47 MiB (1%)	16730
["findfirst", "n=1000", "foldl"]	707.811 ms (5%)
["findfirst", "n=1000", "reduce", "basesize=128"]	365.549 ms (5%)		565.05 KiB (1%)	10236
["findfirst", "n=1000", "reduce", "basesize=256"]	364.186 ms (5%)		288.41 KiB (1%)	5242
["findfirst", "n=1000", "reduce", "basesize=512"]	369.236 ms (5%)		150.52 KiB (1%)	2744
["findfirst", "n=400", "foldl"]	532.189 ms (5%)
["findfirst", "n=400", "reduce", "basesize=128"]	275.988 ms (5%)		1.02 MiB (1%)	18887
["findfirst", "n=400", "reduce", "basesize=256"]	271.257 ms (5%)		526.89 KiB (1%)	9563
["findfirst", "n=400", "reduce", "basesize=512"]	271.328 ms (5%)		268.38 KiB (1%)	4895
["findfirst", "n=500", "foldl"]	89.759 ms (5%)
["findfirst", "n=500", "reduce", "basesize=128"]	44.652 ms (5%)		158.38 KiB (1%)	2859
["findfirst", "n=500", "reduce", "basesize=256"]	46.809 ms (5%)		85.67 KiB (1%)	1551
["findfirst", "n=500", "reduce", "basesize=512"]	48.879 ms (5%)		49.45 KiB (1%)	898
["overhead", "default"]	184.506 μs (5%)		147.05 KiB (1%)	2646
["overhead", "stoppable=false"]	175.606 μs (5%)		146.23 KiB (1%)	2631
["overhead", "stoppable=true"]	337.812 μs (5%)		146.48 KiB (1%)	2648
["parallel_histogram", "assoc", "basesize=16384"]	4.541 ms (5%)		732.86 KiB (1%)	118
["parallel_histogram", "assoc", "basesize=4096"]	5.611 ms (5%)		1.80 MiB (1%)	512
["parallel_histogram", "assoc", "basesize=8192"]	4.831 ms (5%)		1.43 MiB (1%)	257
["parallel_histogram", "comm", "basesize=16384"]	15.256 ms (5%)		1.22 MiB (1%)	160
["parallel_histogram", "comm", "basesize=4096"]	24.094 ms (5%)		1.07 MiB (1%)	4754
["parallel_histogram", "comm", "basesize=8192"]	20.343 ms (5%)		1.26 MiB (1%)	2389
["parallel_histogram", "seq"]	8.095 ms (5%)		364.64 KiB (1%)	26
["sum", "random", "foldl"]	16.077 ms (5%)
["sum", "random", "reduce", "basesize=128"]	8.736 ms (5%)		314.13 KiB (1%)	6083
["sum", "random", "reduce", "basesize=256"]	8.578 ms (5%)		155.84 KiB (1%)	3024
["sum", "random", "reduce", "basesize=512"]	8.630 ms (5%)		77.02 KiB (1%)	1498
["sum", "uniform", "foldl"]	15.831 ms (5%)
["sum", "uniform", "reduce", "basesize=128"]	8.356 ms (5%)		314.11 KiB (1%)	6082
["sum", "uniform", "reduce", "basesize=256"]	8.353 ms (5%)		155.86 KiB (1%)	3025
["sum", "uniform", "reduce", "basesize=512"]	8.216 ms (5%)		76.98 KiB (1%)	1496
["sum", "valley", "foldl"]	16.844 ms (5%)
["sum", "valley", "reduce", "basesize=128"]	8.924 ms (5%)		314.06 KiB (1%)	6079
["sum", "valley", "reduce", "basesize=256"]	8.382 ms (5%)		155.84 KiB (1%)	3024
["sum", "valley", "reduce", "basesize=512"]	8.575 ms (5%)		77.02 KiB (1%)	1498
["words", "nthreads=1"]	37.316 ms (5%)	6.986 ms	64.46 MiB (1%)	2086333
["words", "nthreads=2"]	20.422 ms (5%)		64.82 MiB (1%)	2086410
["words", "nthreads=4"]	23.019 ms (5%)		65.73 MiB (1%)	2086709

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

• ["collect", "assoc"]
• ["collect"]
• ["collect", "unordered"]
• ["findfirst", "n=1000"]
• ["findfirst", "n=1000", "reduce"]
• ["findfirst", "n=400"]
• ["findfirst", "n=400", "reduce"]
• ["findfirst", "n=500"]
• ["findfirst", "n=500", "reduce"]
• ["overhead"]
• ["parallel_histogram", "assoc"]
• ["parallel_histogram", "comm"]
• ["parallel_histogram"]
• ["sum", "random"]
• ["sum", "random", "reduce"]
• ["sum", "uniform"]
• ["sum", "uniform", "reduce"]
• ["sum", "valley"]
• ["sum", "valley", "reduce"]
• ["words"]

Julia versioninfo

Julia Version 1.4.2
Commit 44fa15b150* (2020-05-23 18:35 UTC)
Platform Info:
  OS: Linux (x86_64-pc-linux-gnu)
      Ubuntu 18.04.4 LTS
  uname: Linux 5.3.0-1028-azure #29~18.04.1-Ubuntu SMP Fri Jun 5 14:32:34 UTC 2020 x86_64 x86_64
  CPU: Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz: 
              speed         user         nice          sys         idle          irq
       #1  2095 MHz      51100 s          0 s       2100 s      35088 s          0 s
       #2  2095 MHz      47019 s          0 s       2425 s      38420 s          0 s
       
  Memory: 6.764884948730469 GB (3353.62109375 MB free)
  Uptime: 898.0 sec
  Load Avg:  1.77099609375  1.52490234375  0.8857421875
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-8.0.1 (ORCJIT, skylake)

---

Baseline result

Benchmark Report for /home/runner/work/Transducers.jl/Transducers.jl

Job Properties

• Time of benchmark: 23 Jun 2020 - 0:59
• Package commit: dcd077
• Julia commit: 44fa15
• Julia command flags: None
• Environment variables: JULIA_NUM_THREADS => 2

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID	time	GC time	memory	allocations
["collect", "assoc", "basesize=1"]	364.734 ms (5%)	12.367 ms	87.55 MiB (1%)	1590828
["collect", "assoc", "basesize=1024"]	227.627 ms (5%)		1.84 MiB (1%)	1826
["collect", "assoc", "basesize=32"]	231.764 ms (5%)		5.64 MiB (1%)	54024
["collect", "seq"]	447.665 ms (5%)		1.50 MiB (1%)	32787
["collect", "unordered", "basesize=1"]	476.056 ms (5%)	7.355 ms	29.16 MiB (1%)	403012
["collect", "unordered", "basesize=1024"]	286.569 ms (5%)		804.42 KiB (1%)	4575
["collect", "unordered", "basesize=32"]	258.367 ms (5%)		1.47 MiB (1%)	16404
["findfirst", "n=1000", "foldl"]	704.429 ms (5%)
["findfirst", "n=1000", "reduce", "basesize=128"]	359.053 ms (5%)		564.81 KiB (1%)	10221
["findfirst", "n=1000", "reduce", "basesize=256"]	364.453 ms (5%)		288.38 KiB (1%)	5240
["findfirst", "n=1000", "reduce", "basesize=512"]	369.866 ms (5%)		150.58 KiB (1%)	2748
["findfirst", "n=400", "foldl"]	527.120 ms (5%)
["findfirst", "n=400", "reduce", "basesize=128"]	273.492 ms (5%)		1.02 MiB (1%)	18873
["findfirst", "n=400", "reduce", "basesize=256"]	272.265 ms (5%)		526.84 KiB (1%)	9560
["findfirst", "n=400", "reduce", "basesize=512"]	275.072 ms (5%)		268.23 KiB (1%)	4886
["findfirst", "n=500", "foldl"]	88.763 ms (5%)
["findfirst", "n=500", "reduce", "basesize=128"]	47.146 ms (5%)		158.42 KiB (1%)	2862
["findfirst", "n=500", "reduce", "basesize=256"]	46.708 ms (5%)		85.67 KiB (1%)	1551
["findfirst", "n=500", "reduce", "basesize=512"]	49.766 ms (5%)		49.45 KiB (1%)	898
["overhead", "default"]	180.312 μs (5%)		147.05 KiB (1%)	2646
["overhead", "stoppable=false"]	185.312 μs (5%)		146.25 KiB (1%)	2632
["overhead", "stoppable=true"]	294.919 μs (5%)		146.45 KiB (1%)	2646
["parallel_histogram", "assoc", "basesize=16384"]	4.669 ms (5%)		732.86 KiB (1%)	118
["parallel_histogram", "assoc", "basesize=4096"]	5.515 ms (5%)		1.80 MiB (1%)	512
["parallel_histogram", "assoc", "basesize=8192"]	4.886 ms (5%)		1.43 MiB (1%)	257
["parallel_histogram", "comm", "basesize=16384"]	15.372 ms (5%)		1.22 MiB (1%)	160
["parallel_histogram", "comm", "basesize=4096"]	22.518 ms (5%)		1.09 MiB (1%)	4793
["parallel_histogram", "comm", "basesize=8192"]	20.446 ms (5%)		1.22 MiB (1%)	172
["parallel_histogram", "seq"]	8.159 ms (5%)		364.64 KiB (1%)	26
["sum", "random", "foldl"]	16.486 ms (5%)
["sum", "random", "reduce", "basesize=128"]	8.527 ms (5%)		314.11 KiB (1%)	6082
["sum", "random", "reduce", "basesize=256"]	8.366 ms (5%)		155.81 KiB (1%)	3022
["sum", "random", "reduce", "basesize=512"]	8.291 ms (5%)		77.05 KiB (1%)	1500
["sum", "uniform", "foldl"]	16.221 ms (5%)
["sum", "uniform", "reduce", "basesize=128"]	8.692 ms (5%)		314.13 KiB (1%)	6083
["sum", "uniform", "reduce", "basesize=256"]	8.814 ms (5%)		155.84 KiB (1%)	3024
["sum", "uniform", "reduce", "basesize=512"]	8.438 ms (5%)		77.00 KiB (1%)	1497
["sum", "valley", "foldl"]	16.561 ms (5%)
["sum", "valley", "reduce", "basesize=128"]	9.026 ms (5%)		314.03 KiB (1%)	6077
["sum", "valley", "reduce", "basesize=256"]	8.661 ms (5%)		155.84 KiB (1%)	3024
["sum", "valley", "reduce", "basesize=512"]	8.506 ms (5%)		77.03 KiB (1%)	1499
["words", "nthreads=1"]	37.326 ms (5%)	6.318 ms	64.62 MiB (1%)	2090802
["words", "nthreads=2"]	22.101 ms (5%)		65.34 MiB (1%)	2090956
["words", "nthreads=4"]	23.945 ms (5%)		65.98 MiB (1%)	2091245

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

• ["collect", "assoc"]
• ["collect"]
• ["collect", "unordered"]
• ["findfirst", "n=1000"]
• ["findfirst", "n=1000", "reduce"]
• ["findfirst", "n=400"]
• ["findfirst", "n=400", "reduce"]
• ["findfirst", "n=500"]
• ["findfirst", "n=500", "reduce"]
• ["overhead"]
• ["parallel_histogram", "assoc"]
• ["parallel_histogram", "comm"]
• ["parallel_histogram"]
• ["sum", "random"]
• ["sum", "random", "reduce"]
• ["sum", "uniform"]
• ["sum", "uniform", "reduce"]
• ["sum", "valley"]
• ["sum", "valley", "reduce"]
• ["words"]

Julia versioninfo

Julia Version 1.4.2
Commit 44fa15b150* (2020-05-23 18:35 UTC)
Platform Info:
  OS: Linux (x86_64-pc-linux-gnu)
      Ubuntu 18.04.4 LTS
  uname: Linux 5.3.0-1028-azure #29~18.04.1-Ubuntu SMP Fri Jun 5 14:32:34 UTC 2020 x86_64 x86_64
  CPU: Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz: 
              speed         user         nice          sys         idle          irq
       #1  2095 MHz      73872 s          0 s       2612 s      40064 s          0 s
       #2  2095 MHz      68256 s          0 s       2863 s      44938 s          0 s
       
  Memory: 6.764884948730469 GB (3385.9296875 MB free)
  Uptime: 1183.0 sec
  Load Avg:  1.7431640625  1.60986328125  1.09326171875
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-8.0.1 (ORCJIT, skylake)

---

Runtime information

Runtime Info
BLAS #threads	2
BLAS.vendor()	openblas64
Sys.CPU_THREADS	2

lscpu output:

Architecture:        x86_64
CPU op-mode(s):      32-bit, 64-bit
Byte Order:          Little Endian
CPU(s):              2
On-line CPU(s) list: 0,1
Thread(s) per core:  1
Core(s) per socket:  2
Socket(s):           1
NUMA node(s):        1
Vendor ID:           GenuineIntel
CPU family:          6
Model:               85
Model name:          Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz
Stepping:            4
CPU MHz:             2095.195
BogoMIPS:            4190.39
Hypervisor vendor:   Microsoft
Virtualization type: full
L1d cache:           32K
L1i cache:           32K
L2 cache:            1024K
L3 cache:            36608K
NUMA node0 CPU(s):   0,1
Flags:               fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology cpuid pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch invpcid_single pti fsgsbase bmi1 hle avx2 smep bmi2 erms invpcid rtm mpx avx512f avx512dq rdseed adx smap clflushopt avx512cd avx512bw avx512vl xsaveopt xsavec xsaves md_clear

Cpu Property	Value
Brand	Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz
Vendor	:Intel
Architecture	:Skylake
Model	Family: 0x06, Model: 0x55, Stepping: 0x04, Type: 0x00
Cores	2 physical cores, 2 logical cores (on executing CPU)
	No Hyperthreading detected
Clock Frequencies	Not supported by CPU
Data Cache	Level 1:3 : (32, 1024, 36608) kbytes
	64 byte cache line size
Address Size	48 bits virtual, 44 bits physical
SIMD	512 bit = 64 byte max. SIMD vector size
Time Stamp Counter	TSC is accessible via rdtsc
	TSC increased at every clock cycle (non-invariant TSC)
Perf. Monitoring	Performance Monitoring Counters (PMC) are not supported
Hypervisor	Yes, Microsoft