Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update */Manifest.toml #243

Open
wants to merge 965 commits into
base: master
Choose a base branch
from
Open

Update */Manifest.toml #243

wants to merge 965 commits into from

Conversation

tkf-bot
Copy link
Contributor

@tkf-bot tkf-bot commented Mar 5, 2020

Commit Message

Update */Manifest.toml

@codecov-io
Copy link

codecov-io commented Mar 5, 2020

Codecov Report

Merging #243 into master will not change coverage.
The diff coverage is n/a.

Impacted file tree graph

@@           Coverage Diff           @@
##           master     #243   +/-   ##
=======================================
  Coverage   90.17%   90.17%           
=======================================
  Files          20       20           
  Lines        1395     1395           
=======================================
  Hits         1258     1258           
  Misses        137      137           

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update d8a2512...d8a2512. Read the comment docs.

@github-actions
Copy link
Contributor

github-actions bot commented Mar 5, 2020

Benchmark result

Judge result

Benchmark Report for /home/runner/work/Transducers.jl/Transducers.jl

Job Properties

  • Time of benchmarks:
    • Target: 5 Mar 2020 - 07:16
    • Baseline: 5 Mar 2020 - 07:19
  • Package commits:
    • Target: 747582
    • Baseline: f62c6a
  • Julia commits:
    • Target: 2d5741
    • Baseline: 2d5741
  • Julia command flags:
    • Target: None
    • Baseline: None
  • Environment variables:
    • Target: OMP_NUM_THREADS => 1 JULIA_NUM_THREADS => 1
    • Baseline: OMP_NUM_THREADS => 1 JULIA_NUM_THREADS => 1

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).

ID time ratio memory ratio
["filter_map_map!", "xf"] 0.85 (5%) ✅ 1.00 (1%)
["gemm", "fusedmul", "xf", "16"] 0.92 (5%) ✅ 1.00 (1%)
["gemm", "fusedmul", "xf", "32"] 0.89 (5%) ✅ 1.00 (1%)
["gemm", "mul", "linalg", "8"] 1.15 (5%) ❌ 1.00 (1%)
["gemm", "mul", "man", "false", "256"] 1.08 (5%) ❌ 1.00 (1%)
["gemm", "mul", "man", "false", "8"] 0.73 (5%) ✅ 1.00 (1%)
["gemm", "mul", "man", "ivdep", "256"] 1.06 (5%) ❌ 1.00 (1%)
["gemm", "mul", "man", "ivdep", "8"] 1.06 (5%) ❌ 1.00 (1%)
["gemm", "mul", "man", "true", "256"] 1.08 (5%) ❌ 1.00 (1%)
["gemm", "mul", "man", "true", "8"] 1.22 (5%) ❌ 1.00 (1%)
["gemm", "mul", "xf", "false", "256"] 1.08 (5%) ❌ 1.00 (1%)
["gemm", "mul", "xf", "false", "8"] 0.91 (5%) ✅ 1.00 (1%)
["gemm", "mul", "xf", "ivdep", "256"] 1.05 (5%) ❌ 1.00 (1%)
["gemm", "mul", "xf", "true", "256"] 1.08 (5%) ❌ 1.00 (1%)
["gemm", "mul", "xf", "true", "8"] 1.06 (5%) ❌ 1.00 (1%)
["missing_dot", "equiv"] 0.95 (5%) ✅ 1.00 (1%)

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["cat"]
  • ["collect"]
  • ["dot"]
  • ["filter_map_map!"]
  • ["filter_map_reduce"]
  • ["findall"]
  • ["gemm", "fusedmul", "blas"]
  • ["gemm", "fusedmul", "xf"]
  • ["gemm", "mul", "linalg"]
  • ["gemm", "mul", "man", "false"]
  • ["gemm", "mul", "man", "ivdep"]
  • ["gemm", "mul", "man", "true"]
  • ["gemm", "mul", "xf", "false"]
  • ["gemm", "mul", "xf", "ivdep"]
  • ["gemm", "mul", "xf", "true"]
  • ["missing_argmax"]
  • ["missing_dot"]
  • ["partition_by"]

Julia versioninfo

Target

Julia Version 1.3.1
Commit 2d5741174c (2019-12-30 21:36 UTC)
Platform Info:
  OS: Linux (x86_64-pc-linux-gnu)
      Ubuntu 18.04.4 LTS
  uname: Linux 5.0.0-1032-azure #34-Ubuntu SMP Mon Feb 10 19:37:25 UTC 2020 x86_64 x86_64
  CPU: Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz: 
              speed         user         nice          sys         idle          irq
       #1  2095 MHz      13588 s          0 s       1078 s      37399 s          0 s
       #2  2095 MHz      36312 s          0 s       1198 s      14837 s          0 s
       
  Memory: 6.782737731933594 GB (3485.9453125 MB free)
  Uptime: 538.0 sec
  Load Avg:  1.01904296875  0.9296875  0.52734375
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-6.0.1 (ORCJIT, skylake)

Baseline

Julia Version 1.3.1
Commit 2d5741174c (2019-12-30 21:36 UTC)
Platform Info:
  OS: Linux (x86_64-pc-linux-gnu)
      Ubuntu 18.04.4 LTS
  uname: Linux 5.0.0-1032-azure #34-Ubuntu SMP Mon Feb 10 19:37:25 UTC 2020 x86_64 x86_64
  CPU: Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz: 
              speed         user         nice          sys         idle          irq
       #1  2095 MHz      27445 s          0 s       1183 s      45716 s          0 s
       #2  2095 MHz      44674 s          0 s       1400 s      28544 s          0 s
       
  Memory: 6.782737731933594 GB (3456.84765625 MB free)
  Uptime: 762.0 sec
  Load Avg:  1.046875  0.99072265625  0.64453125
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-6.0.1 (ORCJIT, skylake)

Target result

Benchmark Report for /home/runner/work/Transducers.jl/Transducers.jl

Job Properties

  • Time of benchmark: 5 Mar 2020 - 7:16
  • Package commit: 747582
  • Julia commit: 2d5741
  • Julia command flags: None
  • Environment variables: OMP_NUM_THREADS => 1 JULIA_NUM_THREADS => 1

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["cat", "base"] 192.906 μs (5%)
["cat", "xf"] 1.420 μs (5%)
["collect", "filter-missing"] 78.203 μs (5%) 33.05 KiB (1%) 20
["collect", "identity-float"] 57.602 μs (5%) 256.91 KiB (1%) 20
["collect", "identity-union"] 275.408 μs (5%) 285.45 KiB (1%) 6659
["dot", "blas"] 1.010 μs (5%)
["dot", "man"] 980.100 ns (5%)
["dot", "rf"] 1.790 μs (5%)
["dot", "xf"] 1.780 μs (5%)
["filter_map_map!", "man"] 53.205 μs (5%)
["filter_map_map!", "xf"] 60.905 μs (5%) 144 bytes (1%) 8
["filter_map_reduce", "man"] 191.706 μs (5%)
["filter_map_reduce", "xf"] 191.806 μs (5%)
["findall", "base"] 679.224 μs (5%) 2.00 MiB (1%) 21
["findall", "xf-array"] 517.218 μs (5%) 3.05 MiB (1%) 100015
["findall", "xf-iter"] 656.322 μs (5%) 2.00 MiB (1%) 29
["gemm", "fusedmul", "blas", "16"] 3.801 ms (5%)
["gemm", "fusedmul", "blas", "2"] 2.922 ms (5%)
["gemm", "fusedmul", "blas", "32"] 5.151 ms (5%)
["gemm", "fusedmul", "blas", "8"] 3.016 ms (5%)
["gemm", "fusedmul", "xf", "16"] 4.167 ms (5%) 160 bytes (1%) 6
["gemm", "fusedmul", "xf", "2"] 531.545 μs (5%) 160 bytes (1%) 6
["gemm", "fusedmul", "xf", "32"] 8.445 ms (5%) 160 bytes (1%) 6
["gemm", "fusedmul", "xf", "8"] 2.208 ms (5%) 160 bytes (1%) 6
["gemm", "mul", "linalg", "256"] 757.222 μs (5%)
["gemm", "mul", "linalg", "32"] 2.511 μs (5%)
["gemm", "mul", "linalg", "8"] 229.789 ns (5%)
["gemm", "mul", "man", "false", "256"] 1.468 ms (5%)
["gemm", "mul", "man", "false", "32"] 3.800 μs (5%)
["gemm", "mul", "man", "false", "8"] 363.976 ns (5%)
["gemm", "mul", "man", "ivdep", "256"] 1.451 ms (5%)
["gemm", "mul", "man", "ivdep", "32"] 3.300 μs (5%)
["gemm", "mul", "man", "ivdep", "8"] 317.103 ns (5%)
["gemm", "mul", "man", "true", "256"] 1.470 ms (5%)
["gemm", "mul", "man", "true", "32"] 4.214 μs (5%)
["gemm", "mul", "man", "true", "8"] 367.317 ns (5%)
["gemm", "mul", "xf", "false", "256"] 1.463 ms (5%) 48 bytes (1%) 2
["gemm", "mul", "xf", "false", "32"] 3.638 μs (5%) 48 bytes (1%) 2
["gemm", "mul", "xf", "false", "8"] 364.834 ns (5%) 48 bytes (1%) 2
["gemm", "mul", "xf", "ivdep", "256"] 1.444 ms (5%) 48 bytes (1%) 2
["gemm", "mul", "xf", "ivdep", "32"] 3.163 μs (5%) 48 bytes (1%) 2
["gemm", "mul", "xf", "ivdep", "8"] 303.594 ns (5%) 48 bytes (1%) 2
["gemm", "mul", "xf", "true", "256"] 1.462 ms (5%) 48 bytes (1%) 2
["gemm", "mul", "xf", "true", "32"] 3.850 μs (5%) 48 bytes (1%) 2
["gemm", "mul", "xf", "true", "8"] 318.812 ns (5%) 48 bytes (1%) 2
["missing_argmax", "man"] 2.233 μs (5%) 32 bytes (1%) 1
["missing_argmax", "rf"] 2.145 μs (5%) 32 bytes (1%) 1
["missing_argmax", "xf"] 2.111 μs (5%) 32 bytes (1%) 1
["missing_dot", "equiv"] 1.210 μs (5%) 16 bytes (1%) 1
["missing_dot", "man"] 1.120 μs (5%) 16 bytes (1%) 1
["missing_dot", "naive"] 3.938 μs (5%) 16 bytes (1%) 1
["missing_dot", "rf"] 1.150 μs (5%) 16 bytes (1%) 1
["missing_dot", "rf_nota"] 1.260 μs (5%) 16 bytes (1%) 1
["missing_dot", "xf"] 179.505 μs (5%) 73.95 KiB (1%) 3859
["missing_dot", "xf_nota"] 179.405 μs (5%) 74.05 KiB (1%) 3864
["partition_by", "man"] 1.643 ms (5%) 352 bytes (1%) 4
["partition_by", "xf"] 1.530 ms (5%) 576 bytes (1%) 7

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["cat"]
  • ["collect"]
  • ["dot"]
  • ["filter_map_map!"]
  • ["filter_map_reduce"]
  • ["findall"]
  • ["gemm", "fusedmul", "blas"]
  • ["gemm", "fusedmul", "xf"]
  • ["gemm", "mul", "linalg"]
  • ["gemm", "mul", "man", "false"]
  • ["gemm", "mul", "man", "ivdep"]
  • ["gemm", "mul", "man", "true"]
  • ["gemm", "mul", "xf", "false"]
  • ["gemm", "mul", "xf", "ivdep"]
  • ["gemm", "mul", "xf", "true"]
  • ["missing_argmax"]
  • ["missing_dot"]
  • ["partition_by"]

Julia versioninfo

Julia Version 1.3.1
Commit 2d5741174c (2019-12-30 21:36 UTC)
Platform Info:
  OS: Linux (x86_64-pc-linux-gnu)
      Ubuntu 18.04.4 LTS
  uname: Linux 5.0.0-1032-azure #34-Ubuntu SMP Mon Feb 10 19:37:25 UTC 2020 x86_64 x86_64
  CPU: Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz: 
              speed         user         nice          sys         idle          irq
       #1  2095 MHz      13588 s          0 s       1078 s      37399 s          0 s
       #2  2095 MHz      36312 s          0 s       1198 s      14837 s          0 s
       
  Memory: 6.782737731933594 GB (3485.9453125 MB free)
  Uptime: 538.0 sec
  Load Avg:  1.01904296875  0.9296875  0.52734375
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-6.0.1 (ORCJIT, skylake)

Baseline result

Benchmark Report for /home/runner/work/Transducers.jl/Transducers.jl

Job Properties

  • Time of benchmark: 5 Mar 2020 - 7:19
  • Package commit: f62c6a
  • Julia commit: 2d5741
  • Julia command flags: None
  • Environment variables: OMP_NUM_THREADS => 1 JULIA_NUM_THREADS => 1

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["cat", "base"] 192.910 μs (5%)
["cat", "xf"] 1.420 μs (5%)
["collect", "filter-missing"] 78.304 μs (5%) 33.05 KiB (1%) 20
["collect", "identity-float"] 57.003 μs (5%) 256.91 KiB (1%) 20
["collect", "identity-union"] 279.515 μs (5%) 285.26 KiB (1%) 6682
["dot", "blas"] 1.000 μs (5%)
["dot", "man"] 1.010 μs (5%)
["dot", "rf"] 1.790 μs (5%)
["dot", "xf"] 1.790 μs (5%)
["filter_map_map!", "man"] 54.402 μs (5%)
["filter_map_map!", "xf"] 71.603 μs (5%) 144 bytes (1%) 8
["filter_map_reduce", "man"] 191.711 μs (5%)
["filter_map_reduce", "xf"] 191.711 μs (5%)
["findall", "base"] 669.742 μs (5%) 2.00 MiB (1%) 21
["findall", "xf-array"] 507.531 μs (5%) 3.05 MiB (1%) 100015
["findall", "xf-iter"] 651.739 μs (5%) 2.00 MiB (1%) 29
["gemm", "fusedmul", "blas", "16"] 3.772 ms (5%)
["gemm", "fusedmul", "blas", "2"] 2.888 ms (5%)
["gemm", "fusedmul", "blas", "32"] 5.252 ms (5%)
["gemm", "fusedmul", "blas", "8"] 3.038 ms (5%)
["gemm", "fusedmul", "xf", "16"] 4.550 ms (5%) 160 bytes (1%) 6
["gemm", "fusedmul", "xf", "2"] 548.923 μs (5%) 160 bytes (1%) 6
["gemm", "fusedmul", "xf", "32"] 9.498 ms (5%) 160 bytes (1%) 6
["gemm", "fusedmul", "xf", "8"] 2.180 ms (5%) 160 bytes (1%) 6
["gemm", "mul", "linalg", "256"] 756.839 μs (5%)
["gemm", "mul", "linalg", "32"] 2.500 μs (5%)
["gemm", "mul", "linalg", "8"] 200.000 ns (5%)
["gemm", "mul", "man", "false", "256"] 1.357 ms (5%)
["gemm", "mul", "man", "false", "32"] 4.000 μs (5%)
["gemm", "mul", "man", "false", "8"] 500.000 ns (5%)
["gemm", "mul", "man", "ivdep", "256"] 1.373 ms (5%)
["gemm", "mul", "man", "ivdep", "32"] 3.300 μs (5%)
["gemm", "mul", "man", "ivdep", "8"] 300.000 ns (5%)
["gemm", "mul", "man", "true", "256"] 1.357 ms (5%)
["gemm", "mul", "man", "true", "32"] 4.300 μs (5%)
["gemm", "mul", "man", "true", "8"] 300.000 ns (5%)
["gemm", "mul", "xf", "false", "256"] 1.357 ms (5%) 48 bytes (1%) 2
["gemm", "mul", "xf", "false", "32"] 3.800 μs (5%) 48 bytes (1%) 2
["gemm", "mul", "xf", "false", "8"] 400.000 ns (5%) 48 bytes (1%) 2
["gemm", "mul", "xf", "ivdep", "256"] 1.375 ms (5%) 48 bytes (1%) 2
["gemm", "mul", "xf", "ivdep", "32"] 3.200 μs (5%) 48 bytes (1%) 2
["gemm", "mul", "xf", "ivdep", "8"] 300.000 ns (5%) 48 bytes (1%) 2
["gemm", "mul", "xf", "true", "256"] 1.359 ms (5%) 48 bytes (1%) 2
["gemm", "mul", "xf", "true", "32"] 4.000 μs (5%) 48 bytes (1%) 2
["gemm", "mul", "xf", "true", "8"] 300.000 ns (5%) 48 bytes (1%) 2
["missing_argmax", "man"] 2.233 μs (5%) 32 bytes (1%) 1
["missing_argmax", "rf"] 2.133 μs (5%) 32 bytes (1%) 1
["missing_argmax", "xf"] 2.156 μs (5%) 32 bytes (1%) 1
["missing_dot", "equiv"] 1.280 μs (5%) 16 bytes (1%) 1
["missing_dot", "man"] 1.120 μs (5%) 16 bytes (1%) 1
["missing_dot", "naive"] 3.938 μs (5%) 16 bytes (1%) 1
["missing_dot", "rf"] 1.130 μs (5%) 16 bytes (1%) 1
["missing_dot", "rf_nota"] 1.200 μs (5%) 16 bytes (1%) 1
["missing_dot", "xf"] 178.710 μs (5%) 73.98 KiB (1%) 3861
["missing_dot", "xf_nota"] 175.710 μs (5%) 73.98 KiB (1%) 3860
["partition_by", "man"] 1.656 ms (5%) 352 bytes (1%) 4
["partition_by", "xf"] 1.570 ms (5%) 576 bytes (1%) 7

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["cat"]
  • ["collect"]
  • ["dot"]
  • ["filter_map_map!"]
  • ["filter_map_reduce"]
  • ["findall"]
  • ["gemm", "fusedmul", "blas"]
  • ["gemm", "fusedmul", "xf"]
  • ["gemm", "mul", "linalg"]
  • ["gemm", "mul", "man", "false"]
  • ["gemm", "mul", "man", "ivdep"]
  • ["gemm", "mul", "man", "true"]
  • ["gemm", "mul", "xf", "false"]
  • ["gemm", "mul", "xf", "ivdep"]
  • ["gemm", "mul", "xf", "true"]
  • ["missing_argmax"]
  • ["missing_dot"]
  • ["partition_by"]

Julia versioninfo

Julia Version 1.3.1
Commit 2d5741174c (2019-12-30 21:36 UTC)
Platform Info:
  OS: Linux (x86_64-pc-linux-gnu)
      Ubuntu 18.04.4 LTS
  uname: Linux 5.0.0-1032-azure #34-Ubuntu SMP Mon Feb 10 19:37:25 UTC 2020 x86_64 x86_64
  CPU: Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz: 
              speed         user         nice          sys         idle          irq
       #1  2095 MHz      27445 s          0 s       1183 s      45716 s          0 s
       #2  2095 MHz      44674 s          0 s       1400 s      28544 s          0 s
       
  Memory: 6.782737731933594 GB (3456.84765625 MB free)
  Uptime: 762.0 sec
  Load Avg:  1.046875  0.99072265625  0.64453125
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-6.0.1 (ORCJIT, skylake)

Runtime information

Runtime Info
BLAS #threads 2
BLAS.vendor() openblas64
Sys.CPU_THREADS 2

lscpu output:

Architecture:        x86_64
CPU op-mode(s):      32-bit, 64-bit
Byte Order:          Little Endian
CPU(s):              2
On-line CPU(s) list: 0,1
Thread(s) per core:  1
Core(s) per socket:  2
Socket(s):           1
NUMA node(s):        1
Vendor ID:           GenuineIntel
CPU family:          6
Model:               85
Model name:          Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz
Stepping:            4
CPU MHz:             2095.195
BogoMIPS:            4190.39
Hypervisor vendor:   Microsoft
Virtualization type: full
L1d cache:           32K
L1i cache:           32K
L2 cache:            1024K
L3 cache:            36608K
NUMA node0 CPU(s):   0,1
Flags:               fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology cpuid pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch invpcid_single pti fsgsbase bmi1 hle avx2 smep bmi2 erms invpcid rtm mpx avx512f avx512dq rdseed adx smap clflushopt avx512cd avx512bw avx512vl xsaveopt xsavec xsaves
Cpu Property Value
Brand Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz
Vendor :Intel
Architecture :Skylake
Model Family: 0x06, Model: 0x55, Stepping: 0x04, Type: 0x00
Cores 2 physical cores, 2 logical cores (on executing CPU)
No Hyperthreading detected
Clock Frequencies Not supported by CPU
Data Cache Level 1:3 : (32, 1024, 36608) kbytes
64 byte cache line size
Address Size 48 bits virtual, 44 bits physical
SIMD 512 bit = 64 byte max. SIMD vector size
Time Stamp Counter TSC is accessible via rdtsc
TSC increased at every clock cycle (non-invariant TSC)
Perf. Monitoring Performance Monitoring Counters (PMC) are not supported
Hypervisor Yes, Microsoft

@github-actions
Copy link
Contributor

github-actions bot commented Mar 5, 2020

Multi-thread benchmark result

Judge result

Benchmark Report for /home/runner/work/Transducers.jl/Transducers.jl

Job Properties

  • Time of benchmarks:
    • Target: 5 Mar 2020 - 07:17
    • Baseline: 5 Mar 2020 - 07:22
  • Package commits:
    • Target: 747582
    • Baseline: f62c6a
  • Julia commits:
    • Target: 2d5741
    • Baseline: 2d5741
  • Julia command flags:
    • Target: None
    • Baseline: None
  • Environment variables:
    • Target: JULIA_NUM_THREADS => 2
    • Baseline: JULIA_NUM_THREADS => 2

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).

ID time ratio memory ratio
["collect", "seq"] 1.08 (5%) ❌ 1.00 (1%)
["collect", "unordered", "basesize=1024"] 1.02 (5%) 1.08 (1%) ❌
["findfirst", "n=1000", "reduce", "basesize=128"] 0.92 (5%) ✅ 0.92 (1%) ✅
["findfirst", "n=1000", "reduce", "basesize=256"] 0.88 (5%) ✅ 0.92 (1%) ✅
["findfirst", "n=1000", "reduce", "basesize=512"] 0.83 (5%) ✅ 0.91 (1%) ✅
["findfirst", "n=400", "reduce", "basesize=128"] 1.04 (5%) 1.07 (1%) ❌
["findfirst", "n=400", "reduce", "basesize=512"] 0.96 (5%) 0.96 (1%) ✅
["findfirst", "n=500", "reduce", "basesize=128"] 1.13 (5%) ❌ 1.23 (1%) ❌
["findfirst", "n=500", "reduce", "basesize=256"] 0.76 (5%) ✅ 0.82 (1%) ✅
["findfirst", "n=500", "reduce", "basesize=512"] 1.08 (5%) ❌ 0.92 (1%) ✅
["parallel_histogram", "assoc", "basesize=4096"] 0.98 (5%) 0.87 (1%) ✅
["parallel_histogram", "comm", "basesize=4096"] 1.10 (5%) ❌ 1.00 (1%)
["parallel_histogram", "comm", "basesize=8192"] 1.02 (5%) 1.01 (1%) ❌
["parallel_histogram", "seq"] 0.95 (5%) ✅ 1.00 (1%)
["sum", "random", "reduce", "basesize=128"] 1.06 (5%) ❌ 1.00 (1%)
["sum", "valley", "reduce", "basesize=128"] 1.12 (5%) ❌ 1.00 (1%)
["sum", "valley", "reduce", "basesize=256"] 1.19 (5%) ❌ 1.00 (1%)
["words", "nthreads=1"] 0.94 (5%) ✅ 1.00 (1%)

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["collect", "assoc"]
  • ["collect"]
  • ["collect", "unordered"]
  • ["findfirst", "n=1000"]
  • ["findfirst", "n=1000", "reduce"]
  • ["findfirst", "n=400"]
  • ["findfirst", "n=400", "reduce"]
  • ["findfirst", "n=500"]
  • ["findfirst", "n=500", "reduce"]
  • ["overhead"]
  • ["parallel_histogram", "assoc"]
  • ["parallel_histogram", "comm"]
  • ["parallel_histogram"]
  • ["sum", "random"]
  • ["sum", "random", "reduce"]
  • ["sum", "uniform"]
  • ["sum", "uniform", "reduce"]
  • ["sum", "valley"]
  • ["sum", "valley", "reduce"]
  • ["words"]

Julia versioninfo

Target

Julia Version 1.3.1
Commit 2d5741174c (2019-12-30 21:36 UTC)
Platform Info:
  OS: Linux (x86_64-pc-linux-gnu)
      Ubuntu 18.04.4 LTS
  uname: Linux 5.0.0-1032-azure #34-Ubuntu SMP Mon Feb 10 19:37:25 UTC 2020 x86_64 x86_64
  CPU: Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz: 
              speed         user         nice          sys         idle          irq
       #1  2095 MHz      49531 s          0 s       1922 s      12986 s          0 s
       #2  2095 MHz      44287 s          0 s       1860 s      18530 s          0 s
       
  Memory: 6.782737731933594 GB (3534.9609375 MB free)
  Uptime: 662.0 sec
  Load Avg:  1.73681640625  1.52392578125  0.8818359375
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-6.0.1 (ORCJIT, skylake)

Baseline

Julia Version 1.3.1
Commit 2d5741174c (2019-12-30 21:36 UTC)
Platform Info:
  OS: Linux (x86_64-pc-linux-gnu)
      Ubuntu 18.04.4 LTS
  uname: Linux 5.0.0-1032-azure #34-Ubuntu SMP Mon Feb 10 19:37:25 UTC 2020 x86_64 x86_64
  CPU: Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz: 
              speed         user         nice          sys         idle          irq
       #1  2095 MHz      73225 s          0 s       2360 s      16599 s          0 s
       #2  2095 MHz      63830 s          0 s       2331 s      26379 s          0 s
       
  Memory: 6.782737731933594 GB (3579.28125 MB free)
  Uptime: 942.0 sec
  Load Avg:  1.6416015625  1.58349609375  1.07958984375
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-6.0.1 (ORCJIT, skylake)

Target result

Benchmark Report for /home/runner/work/Transducers.jl/Transducers.jl

Job Properties

  • Time of benchmark: 5 Mar 2020 - 7:17
  • Package commit: 747582
  • Julia commit: 2d5741
  • Julia command flags: None
  • Environment variables: JULIA_NUM_THREADS => 2

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["collect", "assoc", "basesize=1"] 383.408 ms (5%) 12.543 ms 91.55 MiB (1%) 1754696
["collect", "assoc", "basesize=1024"] 255.109 ms (5%) 1.84 MiB (1%) 1967
["collect", "assoc", "basesize=32"] 246.364 ms (5%) 5.77 MiB (1%) 59138
["collect", "seq"] 506.649 ms (5%) 513.00 KiB (1%) 23
["collect", "unordered", "basesize=1"] 467.638 ms (5%) 7.415 ms 30.23 MiB (1%) 473614
["collect", "unordered", "basesize=1024"] 310.593 ms (5%) 834.38 KiB (1%) 6515
["collect", "unordered", "basesize=32"] 275.135 ms (5%) 1.51 MiB (1%) 19312
["findfirst", "n=1000", "foldl"] 686.697 ms (5%)
["findfirst", "n=1000", "reduce", "basesize=128"] 737.116 ms (5%) 1.33 MiB (1%) 26619
["findfirst", "n=1000", "reduce", "basesize=256"] 435.695 ms (5%) 494.11 KiB (1%) 9633
["findfirst", "n=1000", "reduce", "basesize=512"] 613.246 ms (5%) 352.69 KiB (1%) 6877
["findfirst", "n=400", "foldl"] 506.398 ms (5%)
["findfirst", "n=400", "reduce", "basesize=128"] 293.349 ms (5%) 1.28 MiB (1%) 25673
["findfirst", "n=400", "reduce", "basesize=256"] 285.110 ms (5%) 663.22 KiB (1%) 13064
["findfirst", "n=400", "reduce", "basesize=512"] 305.720 ms (5%) 404.58 KiB (1%) 7943
["findfirst", "n=500", "foldl"] 84.870 ms (5%)
["findfirst", "n=500", "reduce", "basesize=128"] 161.785 ms (5%) 737.53 KiB (1%) 14309
["findfirst", "n=500", "reduce", "basesize=256"] 133.937 ms (5%) 382.11 KiB (1%) 7357
["findfirst", "n=500", "reduce", "basesize=512"] 161.766 ms (5%) 212.52 KiB (1%) 4126
["overhead", "n=64"] 166.608 μs (5%) 155.14 KiB (1%) 3009
["parallel_histogram", "assoc", "basesize=16384"] 3.934 ms (5%) 732.22 KiB (1%) 109
["parallel_histogram", "assoc", "basesize=4096"] 4.637 ms (5%) 1.80 MiB (1%) 539
["parallel_histogram", "assoc", "basesize=8192"] 4.226 ms (5%) 1.43 MiB (1%) 260
["parallel_histogram", "comm", "basesize=16384"] 15.061 ms (5%) 1.22 MiB (1%) 169
["parallel_histogram", "comm", "basesize=4096"] 24.618 ms (5%) 1.06 MiB (1%) 6082
["parallel_histogram", "comm", "basesize=8192"] 21.804 ms (5%) 1.28 MiB (1%) 4229
["parallel_histogram", "seq"] 7.295 ms (5%) 364.63 KiB (1%) 25
["sum", "random", "foldl"] 15.144 ms (5%)
["sum", "random", "reduce", "basesize=128"] 8.164 ms (5%) 331.41 KiB (1%) 6836
["sum", "random", "reduce", "basesize=256"] 7.819 ms (5%) 164.13 KiB (1%) 3394
["sum", "random", "reduce", "basesize=512"] 7.824 ms (5%) 80.80 KiB (1%) 1677
["sum", "uniform", "foldl"] 14.766 ms (5%)
["sum", "uniform", "reduce", "basesize=128"] 7.265 ms (5%) 331.39 KiB (1%) 6835
["sum", "uniform", "reduce", "basesize=256"] 7.252 ms (5%) 164.13 KiB (1%) 3394
["sum", "uniform", "reduce", "basesize=512"] 7.281 ms (5%) 80.75 KiB (1%) 1674
["sum", "valley", "foldl"] 15.811 ms (5%)
["sum", "valley", "reduce", "basesize=128"] 9.100 ms (5%) 331.30 KiB (1%) 6829
["sum", "valley", "reduce", "basesize=256"] 8.990 ms (5%) 164.11 KiB (1%) 3393
["sum", "valley", "reduce", "basesize=512"] 7.784 ms (5%) 80.75 KiB (1%) 1674
["words", "nthreads=1"] 34.088 ms (5%) 6.432 ms 64.77 MiB (1%) 2096283
["words", "nthreads=2"] 19.220 ms (5%) 65.13 MiB (1%) 2096366
["words", "nthreads=4"] 20.441 ms (5%) 65.85 MiB (1%) 2096533

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["collect", "assoc"]
  • ["collect"]
  • ["collect", "unordered"]
  • ["findfirst", "n=1000"]
  • ["findfirst", "n=1000", "reduce"]
  • ["findfirst", "n=400"]
  • ["findfirst", "n=400", "reduce"]
  • ["findfirst", "n=500"]
  • ["findfirst", "n=500", "reduce"]
  • ["overhead"]
  • ["parallel_histogram", "assoc"]
  • ["parallel_histogram", "comm"]
  • ["parallel_histogram"]
  • ["sum", "random"]
  • ["sum", "random", "reduce"]
  • ["sum", "uniform"]
  • ["sum", "uniform", "reduce"]
  • ["sum", "valley"]
  • ["sum", "valley", "reduce"]
  • ["words"]

Julia versioninfo

Julia Version 1.3.1
Commit 2d5741174c (2019-12-30 21:36 UTC)
Platform Info:
  OS: Linux (x86_64-pc-linux-gnu)
      Ubuntu 18.04.4 LTS
  uname: Linux 5.0.0-1032-azure #34-Ubuntu SMP Mon Feb 10 19:37:25 UTC 2020 x86_64 x86_64
  CPU: Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz: 
              speed         user         nice          sys         idle          irq
       #1  2095 MHz      49531 s          0 s       1922 s      12986 s          0 s
       #2  2095 MHz      44287 s          0 s       1860 s      18530 s          0 s
       
  Memory: 6.782737731933594 GB (3534.9609375 MB free)
  Uptime: 662.0 sec
  Load Avg:  1.73681640625  1.52392578125  0.8818359375
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-6.0.1 (ORCJIT, skylake)

Baseline result

Benchmark Report for /home/runner/work/Transducers.jl/Transducers.jl

Job Properties

  • Time of benchmark: 5 Mar 2020 - 7:22
  • Package commit: f62c6a
  • Julia commit: 2d5741
  • Julia command flags: None
  • Environment variables: JULIA_NUM_THREADS => 2

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["collect", "assoc", "basesize=1"] 377.007 ms (5%) 10.439 ms 91.55 MiB (1%) 1754685
["collect", "assoc", "basesize=1024"] 243.520 ms (5%) 1.84 MiB (1%) 1967
["collect", "assoc", "basesize=32"] 249.410 ms (5%) 5.77 MiB (1%) 59123
["collect", "seq"] 469.142 ms (5%) 513.00 KiB (1%) 23
["collect", "unordered", "basesize=1"] 489.573 ms (5%) 30.25 MiB (1%) 475016
["collect", "unordered", "basesize=1024"] 303.090 ms (5%) 772.50 KiB (1%) 2555
["collect", "unordered", "basesize=32"] 270.227 ms (5%) 1.51 MiB (1%) 19438
["findfirst", "n=1000", "foldl"] 670.925 ms (5%)
["findfirst", "n=1000", "reduce", "basesize=128"] 798.240 ms (5%) 1.45 MiB (1%) 28967
["findfirst", "n=1000", "reduce", "basesize=256"] 493.043 ms (5%) 535.08 KiB (1%) 10437
["findfirst", "n=1000", "reduce", "basesize=512"] 735.907 ms (5%) 388.69 KiB (1%) 7596
["findfirst", "n=400", "foldl"] 504.329 ms (5%)
["findfirst", "n=400", "reduce", "basesize=128"] 281.090 ms (5%) 1.19 MiB (1%) 24019
["findfirst", "n=400", "reduce", "basesize=256"] 282.823 ms (5%) 657.95 KiB (1%) 12955
["findfirst", "n=400", "reduce", "basesize=512"] 318.022 ms (5%) 422.28 KiB (1%) 8284
["findfirst", "n=500", "foldl"] 82.851 ms (5%)
["findfirst", "n=500", "reduce", "basesize=128"] 143.684 ms (5%) 597.31 KiB (1%) 11596
["findfirst", "n=500", "reduce", "basesize=256"] 175.394 ms (5%) 463.95 KiB (1%) 8954
["findfirst", "n=500", "reduce", "basesize=512"] 149.241 ms (5%) 232.09 KiB (1%) 4472
["overhead", "n=64"] 162.805 μs (5%) 155.11 KiB (1%) 3007
["parallel_histogram", "assoc", "basesize=16384"] 3.930 ms (5%) 732.22 KiB (1%) 109
["parallel_histogram", "assoc", "basesize=4096"] 4.719 ms (5%) 2.07 MiB (1%) 545
["parallel_histogram", "assoc", "basesize=8192"] 4.183 ms (5%) 1.43 MiB (1%) 260
["parallel_histogram", "comm", "basesize=16384"] 14.947 ms (5%) 1.22 MiB (1%) 334
["parallel_histogram", "comm", "basesize=4096"] 22.418 ms (5%) 1.06 MiB (1%) 6025
["parallel_histogram", "comm", "basesize=8192"] 21.292 ms (5%) 1.27 MiB (1%) 3240
["parallel_histogram", "seq"] 7.692 ms (5%) 364.63 KiB (1%) 25
["sum", "random", "foldl"] 15.182 ms (5%)
["sum", "random", "reduce", "basesize=128"] 7.676 ms (5%) 331.42 KiB (1%) 6837
["sum", "random", "reduce", "basesize=256"] 7.531 ms (5%) 164.08 KiB (1%) 3391
["sum", "random", "reduce", "basesize=512"] 7.579 ms (5%) 80.73 KiB (1%) 1673
["sum", "uniform", "foldl"] 15.074 ms (5%)
["sum", "uniform", "reduce", "basesize=128"] 7.170 ms (5%) 331.42 KiB (1%) 6837
["sum", "uniform", "reduce", "basesize=256"] 7.236 ms (5%) 164.13 KiB (1%) 3394
["sum", "uniform", "reduce", "basesize=512"] 7.299 ms (5%) 80.73 KiB (1%) 1673
["sum", "valley", "foldl"] 15.468 ms (5%)
["sum", "valley", "reduce", "basesize=128"] 8.127 ms (5%) 331.25 KiB (1%) 6826
["sum", "valley", "reduce", "basesize=256"] 7.580 ms (5%) 164.09 KiB (1%) 3392
["sum", "valley", "reduce", "basesize=512"] 7.561 ms (5%) 80.77 KiB (1%) 1675
["words", "nthreads=1"] 36.372 ms (5%) 5.923 ms 64.70 MiB (1%) 2094032
["words", "nthreads=2"] 18.705 ms (5%) 65.42 MiB (1%) 2094197
["words", "nthreads=4"] 19.678 ms (5%) 66.05 MiB (1%) 2094511

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["collect", "assoc"]
  • ["collect"]
  • ["collect", "unordered"]
  • ["findfirst", "n=1000"]
  • ["findfirst", "n=1000", "reduce"]
  • ["findfirst", "n=400"]
  • ["findfirst", "n=400", "reduce"]
  • ["findfirst", "n=500"]
  • ["findfirst", "n=500", "reduce"]
  • ["overhead"]
  • ["parallel_histogram", "assoc"]
  • ["parallel_histogram", "comm"]
  • ["parallel_histogram"]
  • ["sum", "random"]
  • ["sum", "random", "reduce"]
  • ["sum", "uniform"]
  • ["sum", "uniform", "reduce"]
  • ["sum", "valley"]
  • ["sum", "valley", "reduce"]
  • ["words"]

Julia versioninfo

Julia Version 1.3.1
Commit 2d5741174c (2019-12-30 21:36 UTC)
Platform Info:
  OS: Linux (x86_64-pc-linux-gnu)
      Ubuntu 18.04.4 LTS
  uname: Linux 5.0.0-1032-azure #34-Ubuntu SMP Mon Feb 10 19:37:25 UTC 2020 x86_64 x86_64
  CPU: Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz: 
              speed         user         nice          sys         idle          irq
       #1  2095 MHz      73225 s          0 s       2360 s      16599 s          0 s
       #2  2095 MHz      63830 s          0 s       2331 s      26379 s          0 s
       
  Memory: 6.782737731933594 GB (3579.28125 MB free)
  Uptime: 942.0 sec
  Load Avg:  1.6416015625  1.58349609375  1.07958984375
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-6.0.1 (ORCJIT, skylake)

Runtime information

Runtime Info
BLAS #threads 2
BLAS.vendor() openblas64
Sys.CPU_THREADS 2

lscpu output:

Architecture:        x86_64
CPU op-mode(s):      32-bit, 64-bit
Byte Order:          Little Endian
CPU(s):              2
On-line CPU(s) list: 0,1
Thread(s) per core:  1
Core(s) per socket:  2
Socket(s):           1
NUMA node(s):        1
Vendor ID:           GenuineIntel
CPU family:          6
Model:               85
Model name:          Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz
Stepping:            4
CPU MHz:             2095.192
BogoMIPS:            4190.38
Hypervisor vendor:   Microsoft
Virtualization type: full
L1d cache:           32K
L1i cache:           32K
L2 cache:            1024K
L3 cache:            36608K
NUMA node0 CPU(s):   0,1
Flags:               fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology cpuid pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch invpcid_single pti fsgsbase bmi1 hle avx2 smep bmi2 erms invpcid rtm mpx avx512f avx512dq rdseed adx smap clflushopt avx512cd avx512bw avx512vl xsaveopt xsavec xsaves
Cpu Property Value
Brand Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz
Vendor :Intel
Architecture :Skylake
Model Family: 0x06, Model: 0x55, Stepping: 0x04, Type: 0x00
Cores 2 physical cores, 2 logical cores (on executing CPU)
No Hyperthreading detected
Clock Frequencies Not supported by CPU
Data Cache Level 1:3 : (32, 1024, 36608) kbytes
64 byte cache line size
Address Size 48 bits virtual, 44 bits physical
SIMD 512 bit = 64 byte max. SIMD vector size
Time Stamp Counter TSC is accessible via rdtsc
TSC increased at every clock cycle (non-invariant TSC)
Perf. Monitoring Performance Monitoring Counters (PMC) are not supported
Hypervisor Yes, Microsoft

@codecov-commenter
Copy link

codecov-commenter commented May 20, 2020

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 94.36%. Comparing base (2a51f8d) to head (af6a4bf).

❗ Current head af6a4bf differs from pull request most recent head 5202959. Consider uploading reports for the commit 5202959 to get more accurate results

Additional details and impacted files
@@            Coverage Diff             @@
##           master     #243      +/-   ##
==========================================
- Coverage   94.61%   94.36%   -0.26%     
==========================================
  Files          32       32              
  Lines        2267     2255      -12     
==========================================
- Hits         2145     2128      -17     
- Misses        122      127       +5     
Flag Coverage Δ
Run.test 94.36% <ø> (-0.26%) ⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

4 participants