VSCode integration #227

aviatesk · 2021-07-31T09:39:58Z

/cc @pfitzseb feel free to push changes as you need

pfitzseb · 2021-07-31T11:28:07Z

aviatesk · 2021-07-31T16:15:43Z

codecov-commenter · 2021-08-01T10:02:39Z

Codecov Report

Merging #227 (33730a9) into master (1ab416e) will decrease coverage by 0.37%.
The diff coverage is 57.89%.

@@            Coverage Diff             @@
##           master     #227      +/-   ##
==========================================
- Coverage   87.53%   87.16%   -0.38%     
==========================================
  Files           9       10       +1     
  Lines        2014     2049      +35     
==========================================
+ Hits         1763     1786      +23     
- Misses        251      263      +12

Impacted Files	Coverage Δ
src/JET.jl	`67.31% <ø> (+0.81%)`	⬆️
src/ui/vscode.jl	`50.00% <50.00%> (ø)`
src/analyzers/optanalyzer.jl	`87.05% <75.00%> (-1.04%)`	⬇️
src/analyzers/jetanalyzer.jl	`92.93% <100.00%> (ø)`
src/toplevel/virtualprocess.jl	`96.82% <0.00%> (+0.02%)`	⬆️
src/ui/print.jl	`90.00% <0.00%> (+0.90%)`	⬆️

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 1ab416e...33730a9. Read the comment docs.

aviatesk · 2021-08-02T10:00:02Z

src/watch.jl

-                included_files′, _ = report_file(io, filename; jetconfigs...)
-                if any(∉(included_files), included_files′)
+                res = report_file(filename; jetconfigs...)
+                display(res)


@pfitzseb do think this display call is reasonable ? In watch mode, we don't return each result of report_file to REPL.

Hm, seems like it could be a bit annoying in the REPL?

Well, the watch mode prints analysis result on every update, so the behavior is same as far as display(res) prints into stdout (I think it's really silly to print everything everytime, though)

github-actions · 2021-08-08T18:03:43Z

JET Benchmark Result

Judge result

Benchmark Report for /home/runner/work/JET.jl/JET.jl

Job Properties

Time of benchmarks:

Target: 8 Aug 2021 - 17:47
Baseline: 8 Aug 2021 - 18:03

Package commits:

Target: 2a87f8
Baseline: f31ff9

Julia commits:

Target: 08fae5
Baseline: 08fae5

Julia command flags:

Target: None
Baseline: None

Environment variables:

Target: None
Baseline: None

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).

ID	time ratio	memory ratio

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

[]

Julia versioninfo

Target

Julia Version 1.8.0-DEV.316
Commit 08fae511b9 (2021-08-08 00:55 UTC)
Platform Info:
 OS: Linux (x86_64-pc-linux-gnu)
 Ubuntu 20.04.2 LTS
 uname: Linux 5.8.0-1039-azure #42~20.04.1-Ubuntu SMP Thu Jul 15 14:11:07 UTC 2021 x86_64 x86_64
 CPU: Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz: 
 speed user nice sys idle irq
 #1 2095 MHz 5637 s 1 s 349 s 6834 s 0 s
 #2 2095 MHz 5538 s 1 s 353 s 6955 s 0 s
 
 Memory: 6.790924072265625 GB (3672.83203125 MB free)
 Uptime: 1290.55 sec
 Load Avg: 1.1 1.05 0.81
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-12.0.1 (ORCJIT, skylake-avx512)

Baseline

Julia Version 1.8.0-DEV.316
Commit 08fae511b9 (2021-08-08 00:55 UTC)
Platform Info:
 OS: Linux (x86_64-pc-linux-gnu)
 Ubuntu 20.04.2 LTS
 uname: Linux 5.8.0-1039-azure #42~20.04.1-Ubuntu SMP Thu Jul 15 14:11:07 UTC 2021 x86_64 x86_64
 CPU: Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz: 
 speed user nice sys idle irq
 #1 2095 MHz 10390 s 1 s 578 s 11422 s 0 s
 #2 2095 MHz 10548 s 1 s 581 s 11295 s 0 s
 
 Memory: 6.790924072265625 GB (3638.0546875 MB free)
 Uptime: 2249.5 sec
 Load Avg: 1.0 1.03 1.0
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-12.0.1 (ORCJIT, skylake-avx512)

Target result

Benchmark Report for /home/runner/work/JET.jl/JET.jl

Job Properties

Time of benchmark: 8 Aug 2021 - 17:47
Package commit: 2a87f8
Julia commit: 08fae5
Julia command flags: None
Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID	time	memory	allocations
`["a bit complex"]`	5.142 s (5%)	728 bytes (1%)	19
`["cached easy"]`	9.041 ms (5%)	728 bytes (1%)	19
`["easy"]`	1.278 s (5%)	728 bytes (1%)	19
`["end to end"]`	13.620 s (5%)	146.26 KiB (1%)	243
`["first time"]`	5.611 s (5%)	920 bytes (1%)	20
`["invalidation"]`	6.073 s (5%)	1.10 KiB (1%)	31
`["package loading"]`	359.524 ms (5%)	648 bytes (1%)	19
`["top-level first time"]`	9.355 s (5%)	1.66 KiB (1%)	20
`["top-level"]`	7.422 s (5%)	1.06 KiB (1%)	19

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

[]

Julia versioninfo

Julia Version 1.8.0-DEV.316
Commit 08fae511b9 (2021-08-08 00:55 UTC)
Platform Info:
 OS: Linux (x86_64-pc-linux-gnu)
 Ubuntu 20.04.2 LTS
 uname: Linux 5.8.0-1039-azure #42~20.04.1-Ubuntu SMP Thu Jul 15 14:11:07 UTC 2021 x86_64 x86_64
 CPU: Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz: 
 speed user nice sys idle irq
 #1 2095 MHz 5637 s 1 s 349 s 6834 s 0 s
 #2 2095 MHz 5538 s 1 s 353 s 6955 s 0 s
 
 Memory: 6.790924072265625 GB (3672.83203125 MB free)
 Uptime: 1290.55 sec
 Load Avg: 1.1 1.05 0.81
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-12.0.1 (ORCJIT, skylake-avx512)

Baseline result

Benchmark Report for /home/runner/work/JET.jl/JET.jl

Job Properties

Time of benchmark: 8 Aug 2021 - 18:3
Package commit: f31ff9
Julia commit: 08fae5
Julia command flags: None
Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID	time	memory	allocations
`["a bit complex"]`	5.152 s (5%)	728 bytes (1%)	19
`["cached easy"]`	8.933 ms (5%)	728 bytes (1%)	19
`["easy"]`	1.255 s (5%)	728 bytes (1%)	19
`["end to end"]`	13.552 s (5%)	146.40 KiB (1%)	251
`["first time"]`	5.635 s (5%)	920 bytes (1%)	20
`["invalidation"]`	5.839 s (5%)	1.10 KiB (1%)	31
`["package loading"]`	357.881 ms (5%)	648 bytes (1%)	19
`["top-level first time"]`	9.239 s (5%)	1.66 KiB (1%)	20
`["top-level"]`	7.289 s (5%)	1.06 KiB (1%)	19

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

[]

Julia versioninfo

Julia Version 1.8.0-DEV.316
Commit 08fae511b9 (2021-08-08 00:55 UTC)
Platform Info:
 OS: Linux (x86_64-pc-linux-gnu)
 Ubuntu 20.04.2 LTS
 uname: Linux 5.8.0-1039-azure #42~20.04.1-Ubuntu SMP Thu Jul 15 14:11:07 UTC 2021 x86_64 x86_64
 CPU: Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz: 
 speed user nice sys idle irq
 #1 2095 MHz 10390 s 1 s 578 s 11422 s 0 s
 #2 2095 MHz 10548 s 1 s 581 s 11295 s 0 s
 
 Memory: 6.790924072265625 GB (3638.0546875 MB free)
 Uptime: 2249.5 sec
 Load Avg: 1.0 1.03 1.0
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-12.0.1 (ORCJIT, skylake-avx512)

Runtime information

Runtime Info
BLAS #threads	2
`BLAS.vendor()`	`openblas64`
`Sys.CPU_THREADS`	2

lscpu output:

Architecture: x86_64
CPU op-mode(s): 32-bit, 64-bit
Byte Order: Little Endian
Address sizes: 46 bits physical, 48 bits virtual
CPU(s): 2
On-line CPU(s) list: 0,1
Thread(s) per core: 1
Core(s) per socket: 2
Socket(s): 1
NUMA node(s): 1
Vendor ID: GenuineIntel
CPU family: 6
Model: 85
Model name: Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz
Stepping: 4
CPU MHz: 2095.199
BogoMIPS: 4190.39
Hypervisor vendor: Microsoft
Virtualization type: full
L1d cache: 64 KiB
L1i cache: 64 KiB
L2 cache: 2 MiB
L3 cache: 35.8 MiB
NUMA node0 CPU(s): 0,1
Vulnerability Itlb multihit: KVM: Mitigation: VMX unsupported
Vulnerability L1tf: Mitigation; PTE Inversion
Vulnerability Mds: Mitigation; Clear CPU buffers; SMT Host state unknown
Vulnerability Meltdown: Mitigation; PTI
Vulnerability Spec store bypass: Vulnerable
Vulnerability Spectre v1: Mitigation; usercopy/swapgs barriers and __user pointer sanitization
Vulnerability Spectre v2: Mitigation; Full generic retpoline, STIBP disabled, RSB filling
Vulnerability Srbds: Not affected
Vulnerability Tsx async abort: Mitigation; Clear CPU buffers; SMT Host state unknown
Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology cpuid pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch invpcid_single pti fsgsbase bmi1 hle avx2 smep bmi2 erms invpcid rtm mpx avx512f avx512dq rdseed adx smap clflushopt avx512cd avx512bw avx512vl xsaveopt xsavec xsaves md_clear

Cpu Property	Value
Brand	Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz
Vendor	:Intel
Architecture	:Skylake
Model	Family: 0x06, Model: 0x55, Stepping: 0x04, Type: 0x00
Cores	2 physical cores, 2 logical cores (on executing CPU)
	No Hyperthreading hardware capability detected
Clock Frequencies	Not supported by CPU
Data Cache	Level 1:3 : (32, 1024, 36608) kbytes
	64 byte cache line size
Address Size	48 bits virtual, 46 bits physical
SIMD	512 bit = 64 byte max. SIMD vector size
Time Stamp Counter	TSC is accessible via `rdtsc`
	TSC increased at every clock cycle (non-invariant TSC)
Perf. Monitoring	Performance Monitoring Counters (PMC) are not supported
Hypervisor	Yes, Microsoft

JET Benchmark Result

Judge result

Benchmark Report for /home/runner/work/JET.jl/JET.jl

Job Properties

Time of benchmarks:

Target: 13 Aug 2021 - 07:33
Baseline: 13 Aug 2021 - 07:49

Package commits:

Target: 6803a4
Baseline: f77e53

Julia commits:

Target: f19b9a
Baseline: f19b9a

Julia command flags:

Target: None
Baseline: None

Environment variables:

Target: None
Baseline: None

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).

ID	time ratio	memory ratio
`["end to end"]`	1.02 (5%)	0.07 (1%) ✅

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

[]

Julia versioninfo

Target

Julia Version 1.8.0-DEV.342
Commit f19b9a20dd (2021-08-12 19:36 UTC)
Platform Info:
 OS: Linux (x86_64-pc-linux-gnu)
 Ubuntu 20.04.2 LTS
 uname: Linux 5.8.0-1039-azure #42~20.04.1-Ubuntu SMP Thu Jul 15 14:11:07 UTC 2021 x86_64 x86_64
 CPU: Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz: 
 speed user nice sys idle irq
 #1 2593 MHz 5465 s 1 s 335 s 5164 s 0 s
 #2 2593 MHz 5495 s 1 s 322 s 5179 s 0 s
 
 Memory: 6.790924072265625 GB (3558.484375 MB free)
 Uptime: 1103.84 sec
 Load Avg: 1.02 1.05 0.82
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-12.0.1 (ORCJIT, skylake-avx512)

Baseline

Julia Version 1.8.0-DEV.342
Commit f19b9a20dd (2021-08-12 19:36 UTC)
Platform Info:
 OS: Linux (x86_64-pc-linux-gnu)
 Ubuntu 20.04.2 LTS
 uname: Linux 5.8.0-1039-azure #42~20.04.1-Ubuntu SMP Thu Jul 15 14:11:07 UTC 2021 x86_64 x86_64
 CPU: Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz: 
 speed user nice sys idle irq
 #1 2593 MHz 10262 s 1 s 575 s 9884 s 0 s
 #2 2593 MHz 10625 s 1 s 568 s 9560 s 0 s
 
 Memory: 6.790924072265625 GB (3364.8671875 MB free)
 Uptime: 2080.96 sec
 Load Avg: 1.0 1.06 1.0
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-12.0.1 (ORCJIT, skylake-avx512)

Target result

Benchmark Report for /home/runner/work/JET.jl/JET.jl

Job Properties

Time of benchmark: 13 Aug 2021 - 7:33
Package commit: 6803a4
Julia commit: f19b9a
Julia command flags: None
Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID	time	memory	allocations
`["a bit complex"]`	4.470 s (5%)	728 bytes (1%)	19
`["cached easy"]`	7.601 ms (5%)	728 bytes (1%)	19
`["easy"]`	1.088 s (5%)	728 bytes (1%)	19
`["end to end"]`	11.705 s (5%)	10.93 KiB (1%)	251
`["first time"]`	4.850 s (5%)	920 bytes (1%)	20
`["invalidation"]`	5.148 s (5%)	1.10 KiB (1%)	31
`["package loading"]`	311.841 ms (5%)	648 bytes (1%)	19
`["top-level first time"]`	7.840 s (5%)	1.66 KiB (1%)	20
`["top-level"]`	6.319 s (5%)	1.06 KiB (1%)	19

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

[]

Julia versioninfo

Julia Version 1.8.0-DEV.342
Commit f19b9a20dd (2021-08-12 19:36 UTC)
Platform Info:
 OS: Linux (x86_64-pc-linux-gnu)
 Ubuntu 20.04.2 LTS
 uname: Linux 5.8.0-1039-azure #42~20.04.1-Ubuntu SMP Thu Jul 15 14:11:07 UTC 2021 x86_64 x86_64
 CPU: Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz: 
 speed user nice sys idle irq
 #1 2593 MHz 5465 s 1 s 335 s 5164 s 0 s
 #2 2593 MHz 5495 s 1 s 322 s 5179 s 0 s
 
 Memory: 6.790924072265625 GB (3558.484375 MB free)
 Uptime: 1103.84 sec
 Load Avg: 1.02 1.05 0.82
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-12.0.1 (ORCJIT, skylake-avx512)

Baseline result

Benchmark Report for /home/runner/work/JET.jl/JET.jl

Job Properties

Time of benchmark: 13 Aug 2021 - 7:49
Package commit: f77e53
Julia commit: f19b9a
Julia command flags: None
Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID	time	memory	allocations
`["a bit complex"]`	4.497 s (5%)	728 bytes (1%)	19
`["cached easy"]`	7.536 ms (5%)	728 bytes (1%)	19
`["easy"]`	1.070 s (5%)	728 bytes (1%)	19
`["end to end"]`	11.482 s (5%)	146.59 KiB (1%)	262
`["first time"]`	4.835 s (5%)	920 bytes (1%)	20
`["invalidation"]`	5.013 s (5%)	1.10 KiB (1%)	31
`["package loading"]`	299.579 ms (5%)	648 bytes (1%)	19
`["top-level first time"]`	7.856 s (5%)	1.66 KiB (1%)	20
`["top-level"]`	6.201 s (5%)	1.06 KiB (1%)	19

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

[]

Julia versioninfo

Julia Version 1.8.0-DEV.342
Commit f19b9a20dd (2021-08-12 19:36 UTC)
Platform Info:
 OS: Linux (x86_64-pc-linux-gnu)
 Ubuntu 20.04.2 LTS
 uname: Linux 5.8.0-1039-azure #42~20.04.1-Ubuntu SMP Thu Jul 15 14:11:07 UTC 2021 x86_64 x86_64
 CPU: Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz: 
 speed user nice sys idle irq
 #1 2593 MHz 10262 s 1 s 575 s 9884 s 0 s
 #2 2593 MHz 10625 s 1 s 568 s 9560 s 0 s
 
 Memory: 6.790924072265625 GB (3364.8671875 MB free)
 Uptime: 2080.96 sec
 Load Avg: 1.0 1.06 1.0
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-12.0.1 (ORCJIT, skylake-avx512)

Runtime information

Runtime Info
BLAS #threads	2
`BLAS.vendor()`	`openblas64`
`Sys.CPU_THREADS`	2

lscpu output:

Architecture: x86_64
CPU op-mode(s): 32-bit, 64-bit
Byte Order: Little Endian
Address sizes: 46 bits physical, 48 bits virtual
CPU(s): 2
On-line CPU(s) list: 0,1
Thread(s) per core: 1
Core(s) per socket: 2
Socket(s): 1
NUMA node(s): 1
Vendor ID: GenuineIntel
CPU family: 6
Model: 85
Model name: Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Stepping: 7
CPU MHz: 2593.907
BogoMIPS: 5187.81
Hypervisor vendor: Microsoft
Virtualization type: full
L1d cache: 64 KiB
L1i cache: 64 KiB
L2 cache: 2 MiB
L3 cache: 35.8 MiB
NUMA node0 CPU(s): 0,1
Vulnerability Itlb multihit: KVM: Mitigation: VMX unsupported
Vulnerability L1tf: Mitigation; PTE Inversion
Vulnerability Mds: Mitigation; Clear CPU buffers; SMT Host state unknown
Vulnerability Meltdown: Mitigation; PTI
Vulnerability Spec store bypass: Vulnerable
Vulnerability Spectre v1: Mitigation; usercopy/swapgs barriers and __user pointer sanitization
Vulnerability Spectre v2: Mitigation; Full generic retpoline, STIBP disabled, RSB filling
Vulnerability Srbds: Not affected
Vulnerability Tsx async abort: Mitigation; Clear CPU buffers; SMT Host state unknown
Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology cpuid pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch invpcid_single pti fsgsbase bmi1 hle avx2 smep bmi2 erms invpcid rtm mpx avx512f avx512dq rdseed adx smap clflushopt avx512cd avx512bw avx512vl xsaveopt xsavec xsaves md_clear

Cpu Property	Value
Brand	Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Vendor	:Intel
Architecture	:Skylake
Model	Family: 0x06, Model: 0x55, Stepping: 0x07, Type: 0x00
Cores	2 physical cores, 2 logical cores (on executing CPU)
	No Hyperthreading hardware capability detected
Clock Frequencies	Not supported by CPU
Data Cache	Level 1:3 : (32, 1024, 36608) kbytes
	64 byte cache line size
Address Size	48 bits virtual, 46 bits physical
SIMD	512 bit = 64 byte max. SIMD vector size
Time Stamp Counter	TSC is accessible via `rdtsc`
	TSC increased at every clock cycle (non-invariant TSC)
Perf. Monitoring	Performance Monitoring Counters (PMC) are not supported
Hypervisor	Yes, Microsoft

JET Benchmark Result

Judge result

Benchmark Report for /home/runner/work/JET.jl/JET.jl

Job Properties

Time of benchmarks:

Target: 13 Aug 2021 - 07:33
Baseline: 13 Aug 2021 - 07:49

Package commits:

Target: 6803a4
Baseline: f77e53

Julia commits:

Target: f19b9a
Baseline: f19b9a

Julia command flags:

Target: None
Baseline: None

Environment variables:

Target: None
Baseline: None

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).

ID	time ratio	memory ratio
`["end to end"]`	1.02 (5%)	0.07 (1%) ✅

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

[]

Julia versioninfo

Target

Julia Version 1.8.0-DEV.342
Commit f19b9a20dd (2021-08-12 19:36 UTC)
Platform Info:
 OS: Linux (x86_64-pc-linux-gnu)
 Ubuntu 20.04.2 LTS
 uname: Linux 5.8.0-1039-azure #42~20.04.1-Ubuntu SMP Thu Jul 15 14:11:07 UTC 2021 x86_64 x86_64
 CPU: Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz: 
 speed user nice sys idle irq
 #1 2593 MHz 5465 s 1 s 335 s 5164 s 0 s
 #2 2593 MHz 5495 s 1 s 322 s 5179 s 0 s
 
 Memory: 6.790924072265625 GB (3558.484375 MB free)
 Uptime: 1103.84 sec
 Load Avg: 1.02 1.05 0.82
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-12.0.1 (ORCJIT, skylake-avx512)

Baseline

Julia Version 1.8.0-DEV.342
Commit f19b9a20dd (2021-08-12 19:36 UTC)
Platform Info:
 OS: Linux (x86_64-pc-linux-gnu)
 Ubuntu 20.04.2 LTS
 uname: Linux 5.8.0-1039-azure #42~20.04.1-Ubuntu SMP Thu Jul 15 14:11:07 UTC 2021 x86_64 x86_64
 CPU: Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz: 
 speed user nice sys idle irq
 #1 2593 MHz 10262 s 1 s 575 s 9884 s 0 s
 #2 2593 MHz 10625 s 1 s 568 s 9560 s 0 s
 
 Memory: 6.790924072265625 GB (3364.8671875 MB free)
 Uptime: 2080.96 sec
 Load Avg: 1.0 1.06 1.0
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-12.0.1 (ORCJIT, skylake-avx512)

Target result

Benchmark Report for /home/runner/work/JET.jl/JET.jl

Job Properties

Time of benchmark: 13 Aug 2021 - 7:33
Package commit: 6803a4
Julia commit: f19b9a
Julia command flags: None
Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID	time	memory	allocations
`["a bit complex"]`	4.470 s (5%)	728 bytes (1%)	19
`["cached easy"]`	7.601 ms (5%)	728 bytes (1%)	19
`["easy"]`	1.088 s (5%)	728 bytes (1%)	19
`["end to end"]`	11.705 s (5%)	10.93 KiB (1%)	251
`["first time"]`	4.850 s (5%)	920 bytes (1%)	20
`["invalidation"]`	5.148 s (5%)	1.10 KiB (1%)	31
`["package loading"]`	311.841 ms (5%)	648 bytes (1%)	19
`["top-level first time"]`	7.840 s (5%)	1.66 KiB (1%)	20
`["top-level"]`	6.319 s (5%)	1.06 KiB (1%)	19

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

[]

Julia versioninfo

Julia Version 1.8.0-DEV.342
Commit f19b9a20dd (2021-08-12 19:36 UTC)
Platform Info:
 OS: Linux (x86_64-pc-linux-gnu)
 Ubuntu 20.04.2 LTS
 uname: Linux 5.8.0-1039-azure #42~20.04.1-Ubuntu SMP Thu Jul 15 14:11:07 UTC 2021 x86_64 x86_64
 CPU: Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz: 
 speed user nice sys idle irq
 #1 2593 MHz 5465 s 1 s 335 s 5164 s 0 s
 #2 2593 MHz 5495 s 1 s 322 s 5179 s 0 s
 
 Memory: 6.790924072265625 GB (3558.484375 MB free)
 Uptime: 1103.84 sec
 Load Avg: 1.02 1.05 0.82
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-12.0.1 (ORCJIT, skylake-avx512)

Baseline result

Benchmark Report for /home/runner/work/JET.jl/JET.jl

Job Properties

Time of benchmark: 13 Aug 2021 - 7:49
Package commit: f77e53
Julia commit: f19b9a
Julia command flags: None
Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID	time	memory	allocations
`["a bit complex"]`	4.497 s (5%)	728 bytes (1%)	19
`["cached easy"]`	7.536 ms (5%)	728 bytes (1%)	19
`["easy"]`	1.070 s (5%)	728 bytes (1%)	19
`["end to end"]`	11.482 s (5%)	146.59 KiB (1%)	262
`["first time"]`	4.835 s (5%)	920 bytes (1%)	20
`["invalidation"]`	5.013 s (5%)	1.10 KiB (1%)	31
`["package loading"]`	299.579 ms (5%)	648 bytes (1%)	19
`["top-level first time"]`	7.856 s (5%)	1.66 KiB (1%)	20
`["top-level"]`	6.201 s (5%)	1.06 KiB (1%)	19

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

[]

Julia versioninfo

Julia Version 1.8.0-DEV.342
Commit f19b9a20dd (2021-08-12 19:36 UTC)
Platform Info:
 OS: Linux (x86_64-pc-linux-gnu)
 Ubuntu 20.04.2 LTS
 uname: Linux 5.8.0-1039-azure #42~20.04.1-Ubuntu SMP Thu Jul 15 14:11:07 UTC 2021 x86_64 x86_64
 CPU: Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz: 
 speed user nice sys idle irq
 #1 2593 MHz 10262 s 1 s 575 s 9884 s 0 s
 #2 2593 MHz 10625 s 1 s 568 s 9560 s 0 s
 
 Memory: 6.790924072265625 GB (3364.8671875 MB free)
 Uptime: 2080.96 sec
 Load Avg: 1.0 1.06 1.0
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-12.0.1 (ORCJIT, skylake-avx512)

Runtime information

Runtime Info
BLAS #threads	2
`BLAS.vendor()`	`openblas64`
`Sys.CPU_THREADS`	2

lscpu output:

Architecture: x86_64
CPU op-mode(s): 32-bit, 64-bit
Byte Order: Little Endian
Address sizes: 46 bits physical, 48 bits virtual
CPU(s): 2
On-line CPU(s) list: 0,1
Thread(s) per core: 1
Core(s) per socket: 2
Socket(s): 1
NUMA node(s): 1
Vendor ID: GenuineIntel
CPU family: 6
Model: 85
Model name: Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Stepping: 7
CPU MHz: 2593.907
BogoMIPS: 5187.81
Hypervisor vendor: Microsoft
Virtualization type: full
L1d cache: 64 KiB
L1i cache: 64 KiB
L2 cache: 2 MiB
L3 cache: 35.8 MiB
NUMA node0 CPU(s): 0,1
Vulnerability Itlb multihit: KVM: Mitigation: VMX unsupported
Vulnerability L1tf: Mitigation; PTE Inversion
Vulnerability Mds: Mitigation; Clear CPU buffers; SMT Host state unknown
Vulnerability Meltdown: Mitigation; PTI
Vulnerability Spec store bypass: Vulnerable
Vulnerability Spectre v1: Mitigation; usercopy/swapgs barriers and __user pointer sanitization
Vulnerability Spectre v2: Mitigation; Full generic retpoline, STIBP disabled, RSB filling
Vulnerability Srbds: Not affected
Vulnerability Tsx async abort: Mitigation; Clear CPU buffers; SMT Host state unknown
Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology cpuid pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch invpcid_single pti fsgsbase bmi1 hle avx2 smep bmi2 erms invpcid rtm mpx avx512f avx512dq rdseed adx smap clflushopt avx512cd avx512bw avx512vl xsaveopt xsavec xsaves md_clear

Cpu Property	Value
Brand	Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Vendor	:Intel
Architecture	:Skylake
Model	Family: 0x06, Model: 0x55, Stepping: 0x07, Type: 0x00
Cores	2 physical cores, 2 logical cores (on executing CPU)
	No Hyperthreading hardware capability detected
Clock Frequencies	Not supported by CPU
Data Cache	Level 1:3 : (32, 1024, 36608) kbytes
	64 byte cache line size
Address Size	48 bits virtual, 46 bits physical
SIMD	512 bit = 64 byte max. SIMD vector size
Time Stamp Counter	TSC is accessible via `rdtsc`
	TSC increased at every clock cycle (non-invariant TSC)
Perf. Monitoring	Performance Monitoring Counters (PMC) are not supported
Hypervisor	Yes, Microsoft

JET Benchmark Result

Judge result

Benchmark Report for /home/runner/work/JET.jl/JET.jl

Job Properties

Time of benchmarks:

Target: 2 Sep 2021 - 12:15
Baseline: 2 Sep 2021 - 12:32

Package commits:

Target: 1be606
Baseline: 85aa6b

Julia commits:

Target: 3aada5
Baseline: 3aada5

Julia command flags:

Target: None
Baseline: None

Environment variables:

Target: None
Baseline: None

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).

ID	time ratio	memory ratio

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

[]

Julia versioninfo

Target

Julia Version 1.8.0-DEV.459
Commit 3aada5982c (2021-09-01 19:46 UTC)
Platform Info:
 OS: Linux (x86_64-pc-linux-gnu)
 Ubuntu 20.04.3 LTS
 uname: Linux 5.8.0-1040-azure #43~20.04.1-Ubuntu SMP Mon Aug 2 22:06:11 UTC 2021 x86_64 x86_64
 CPU: Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz: 
 speed user nice sys idle irq
 #1 2593 MHz 5756 s 1 s 349 s 6362 s 0 s
 #2 2593 MHz 6326 s 1 s 366 s 5793 s 0 s
 
 Memory: 6.790924072265625 GB (3376.87890625 MB free)
 Uptime: 1253.67 sec
 Load Avg: 1.06 1.06 0.86
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-12.0.1 (ORCJIT, skylake-avx512)

Baseline

Julia Version 1.8.0-DEV.459
Commit 3aada5982c (2021-09-01 19:46 UTC)
Platform Info:
 OS: Linux (x86_64-pc-linux-gnu)
 Ubuntu 20.04.3 LTS
 uname: Linux 5.8.0-1040-azure #43~20.04.1-Ubuntu SMP Mon Aug 2 22:06:11 UTC 2021 x86_64 x86_64
 CPU: Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz: 
 speed user nice sys idle irq
 #1 2593 MHz 11274 s 1 s 613 s 11107 s 0 s
 #2 2593 MHz 11487 s 1 s 630 s 10895 s 0 s
 
 Memory: 6.790924072265625 GB (3384.81640625 MB free)
 Uptime: 2307.52 sec
 Load Avg: 1.12 1.06 1.01
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-12.0.1 (ORCJIT, skylake-avx512)

Target result

Benchmark Report for /home/runner/work/JET.jl/JET.jl

Job Properties

Time of benchmark: 2 Sep 2021 - 12:15
Package commit: 1be606
Julia commit: 3aada5
Julia command flags: None
Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID	time	memory	allocations
`["a bit complex"]`	1.146 s (5%)	728 bytes (1%)	19
`["cached easy"]`	7.427 ms (5%)	728 bytes (1%)	19
`["easy"]`	921.199 ms (5%)	728 bytes (1%)	19
`["end to end"]`	9.918 s (5%)	146.74 KiB (1%)	264
`["first time"]`	3.819 s (5%)	920 bytes (1%)	20
`["invalidation"]`	2.705 s (5%)	752 bytes (1%)	19
`["package loading"]`	273.922 ms (5%)	648 bytes (1%)	19
`["self analysis"]`	19.053 s (5%)	960 bytes (1%)	19
`["top-level first time"]`	6.728 s (5%)	1.66 KiB (1%)	20
`["top-level"]`	2.479 s (5%)	1.06 KiB (1%)	19

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

[]

Julia versioninfo

Julia Version 1.8.0-DEV.459
Commit 3aada5982c (2021-09-01 19:46 UTC)
Platform Info:
 OS: Linux (x86_64-pc-linux-gnu)
 Ubuntu 20.04.3 LTS
 uname: Linux 5.8.0-1040-azure #43~20.04.1-Ubuntu SMP Mon Aug 2 22:06:11 UTC 2021 x86_64 x86_64
 CPU: Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz: 
 speed user nice sys idle irq
 #1 2593 MHz 5756 s 1 s 349 s 6362 s 0 s
 #2 2593 MHz 6326 s 1 s 366 s 5793 s 0 s
 
 Memory: 6.790924072265625 GB (3376.87890625 MB free)
 Uptime: 1253.67 sec
 Load Avg: 1.06 1.06 0.86
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-12.0.1 (ORCJIT, skylake-avx512)

Baseline result

Benchmark Report for /home/runner/work/JET.jl/JET.jl

Job Properties

Time of benchmark: 2 Sep 2021 - 12:32
Package commit: 85aa6b
Julia commit: 3aada5
Julia command flags: None
Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID	time	memory	allocations
`["a bit complex"]`	1.129 s (5%)	728 bytes (1%)	19
`["cached easy"]`	7.164 ms (5%)	728 bytes (1%)	19
`["easy"]`	902.234 ms (5%)	728 bytes (1%)	19
`["end to end"]`	9.979 s (5%)	146.40 KiB (1%)	251
`["first time"]`	3.837 s (5%)	920 bytes (1%)	20
`["invalidation"]`	2.739 s (5%)	752 bytes (1%)	19
`["package loading"]`	274.091 ms (5%)	648 bytes (1%)	19
`["self analysis"]`	18.824 s (5%)	960 bytes (1%)	19
`["top-level first time"]`	6.736 s (5%)	1.66 KiB (1%)	20
`["top-level"]`	2.526 s (5%)	1.06 KiB (1%)	19

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

[]

Julia versioninfo

Julia Version 1.8.0-DEV.459
Commit 3aada5982c (2021-09-01 19:46 UTC)
Platform Info:
 OS: Linux (x86_64-pc-linux-gnu)
 Ubuntu 20.04.3 LTS
 uname: Linux 5.8.0-1040-azure #43~20.04.1-Ubuntu SMP Mon Aug 2 22:06:11 UTC 2021 x86_64 x86_64
 CPU: Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz: 
 speed user nice sys idle irq
 #1 2593 MHz 11274 s 1 s 613 s 11107 s 0 s
 #2 2593 MHz 11487 s 1 s 630 s 10895 s 0 s
 
 Memory: 6.790924072265625 GB (3384.81640625 MB free)
 Uptime: 2307.52 sec
 Load Avg: 1.12 1.06 1.01
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-12.0.1 (ORCJIT, skylake-avx512)

Runtime information

Runtime Info
BLAS #threads	2
`BLAS.vendor()`	`openblas64`
`Sys.CPU_THREADS`	2

lscpu output:

Architecture: x86_64
CPU op-mode(s): 32-bit, 64-bit
Byte Order: Little Endian
Address sizes: 46 bits physical, 48 bits virtual
CPU(s): 2
On-line CPU(s) list: 0,1
Thread(s) per core: 1
Core(s) per socket: 2
Socket(s): 1
NUMA node(s): 1
Vendor ID: GenuineIntel
CPU family: 6
Model: 85
Model name: Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Stepping: 7
CPU MHz: 2593.908
BogoMIPS: 5187.81
Hypervisor vendor: Microsoft
Virtualization type: full
L1d cache: 64 KiB
L1i cache: 64 KiB
L2 cache: 2 MiB
L3 cache: 35.8 MiB
NUMA node0 CPU(s): 0,1
Vulnerability Itlb multihit: KVM: Mitigation: VMX unsupported
Vulnerability L1tf: Mitigation; PTE Inversion
Vulnerability Mds: Mitigation; Clear CPU buffers; SMT Host state unknown
Vulnerability Meltdown: Mitigation; PTI
Vulnerability Spec store bypass: Vulnerable
Vulnerability Spectre v1: Mitigation; usercopy/swapgs barriers and __user pointer sanitization
Vulnerability Spectre v2: Mitigation; Full generic retpoline, STIBP disabled, RSB filling
Vulnerability Srbds: Not affected
Vulnerability Tsx async abort: Mitigation; Clear CPU buffers; SMT Host state unknown
Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology cpuid pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch invpcid_single pti fsgsbase bmi1 hle avx2 smep bmi2 erms invpcid rtm mpx avx512f avx512dq rdseed adx smap clflushopt avx512cd avx512bw avx512vl xsaveopt xsavec xsaves md_clear

Cpu Property	Value
Brand	Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Vendor	:Intel
Architecture	:Skylake
Model	Family: 0x06, Model: 0x55, Stepping: 0x07, Type: 0x00
Cores	2 physical cores, 2 logical cores (on executing CPU)
	No Hyperthreading hardware capability detected
Clock Frequencies	Not supported by CPU
Data Cache	Level 1:3 : (32, 1024, 36608) kbytes
	64 byte cache line size
Address Size	48 bits virtual, 46 bits physical
SIMD	512 bit = 64 byte max. SIMD vector size
Time Stamp Counter	TSC is accessible via `rdtsc`
	TSC increased at every clock cycle (non-invariant TSC)
Perf. Monitoring	Performance Monitoring Counters (PMC) are not supported
Hypervisor	Yes, Microsoft

JET Benchmark Result

Judge result

Benchmark Report for /home/runner/work/JET.jl/JET.jl

Job Properties

Time of benchmarks:

Target: 7 Sep 2021 - 07:44
Baseline: 7 Sep 2021 - 08:02

Package commits:

Target: dcb894
Baseline: 1ab416

Julia commits:

Target: 454192
Baseline: 454192

Julia command flags:

Target: None
Baseline: None

Environment variables:

Target: None
Baseline: None

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).

ID	time ratio	memory ratio
`["end to end"]`	1.01 (5%)	0.08 (1%) ✅

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

[]

Julia versioninfo

Target

Julia Version 1.8.0-DEV.477
Commit 4541922b06 (2021-09-06 23:29 UTC)
Platform Info:
 OS: Linux (x86_64-pc-linux-gnu)
 Ubuntu 20.04.3 LTS
 uname: Linux 5.8.0-1040-azure #43~20.04.1-Ubuntu SMP Mon Aug 2 22:06:11 UTC 2021 x86_64 x86_64
 CPU: Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz: 
 speed user nice sys idle irq
 #1 2593 MHz 5893 s 1 s 366 s 7668 s 0 s
 #2 2593 MHz 6032 s 1 s 350 s 7569 s 0 s
 
 Memory: 6.790924072265625 GB (3611.74609375 MB free)
 Uptime: 1400.6 sec
 Load Avg: 1.2 1.1 0.86
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-12.0.1 (ORCJIT, skylake-avx512)

Baseline

Julia Version 1.8.0-DEV.477
Commit 4541922b06 (2021-09-06 23:29 UTC)
Platform Info:
 OS: Linux (x86_64-pc-linux-gnu)
 Ubuntu 20.04.3 LTS
 uname: Linux 5.8.0-1040-azure #43~20.04.1-Ubuntu SMP Mon Aug 2 22:06:11 UTC 2021 x86_64 x86_64
 CPU: Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz: 
 speed user nice sys idle irq
 #1 2593 MHz 11032 s 1 s 628 s 12870 s 0 s
 #2 2593 MHz 11652 s 1 s 615 s 12291 s 0 s
 
 Memory: 6.790924072265625 GB (3341.5703125 MB free)
 Uptime: 2462.9 sec
 Load Avg: 1.04 1.03 1.0
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-12.0.1 (ORCJIT, skylake-avx512)

Target result

Benchmark Report for /home/runner/work/JET.jl/JET.jl

Job Properties

Time of benchmark: 7 Sep 2021 - 7:44
Package commit: dcb894
Julia commit: 454192
Julia command flags: None
Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID	time	memory	allocations
`["a bit complex"]`	1.267 s (5%)	728 bytes (1%)	19
`["cached easy"]`	7.851 ms (5%)	728 bytes (1%)	19
`["easy"]`	1.012 s (5%)	728 bytes (1%)	19
`["end to end"]`	11.030 s (5%)	11.02 KiB (1%)	264
`["first time"]`	4.336 s (5%)	920 bytes (1%)	20
`["invalidation"]`	2.999 s (5%)	752 bytes (1%)	19
`["package loading"]`	301.633 ms (5%)	648 bytes (1%)	19
`["self analysis"]`	21.341 s (5%)	960 bytes (1%)	19
`["top-level first time"]`	7.568 s (5%)	1.66 KiB (1%)	20
`["top-level"]`	2.777 s (5%)	1.06 KiB (1%)	19

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

[]

Julia versioninfo

Julia Version 1.8.0-DEV.477
Commit 4541922b06 (2021-09-06 23:29 UTC)
Platform Info:
 OS: Linux (x86_64-pc-linux-gnu)
 Ubuntu 20.04.3 LTS
 uname: Linux 5.8.0-1040-azure #43~20.04.1-Ubuntu SMP Mon Aug 2 22:06:11 UTC 2021 x86_64 x86_64
 CPU: Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz: 
 speed user nice sys idle irq
 #1 2593 MHz 5893 s 1 s 366 s 7668 s 0 s
 #2 2593 MHz 6032 s 1 s 350 s 7569 s 0 s
 
 Memory: 6.790924072265625 GB (3611.74609375 MB free)
 Uptime: 1400.6 sec
 Load Avg: 1.2 1.1 0.86
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-12.0.1 (ORCJIT, skylake-avx512)

Baseline result

Benchmark Report for /home/runner/work/JET.jl/JET.jl

Job Properties

Time of benchmark: 7 Sep 2021 - 8:2
Package commit: 1ab416
Julia commit: 454192
Julia command flags: None
Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID	time	memory	allocations
`["a bit complex"]`	1.237 s (5%)	728 bytes (1%)	19
`["cached easy"]`	7.748 ms (5%)	728 bytes (1%)	19
`["easy"]`	984.600 ms (5%)	728 bytes (1%)	19
`["end to end"]`	10.908 s (5%)	146.95 KiB (1%)	274
`["first time"]`	4.249 s (5%)	920 bytes (1%)	20
`["invalidation"]`	2.978 s (5%)	752 bytes (1%)	19
`["package loading"]`	300.128 ms (5%)	648 bytes (1%)	19
`["self analysis"]`	22.103 s (5%)	960 bytes (1%)	19
`["top-level first time"]`	7.504 s (5%)	1.66 KiB (1%)	20
`["top-level"]`	2.762 s (5%)	1.06 KiB (1%)	19

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

[]

Julia versioninfo

Julia Version 1.8.0-DEV.477
Commit 4541922b06 (2021-09-06 23:29 UTC)
Platform Info:
 OS: Linux (x86_64-pc-linux-gnu)
 Ubuntu 20.04.3 LTS
 uname: Linux 5.8.0-1040-azure #43~20.04.1-Ubuntu SMP Mon Aug 2 22:06:11 UTC 2021 x86_64 x86_64
 CPU: Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz: 
 speed user nice sys idle irq
 #1 2593 MHz 11032 s 1 s 628 s 12870 s 0 s
 #2 2593 MHz 11652 s 1 s 615 s 12291 s 0 s
 
 Memory: 6.790924072265625 GB (3341.5703125 MB free)
 Uptime: 2462.9 sec
 Load Avg: 1.04 1.03 1.0
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-12.0.1 (ORCJIT, skylake-avx512)

Runtime information

Runtime Info
BLAS #threads	2
`BLAS.vendor()`	`openblas64`
`Sys.CPU_THREADS`	2

lscpu output:

Architecture: x86_64
CPU op-mode(s): 32-bit, 64-bit
Byte Order: Little Endian
Address sizes: 46 bits physical, 48 bits virtual
CPU(s): 2
On-line CPU(s) list: 0,1
Thread(s) per core: 1
Core(s) per socket: 2
Socket(s): 1
NUMA node(s): 1
Vendor ID: GenuineIntel
CPU family: 6
Model: 85
Model name: Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Stepping: 7
CPU MHz: 2593.906
BogoMIPS: 5187.81
Hypervisor vendor: Microsoft
Virtualization type: full
L1d cache: 64 KiB
L1i cache: 64 KiB
L2 cache: 2 MiB
L3 cache: 35.8 MiB
NUMA node0 CPU(s): 0,1
Vulnerability Itlb multihit: KVM: Mitigation: VMX unsupported
Vulnerability L1tf: Mitigation; PTE Inversion
Vulnerability Mds: Mitigation; Clear CPU buffers; SMT Host state unknown
Vulnerability Meltdown: Mitigation; PTI
Vulnerability Spec store bypass: Vulnerable
Vulnerability Spectre v1: Mitigation; usercopy/swapgs barriers and __user pointer sanitization
Vulnerability Spectre v2: Mitigation; Full generic retpoline, STIBP disabled, RSB filling
Vulnerability Srbds: Not affected
Vulnerability Tsx async abort: Mitigation; Clear CPU buffers; SMT Host state unknown
Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology cpuid pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch invpcid_single pti fsgsbase bmi1 hle avx2 smep bmi2 erms invpcid rtm mpx avx512f avx512dq rdseed adx smap clflushopt avx512cd avx512bw avx512vl xsaveopt xsavec xsaves md_clear

Cpu Property	Value
Brand	Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Vendor	:Intel
Architecture	:Skylake
Model	Family: 0x06, Model: 0x55, Stepping: 0x07, Type: 0x00
Cores	2 physical cores, 2 logical cores (on executing CPU)
	No Hyperthreading hardware capability detected
Clock Frequencies	Not supported by CPU
Data Cache	Level 1:3 : (32, 1024, 36608) kbytes
	64 byte cache line size
Address Size	48 bits virtual, 46 bits physical
SIMD	512 bit = 64 byte max. SIMD vector size
Time Stamp Counter	TSC is accessible via `rdtsc`
	TSC increased at every clock cycle (non-invariant TSC)
Perf. Monitoring	Performance Monitoring Counters (PMC) are not supported
Hypervisor	Yes, Microsoft

JET Benchmark Result

Judge result

Benchmark Report for /home/runner/work/JET.jl/JET.jl

Job Properties

Time of benchmarks:

Target: 7 Sep 2021 - 07:54
Baseline: 7 Sep 2021 - 08:12

Package commits:

Target: 8dee71
Baseline: 1ab416

Julia commits:

Target: 454192
Baseline: 454192

Julia command flags:

Target: None
Baseline: None

Environment variables:

Target: None
Baseline: None

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).

ID	time ratio	memory ratio
`["end to end"]`	1.00 (5%)	13.35 (1%) ❌

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

[]

Julia versioninfo

Target

Julia Version 1.8.0-DEV.477
Commit 4541922b06 (2021-09-06 23:29 UTC)
Platform Info:
 OS: Linux (x86_64-pc-linux-gnu)
 Ubuntu 20.04.3 LTS
 uname: Linux 5.8.0-1040-azure #43~20.04.1-Ubuntu SMP Mon Aug 2 22:06:11 UTC 2021 x86_64 x86_64
 CPU: Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz: 
 speed user nice sys idle irq
 #1 2593 MHz 6901 s 1 s 345 s 5238 s 0 s
 #2 2593 MHz 5516 s 1 s 346 s 6632 s 0 s
 
 Memory: 6.790924072265625 GB (3587.4140625 MB free)
 Uptime: 1255.46 sec
 Load Avg: 1.1 1.11 0.94
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-12.0.1 (ORCJIT, skylake-avx512)

Baseline

Julia Version 1.8.0-DEV.477
Commit 4541922b06 (2021-09-06 23:29 UTC)
Platform Info:
 OS: Linux (x86_64-pc-linux-gnu)
 Ubuntu 20.04.3 LTS
 uname: Linux 5.8.0-1040-azure #43~20.04.1-Ubuntu SMP Mon Aug 2 22:06:11 UTC 2021 x86_64 x86_64
 CPU: Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz: 
 speed user nice sys idle irq
 #1 2593 MHz 12292 s 1 s 602 s 10360 s 0 s
 #2 2593 MHz 11043 s 1 s 606 s 11617 s 0 s
 
 Memory: 6.790924072265625 GB (3375.9609375 MB free)
 Uptime: 2334.4 sec
 Load Avg: 1.05 1.05 1.02
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-12.0.1 (ORCJIT, skylake-avx512)

Target result

Benchmark Report for /home/runner/work/JET.jl/JET.jl

Job Properties

Time of benchmark: 7 Sep 2021 - 7:54
Package commit: 8dee71
Julia commit: 454192
Julia command flags: None
Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID	time	memory	allocations
`["a bit complex"]`	1.338 s (5%)	728 bytes (1%)	19
`["cached easy"]`	8.587 ms (5%)	728 bytes (1%)	19
`["easy"]`	1.060 s (5%)	728 bytes (1%)	19
`["end to end"]`	11.460 s (5%)	146.77 KiB (1%)	265
`["first time"]`	4.342 s (5%)	920 bytes (1%)	20
`["invalidation"]`	3.117 s (5%)	752 bytes (1%)	19
`["package loading"]`	318.813 ms (5%)	648 bytes (1%)	19
`["self analysis"]`	21.813 s (5%)	960 bytes (1%)	19
`["top-level first time"]`	7.691 s (5%)	1.66 KiB (1%)	20
`["top-level"]`	2.983 s (5%)	1.06 KiB (1%)	19

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

[]

Julia versioninfo

Julia Version 1.8.0-DEV.477
Commit 4541922b06 (2021-09-06 23:29 UTC)
Platform Info:
 OS: Linux (x86_64-pc-linux-gnu)
 Ubuntu 20.04.3 LTS
 uname: Linux 5.8.0-1040-azure #43~20.04.1-Ubuntu SMP Mon Aug 2 22:06:11 UTC 2021 x86_64 x86_64
 CPU: Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz: 
 speed user nice sys idle irq
 #1 2593 MHz 6901 s 1 s 345 s 5238 s 0 s
 #2 2593 MHz 5516 s 1 s 346 s 6632 s 0 s
 
 Memory: 6.790924072265625 GB (3587.4140625 MB free)
 Uptime: 1255.46 sec
 Load Avg: 1.1 1.11 0.94
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-12.0.1 (ORCJIT, skylake-avx512)

Baseline result

Benchmark Report for /home/runner/work/JET.jl/JET.jl

Job Properties

Time of benchmark: 7 Sep 2021 - 8:12
Package commit: 1ab416
Julia commit: 454192
Julia command flags: None
Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID	time	memory	allocations
`["a bit complex"]`	1.293 s (5%)	728 bytes (1%)	19
`["cached easy"]`	8.855 ms (5%)	728 bytes (1%)	19
`["easy"]`	1.059 s (5%)	728 bytes (1%)	19
`["end to end"]`	11.478 s (5%)	10.99 KiB (1%)	271
`["first time"]`	4.365 s (5%)	920 bytes (1%)	20
`["invalidation"]`	3.087 s (5%)	752 bytes (1%)	19
`["package loading"]`	316.470 ms (5%)	648 bytes (1%)	19
`["self analysis"]`	21.942 s (5%)	960 bytes (1%)	19
`["top-level first time"]`	7.820 s (5%)	1.66 KiB (1%)	20
`["top-level"]`	2.888 s (5%)	1.06 KiB (1%)	19

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

[]

Julia versioninfo

Julia Version 1.8.0-DEV.477
Commit 4541922b06 (2021-09-06 23:29 UTC)
Platform Info:
 OS: Linux (x86_64-pc-linux-gnu)
 Ubuntu 20.04.3 LTS
 uname: Linux 5.8.0-1040-azure #43~20.04.1-Ubuntu SMP Mon Aug 2 22:06:11 UTC 2021 x86_64 x86_64
 CPU: Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz: 
 speed user nice sys idle irq
 #1 2593 MHz 12292 s 1 s 602 s 10360 s 0 s
 #2 2593 MHz 11043 s 1 s 606 s 11617 s 0 s
 
 Memory: 6.790924072265625 GB (3375.9609375 MB free)
 Uptime: 2334.4 sec
 Load Avg: 1.05 1.05 1.02
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-12.0.1 (ORCJIT, skylake-avx512)

Runtime information

Runtime Info
BLAS #threads	2
`BLAS.vendor()`	`openblas64`
`Sys.CPU_THREADS`	2

lscpu output:

Architecture: x86_64
CPU op-mode(s): 32-bit, 64-bit
Byte Order: Little Endian
Address sizes: 46 bits physical, 48 bits virtual
CPU(s): 2
On-line CPU(s) list: 0,1
Thread(s) per core: 1
Core(s) per socket: 2
Socket(s): 1
NUMA node(s): 1
Vendor ID: GenuineIntel
CPU family: 6
Model: 85
Model name: Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Stepping: 7
CPU MHz: 2593.908
BogoMIPS: 5187.81
Hypervisor vendor: Microsoft
Virtualization type: full
L1d cache: 64 KiB
L1i cache: 64 KiB
L2 cache: 2 MiB
L3 cache: 35.8 MiB
NUMA node0 CPU(s): 0,1
Vulnerability Itlb multihit: KVM: Mitigation: VMX unsupported
Vulnerability L1tf: Mitigation; PTE Inversion
Vulnerability Mds: Mitigation; Clear CPU buffers; SMT Host state unknown
Vulnerability Meltdown: Mitigation; PTI
Vulnerability Spec store bypass: Vulnerable
Vulnerability Spectre v1: Mitigation; usercopy/swapgs barriers and __user pointer sanitization
Vulnerability Spectre v2: Mitigation; Full generic retpoline, STIBP disabled, RSB filling
Vulnerability Srbds: Not affected
Vulnerability Tsx async abort: Mitigation; Clear CPU buffers; SMT Host state unknown
Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology cpuid pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch invpcid_single pti fsgsbase bmi1 hle avx2 smep bmi2 erms invpcid rtm mpx avx512f avx512dq rdseed adx smap clflushopt avx512cd avx512bw avx512vl xsaveopt xsavec xsaves md_clear

Cpu Property	Value
Brand	Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Vendor	:Intel
Architecture	:Skylake
Model	Family: 0x06, Model: 0x55, Stepping: 0x07, Type: 0x00
Cores	2 physical cores, 2 logical cores (on executing CPU)
	No Hyperthreading hardware capability detected
Clock Frequencies	Not supported by CPU
Data Cache	Level 1:3 : (32, 1024, 36608) kbytes
	64 byte cache line size
Address Size	48 bits virtual, 46 bits physical
SIMD	512 bit = 64 byte max. SIMD vector size
Time Stamp Counter	TSC is accessible via `rdtsc`
	TSC increased at every clock cycle (non-invariant TSC)
Perf. Monitoring	Performance Monitoring Counters (PMC) are not supported
Hypervisor	Yes, Microsoft

Requires <julia-vscode/julia-vscode#2329> on VSCode side.

pfitzseb mentioned this pull request Jul 31, 2021

Extensible diagnostics display julia-vscode/julia-vscode#2329

Merged

aviatesk changed the title ~~wip: sort out interfaces for VSCode integration~~ VSCode integration Jul 31, 2021

aviatesk commented Aug 2, 2021

View reviewed changes

aviatesk mentioned this pull request Aug 2, 2021

VSCode integration aviatesk/JETTest.jl#8

Open

aviatesk force-pushed the avi/vscode branch 3 times, most recently from fe312a5 to 063460a Compare August 8, 2021 17:29

aviatesk force-pushed the avi/vscode branch from 063460a to 9152f1e Compare August 13, 2021 07:15

aviatesk force-pushed the avi/vscode branch 2 times, most recently from c372c4c to 4c7c3cb Compare September 7, 2021 07:24

implement VSCode integration

33730a9

Requires <julia-vscode/julia-vscode#2329> on VSCode side.

aviatesk force-pushed the avi/vscode branch from 4c7c3cb to 33730a9 Compare September 7, 2021 07:34

aviatesk merged commit 533310b into master Sep 7, 2021

aviatesk deleted the avi/vscode branch September 7, 2021 07:57

VSCode integration #227

VSCode integration #227

Conversation

aviatesk commented Jul 31, 2021

pfitzseb commented Jul 31, 2021

aviatesk commented Jul 31, 2021

codecov-commenter commented Aug 1, 2021 • edited

Codecov Report

aviatesk Aug 2, 2021

Choose a reason for hiding this comment

pfitzseb Aug 2, 2021

Choose a reason for hiding this comment

aviatesk Aug 2, 2021

Choose a reason for hiding this comment

github-actions bot commented Aug 8, 2021 • edited

Judge result

Benchmark Report for /home/runner/work/JET.jl/JET.jl

Job Properties

Results

Benchmark Group List

Julia versioninfo

Target

Baseline

Target result

Benchmark Report for /home/runner/work/JET.jl/JET.jl

Job Properties

Results

Benchmark Group List

Julia versioninfo

Baseline result

Benchmark Report for /home/runner/work/JET.jl/JET.jl

Job Properties

Results

Benchmark Group List

Julia versioninfo

Runtime information

Judge result

Benchmark Report for /home/runner/work/JET.jl/JET.jl

Job Properties

Results

Benchmark Group List

Julia versioninfo

Target

Baseline

Target result

Benchmark Report for /home/runner/work/JET.jl/JET.jl

Job Properties

Results

Benchmark Group List

Julia versioninfo

Baseline result

Benchmark Report for /home/runner/work/JET.jl/JET.jl

Job Properties

Results

Benchmark Group List

Julia versioninfo

Runtime information

Judge result

Benchmark Report for /home/runner/work/JET.jl/JET.jl

Job Properties

Results

Benchmark Group List

Julia versioninfo

Target

Baseline

Target result

Benchmark Report for /home/runner/work/JET.jl/JET.jl

Job Properties

Results

Benchmark Group List

Julia versioninfo

Baseline result

Benchmark Report for /home/runner/work/JET.jl/JET.jl

Job Properties

Results

Benchmark Group List

Julia versioninfo

Runtime information

Judge result

Benchmark Report for /home/runner/work/JET.jl/JET.jl

codecov-commenter commented Aug 1, 2021 •

edited

github-actions bot commented Aug 8, 2021 •

edited