Add local tracers #65

adrhill · 2024-05-15T20:44:53Z

Closes #56.

Add a Dual wrapper type keeping track of primal computations
- rename GlobalGradientTracer back to GradientTracer
- rename GlobalHessianTracer back to HessianTracer

Still WIP.

gdalle

Haven't read everything but I left some comments to reduce code duplication if possible! Good work :)

src/overload_connectivity.jl

src/overload_gradient.jl

src/overload_hessian.jl

src/operators.jl

adrhill · 2024-05-16T15:45:33Z

#68 is fixed on Jacobians. Hessians and Connectivity still need testing.

gdalle

I have reviewed the overloads, not the conversion yet. My main doubt is whether we handle gradient tracing properly when we do hessian tracing

src/overload_gradient.jl

src/overload_hessian.jl

codecov-commenter · 2024-05-16T21:11:10Z

Codecov Report

Attention: Patch coverage is 57.72871% with 134 lines in your changes are missing coverage. Please review.

Project coverage is 71.32%. Comparing base (6750c46) to head (609120e).

Files	Patch %	Lines
src/conversion.jl	18.29%	67 Missing ⚠️
src/overload_hessian.jl	74.28%	18 Missing ⚠️
src/overload_gradient.jl	75.80%	15 Missing ⚠️
src/overload_connectivity.jl	22.22%	14 Missing ⚠️
src/tracers.jl	70.58%	10 Missing ⚠️
src/operators.jl	68.42%	6 Missing ⚠️
src/pattern.jl	86.66%	4 Missing ⚠️

Additional details and impacted files

@@            Coverage Diff             @@
##             main      #65      +/-   ##
==========================================
+ Coverage   70.04%   71.32%   +1.27%     
==========================================
  Files          12       13       +1     
  Lines         424      544     +120     
==========================================
+ Hits          297      388      +91     
- Misses        127      156      +29

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

adrhill · 2024-05-16T21:15:21Z

Documenter.jl truly implemented their similar method specifically to drive me insane...

gdalle · 2024-05-17T11:54:21Z

Documenter.jl truly implemented their similar method specifically to drive me insane...

How did you fix it all the previous times?

gdalle · 2024-05-17T12:42:44Z

as I live and breathe

gdalle · 2024-05-17T12:42:48Z

passing tests

github-actions · 2024-05-17T13:53:57Z

Benchmark result

Judge result

Benchmark Report for /home/runner/work/SparseConnectivityTracer.jl/SparseConnectivityTracer.jl

Job Properties

Time of benchmarks:
- Target: 17 May 2024 - 13:49
- Baseline: 17 May 2024 - 13:53
Package commits:
- Target: bc52de
- Baseline: 6750c4
Julia commits:
- Target: 0b4590
- Baseline: 0b4590
Julia command flags:
- Target: None
- Baseline: None
Environment variables:
- Target: None
- Baseline: None

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).

ID	time ratio	memory ratio
`["Jacobian", "Global", "brusselator", "N=100", "BitSet"]`	0.91 (5%) ✅	1.00 (1%)
`["Jacobian", "Global", "brusselator_ode_solve", "N=100", "BitSet"]`	0.89 (5%) ✅	1.00 (1%)
`["Jacobian", "Global", "sparse_matmul", "sparsity=0.01", "BitSet"]`	1.06 (5%) ❌	1.02 (1%) ❌
`["Jacobian", "Global", "sparse_matmul", "sparsity=0.01", "Set{UInt64}"]`	1.04 (5%)	0.98 (1%) ✅
`["Jacobian", "Global", "sparse_matmul", "sparsity=0.05", "BitSet"]`	1.02 (5%)	1.01 (1%) ❌
`["Jacobian", "Global", "sparse_matmul", "sparsity=0.05", "DuplicateVector{UInt64}"]`	0.92 (5%) ✅	0.94 (1%) ✅
`["Jacobian", "Global", "sparse_matmul", "sparsity=0.05", "Set{UInt64}"]`	1.02 (5%)	1.03 (1%) ❌
`["Jacobian", "Global", "sparse_matmul", "sparsity=0.05", "SortedVector{UInt64}"]`	1.02 (5%)	0.99 (1%) ✅
`["Jacobian", "Global", "sparse_matmul", "sparsity=0.1", "DuplicateVector{UInt64}"]`	0.97 (5%)	0.98 (1%) ✅
`["Jacobian", "Global", "sparse_matmul", "sparsity=0.1", "Set{UInt64}"]`	0.97 (5%)	0.97 (1%) ✅
`["Jacobian", "Global", "sparse_matmul", "sparsity=0.25", "DuplicateVector{UInt64}"]`	1.02 (5%)	0.95 (1%) ✅
`["Jacobian", "Global", "sparse_matmul", "sparsity=0.25", "SortedVector{UInt64}"]`	1.06 (5%) ❌	1.01 (1%)

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

["Jacobian", "Global", "brusselator", "N=100"]
["Jacobian", "Global", "brusselator", "N=24"]
["Jacobian", "Global", "brusselator", "N=6"]
["Jacobian", "Global", "brusselator_ode_solve", "N=100"]
["Jacobian", "Global", "brusselator_ode_solve", "N=24"]
["Jacobian", "Global", "brusselator_ode_solve", "N=6"]
["Jacobian", "Global", "conv", "size=128x128x3"]
["Jacobian", "Global", "conv", "size=28x28x3"]
["Jacobian", "Global", "sparse_matmul", "sparsity=0.01"]
["Jacobian", "Global", "sparse_matmul", "sparsity=0.05"]
["Jacobian", "Global", "sparse_matmul", "sparsity=0.1"]
["Jacobian", "Global", "sparse_matmul", "sparsity=0.25"]

Julia versioninfo

Target

Julia Version 1.10.3
Commit 0b4590a5507 (2024-04-30 10:59 UTC)
Build Info:
  Official https://julialang.org/ release
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.4 LTS
  uname: Linux 6.5.0-1021-azure #22~22.04.1-Ubuntu SMP Tue Apr 30 16:08:18 UTC 2024 x86_64 x86_64
  CPU: AMD EPYC 7763 64-Core Processor: 
              speed         user         nice          sys         idle          irq
       #1  2604 MHz       2647 s          0 s        196 s       5981 s          0 s
       #2  3224 MHz       3227 s          0 s        170 s       5428 s          0 s
       #3  3165 MHz       1698 s          0 s        176 s       6951 s          0 s
       #4  3241 MHz       1528 s          0 s        193 s       7110 s          0 s
  Memory: 15.606502532958984 GB (13319.24609375 MB free)
  Uptime: 887.21 sec
  Load Avg:  1.06  1.08  0.79
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline

Julia Version 1.10.3
Commit 0b4590a5507 (2024-04-30 10:59 UTC)
Build Info:
  Official https://julialang.org/ release
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.4 LTS
  uname: Linux 6.5.0-1021-azure #22~22.04.1-Ubuntu SMP Tue Apr 30 16:08:18 UTC 2024 x86_64 x86_64
  CPU: AMD EPYC 7763 64-Core Processor: 
              speed         user         nice          sys         idle          irq
       #1  2445 MHz       3540 s          0 s        223 s       7554 s          0 s
       #2  2445 MHz       4075 s          0 s        202 s       7042 s          0 s
       #3  3246 MHz       2211 s          0 s        204 s       8901 s          0 s
       #4  3242 MHz       1724 s          0 s        212 s       9386 s          0 s
  Memory: 15.606502532958984 GB (13791.3203125 MB free)
  Uptime: 1136.99 sec
  Load Avg:  1.08  1.07  0.86
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Target result

Benchmark Report for /home/runner/work/SparseConnectivityTracer.jl/SparseConnectivityTracer.jl

Job Properties

Time of benchmark: 17 May 2024 - 13:49
Package commit: bc52de
Julia commit: 0b4590
Julia command flags: None
Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID	time	GC time	memory	allocations
`["Jacobian", "Global", "brusselator", "N=100", "BitSet"]`	51.343 ms (5%)	6.454 ms	145.98 MiB (1%)	426018
`["Jacobian", "Global", "brusselator", "N=100", "DuplicateVector{UInt64}"]`	68.852 ms (5%)	5.119 ms	75.53 MiB (1%)	740057
`["Jacobian", "Global", "brusselator", "N=100", "Set{UInt64}"]`	46.231 ms (5%)		69.12 MiB (1%)	660060
`["Jacobian", "Global", "brusselator", "N=100", "SortedVector{UInt64}"]`	11.755 ms (5%)		23.19 MiB (1%)	200057
`["Jacobian", "Global", "brusselator", "N=24", "BitSet"]`	949.447 μs (5%)		2.10 MiB (1%)	23418
`["Jacobian", "Global", "brusselator", "N=24", "DuplicateVector{UInt64}"]`	3.552 ms (5%)		4.38 MiB (1%)	42665
`["Jacobian", "Global", "brusselator", "N=24", "Set{UInt64}"]`	2.208 ms (5%)		4.01 MiB (1%)	38060
`["Jacobian", "Global", "brusselator", "N=24", "SortedVector{UInt64}"]`	655.046 μs (5%)		1.37 MiB (1%)	11561
`["Jacobian", "Global", "brusselator", "N=6", "BitSet"]`	52.188 μs (5%)		104.75 KiB (1%)	1254
`["Jacobian", "Global", "brusselator", "N=6", "DuplicateVector{UInt64}"]`	217.948 μs (5%)		281.31 KiB (1%)	2693
`["Jacobian", "Global", "brusselator", "N=6", "Set{UInt64}"]`	114.274 μs (5%)		258.02 KiB (1%)	2408
`["Jacobian", "Global", "brusselator", "N=6", "SortedVector{UInt64}"]`	41.027 μs (5%)		88.38 KiB (1%)	749
`["Jacobian", "Global", "brusselator_ode_solve", "N=100", "BitSet"]`	245.200 ms (5%)	67.885 ms	800.89 MiB (1%)	1225764
`["Jacobian", "Global", "brusselator_ode_solve", "N=100", "DuplicateVector{UInt64}"]`	386.170 ms (5%)	36.387 ms	531.22 MiB (1%)	3100171
`["Jacobian", "Global", "brusselator_ode_solve", "N=100", "Set{UInt64}"]`	343.439 ms (5%)	68.521 ms	360.10 MiB (1%)	2480179
`["Jacobian", "Global", "brusselator_ode_solve", "N=100", "SortedVector{UInt64}"]`	41.811 ms (5%)	4.092 ms	80.25 MiB (1%)	460171
`["Jacobian", "Global", "brusselator_ode_solve", "N=24", "BitSet"]`	2.745 ms (5%)		6.32 MiB (1%)	67431
`["Jacobian", "Global", "brusselator_ode_solve", "N=24", "DuplicateVector{UInt64}"]`	18.078 ms (5%)		31.01 MiB (1%)	178708
`["Jacobian", "Global", "brusselator_ode_solve", "N=24", "Set{UInt64}"]`	13.181 ms (5%)		20.76 MiB (1%)	143004
`["Jacobian", "Global", "brusselator_ode_solve", "N=24", "SortedVector{UInt64}"]`	1.935 ms (5%)		4.64 MiB (1%)	26644
`["Jacobian", "Global", "brusselator_ode_solve", "N=6", "BitSet"]`	149.379 μs (5%)		275.11 KiB (1%)	3233
`["Jacobian", "Global", "brusselator_ode_solve", "N=6", "DuplicateVector{UInt64}"]`	1.101 ms (5%)		1.95 MiB (1%)	11295
`["Jacobian", "Global", "brusselator_ode_solve", "N=6", "Set{UInt64}"]`	743.422 μs (5%)		1.31 MiB (1%)	9071
`["Jacobian", "Global", "brusselator_ode_solve", "N=6", "SortedVector{UInt64}"]`	137.707 μs (5%)		305.86 KiB (1%)	1791
`["Jacobian", "Global", "conv", "size=128x128x3", "BitSet"]`	2.125 s (5%)	457.683 ms	19.15 GiB (1%)	16384623
`["Jacobian", "Global", "conv", "size=128x128x3", "DuplicateVector{UInt64}"]`	1.203 s (5%)	99.392 ms	1.20 GiB (1%)	7109869
`["Jacobian", "Global", "conv", "size=128x128x3", "Set{UInt64}"]`	3.509 s (5%)	654.804 ms	4.65 GiB (1%)	34480063
`["Jacobian", "Global", "conv", "size=128x128x3", "SortedVector{UInt64}"]`	707.528 ms (5%)	80.819 ms	1.20 GiB (1%)	7159021
`["Jacobian", "Global", "conv", "size=28x28x3", "BitSet"]`	26.697 ms (5%)	2.353 ms	74.83 MiB (1%)	598714
`["Jacobian", "Global", "conv", "size=28x28x3", "DuplicateVector{UInt64}"]`	38.205 ms (5%)		48.51 MiB (1%)	267454
`["Jacobian", "Global", "conv", "size=28x28x3", "Set{UInt64}"]`	113.474 ms (5%)	8.661 ms	181.66 MiB (1%)	1294798
`["Jacobian", "Global", "conv", "size=28x28x3", "SortedVector{UInt64}"]`	21.320 ms (5%)		48.65 MiB (1%)	269806
`["Jacobian", "Global", "sparse_matmul", "sparsity=0.01", "BitSet"]`	15.649 μs (5%)		31.84 KiB (1%)	381
`["Jacobian", "Global", "sparse_matmul", "sparsity=0.01", "DuplicateVector{UInt64}"]`	13.164 μs (5%)		22.11 KiB (1%)	225
`["Jacobian", "Global", "sparse_matmul", "sparsity=0.01", "Set{UInt64}"]`	25.929 μs (5%)		69.83 KiB (1%)	663
`["Jacobian", "Global", "sparse_matmul", "sparsity=0.01", "SortedVector{UInt64}"]`	14.467 μs (5%)		25.33 KiB (1%)	277
`["Jacobian", "Global", "sparse_matmul", "sparsity=0.05", "BitSet"]`	84.057 μs (5%)		162.09 KiB (1%)	1297
`["Jacobian", "Global", "sparse_matmul", "sparsity=0.05", "DuplicateVector{UInt64}"]`	785.757 μs (5%)		1.13 MiB (1%)	6847
`["Jacobian", "Global", "sparse_matmul", "sparsity=0.05", "Set{UInt64}"]`	288.699 μs (5%)		485.57 KiB (1%)	3178
`["Jacobian", "Global", "sparse_matmul", "sparsity=0.05", "SortedVector{UInt64}"]`	84.879 μs (5%)		165.58 KiB (1%)	749
`["Jacobian", "Global", "sparse_matmul", "sparsity=0.1", "BitSet"]`	170.379 μs (5%)		340.27 KiB (1%)	2475
`["Jacobian", "Global", "sparse_matmul", "sparsity=0.1", "DuplicateVector{UInt64}"]`	5.530 ms (5%)		11.99 MiB (1%)	24960
`["Jacobian", "Global", "sparse_matmul", "sparsity=0.1", "Set{UInt64}"]`	1.307 ms (5%)		2.19 MiB (1%)	8481
`["Jacobian", "Global", "sparse_matmul", "sparsity=0.1", "SortedVector{UInt64}"]`	236.433 μs (5%)		650.48 KiB (1%)	1333
`["Jacobian", "Global", "sparse_matmul", "sparsity=0.25", "BitSet"]`	359.212 μs (5%)		597.19 KiB (1%)	6087
`["Jacobian", "Global", "sparse_matmul", "sparsity=0.25", "DuplicateVector{UInt64}"]`	344.501 ms (5%)	190.209 ms	754.84 MiB (1%)	29930
`["Jacobian", "Global", "sparse_matmul", "sparsity=0.25", "Set{UInt64}"]`	4.401 ms (5%)		8.28 MiB (1%)	25221
`["Jacobian", "Global", "sparse_matmul", "sparsity=0.25", "SortedVector{UInt64}"]`	642.423 μs (5%)		1.98 MiB (1%)	3188

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

["Jacobian", "Global", "brusselator", "N=100"]
["Jacobian", "Global", "brusselator", "N=24"]
["Jacobian", "Global", "brusselator", "N=6"]
["Jacobian", "Global", "brusselator_ode_solve", "N=100"]
["Jacobian", "Global", "brusselator_ode_solve", "N=24"]
["Jacobian", "Global", "brusselator_ode_solve", "N=6"]
["Jacobian", "Global", "conv", "size=128x128x3"]
["Jacobian", "Global", "conv", "size=28x28x3"]
["Jacobian", "Global", "sparse_matmul", "sparsity=0.01"]
["Jacobian", "Global", "sparse_matmul", "sparsity=0.05"]
["Jacobian", "Global", "sparse_matmul", "sparsity=0.1"]
["Jacobian", "Global", "sparse_matmul", "sparsity=0.25"]

Julia versioninfo

Julia Version 1.10.3
Commit 0b4590a5507 (2024-04-30 10:59 UTC)
Build Info:
  Official https://julialang.org/ release
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.4 LTS
  uname: Linux 6.5.0-1021-azure #22~22.04.1-Ubuntu SMP Tue Apr 30 16:08:18 UTC 2024 x86_64 x86_64
  CPU: AMD EPYC 7763 64-Core Processor: 
              speed         user         nice          sys         idle          irq
       #1  2604 MHz       2647 s          0 s        196 s       5981 s          0 s
       #2  3224 MHz       3227 s          0 s        170 s       5428 s          0 s
       #3  3165 MHz       1698 s          0 s        176 s       6951 s          0 s
       #4  3241 MHz       1528 s          0 s        193 s       7110 s          0 s
  Memory: 15.606502532958984 GB (13319.24609375 MB free)
  Uptime: 887.21 sec
  Load Avg:  1.06  1.08  0.79
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline result

Benchmark Report for /home/runner/work/SparseConnectivityTracer.jl/SparseConnectivityTracer.jl

Job Properties

Time of benchmark: 17 May 2024 - 13:53
Package commit: 6750c4
Julia commit: 0b4590
Julia command flags: None
Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID	time	GC time	memory	allocations
`["Jacobian", "Global", "brusselator", "N=100", "BitSet"]`	56.546 ms (5%)	13.120 ms	145.98 MiB (1%)	426018
`["Jacobian", "Global", "brusselator", "N=100", "DuplicateVector{UInt64}"]`	69.031 ms (5%)	5.850 ms	75.53 MiB (1%)	740057
`["Jacobian", "Global", "brusselator", "N=100", "Set{UInt64}"]`	46.143 ms (5%)		69.12 MiB (1%)	660060
`["Jacobian", "Global", "brusselator", "N=100", "SortedVector{UInt64}"]`	11.272 ms (5%)		23.19 MiB (1%)	200057
`["Jacobian", "Global", "brusselator", "N=24", "BitSet"]`	930.728 μs (5%)		2.10 MiB (1%)	23418
`["Jacobian", "Global", "brusselator", "N=24", "DuplicateVector{UInt64}"]`	3.528 ms (5%)		4.38 MiB (1%)	42665
`["Jacobian", "Global", "brusselator", "N=24", "Set{UInt64}"]`	2.185 ms (5%)		4.01 MiB (1%)	38060
`["Jacobian", "Global", "brusselator", "N=24", "SortedVector{UInt64}"]`	633.309 μs (5%)		1.37 MiB (1%)	11561
`["Jacobian", "Global", "brusselator", "N=6", "BitSet"]`	51.436 μs (5%)		104.75 KiB (1%)	1254
`["Jacobian", "Global", "brusselator", "N=6", "DuplicateVector{UInt64}"]`	217.027 μs (5%)		281.31 KiB (1%)	2693
`["Jacobian", "Global", "brusselator", "N=6", "Set{UInt64}"]`	112.782 μs (5%)		258.02 KiB (1%)	2408
`["Jacobian", "Global", "brusselator", "N=6", "SortedVector{UInt64}"]`	40.255 μs (5%)		88.38 KiB (1%)	749
`["Jacobian", "Global", "brusselator_ode_solve", "N=100", "BitSet"]`	274.572 ms (5%)	65.375 ms	800.89 MiB (1%)	1225764
`["Jacobian", "Global", "brusselator_ode_solve", "N=100", "DuplicateVector{UInt64}"]`	396.727 ms (5%)	37.960 ms	531.22 MiB (1%)	3100171
`["Jacobian", "Global", "brusselator_ode_solve", "N=100", "Set{UInt64}"]`	335.289 ms (5%)	66.881 ms	360.10 MiB (1%)	2480179
`["Jacobian", "Global", "brusselator_ode_solve", "N=100", "SortedVector{UInt64}"]`	42.881 ms (5%)	5.546 ms	80.25 MiB (1%)	460171
`["Jacobian", "Global", "brusselator_ode_solve", "N=24", "BitSet"]`	2.848 ms (5%)		6.32 MiB (1%)	67431
`["Jacobian", "Global", "brusselator_ode_solve", "N=24", "DuplicateVector{UInt64}"]`	18.527 ms (5%)		31.01 MiB (1%)	178708
`["Jacobian", "Global", "brusselator_ode_solve", "N=24", "Set{UInt64}"]`	13.554 ms (5%)		20.76 MiB (1%)	143004
`["Jacobian", "Global", "brusselator_ode_solve", "N=24", "SortedVector{UInt64}"]`	1.994 ms (5%)		4.64 MiB (1%)	26644
`["Jacobian", "Global", "brusselator_ode_solve", "N=6", "BitSet"]`	149.270 μs (5%)		275.11 KiB (1%)	3233
`["Jacobian", "Global", "brusselator_ode_solve", "N=6", "DuplicateVector{UInt64}"]`	1.110 ms (5%)		1.95 MiB (1%)	11295
`["Jacobian", "Global", "brusselator_ode_solve", "N=6", "Set{UInt64}"]`	755.664 μs (5%)		1.31 MiB (1%)	9071
`["Jacobian", "Global", "brusselator_ode_solve", "N=6", "SortedVector{UInt64}"]`	139.642 μs (5%)		305.86 KiB (1%)	1791
`["Jacobian", "Global", "conv", "size=128x128x3", "BitSet"]`	2.181 s (5%)	444.063 ms	19.15 GiB (1%)	16384623
`["Jacobian", "Global", "conv", "size=128x128x3", "DuplicateVector{UInt64}"]`	1.153 s (5%)	70.558 ms	1.20 GiB (1%)	7109869
`["Jacobian", "Global", "conv", "size=128x128x3", "Set{UInt64}"]`	3.521 s (5%)	645.655 ms	4.65 GiB (1%)	34480063
`["Jacobian", "Global", "conv", "size=128x128x3", "SortedVector{UInt64}"]`	683.569 ms (5%)	89.353 ms	1.20 GiB (1%)	7159021
`["Jacobian", "Global", "conv", "size=28x28x3", "BitSet"]`	26.126 ms (5%)	2.716 ms	74.83 MiB (1%)	598714
`["Jacobian", "Global", "conv", "size=28x28x3", "DuplicateVector{UInt64}"]`	38.365 ms (5%)		48.51 MiB (1%)	267454
`["Jacobian", "Global", "conv", "size=28x28x3", "Set{UInt64}"]`	112.577 ms (5%)	8.282 ms	181.66 MiB (1%)	1294798
`["Jacobian", "Global", "conv", "size=28x28x3", "SortedVector{UInt64}"]`	20.951 ms (5%)		48.65 MiB (1%)	269806
`["Jacobian", "Global", "sparse_matmul", "sparsity=0.01", "BitSet"]`	14.757 μs (5%)		31.17 KiB (1%)	371
`["Jacobian", "Global", "sparse_matmul", "sparsity=0.01", "DuplicateVector{UInt64}"]`	12.914 μs (5%)		22.33 KiB (1%)	228
`["Jacobian", "Global", "sparse_matmul", "sparsity=0.01", "Set{UInt64}"]`	25.047 μs (5%)		71.03 KiB (1%)	675
`["Jacobian", "Global", "sparse_matmul", "sparsity=0.01", "SortedVector{UInt64}"]`	14.176 μs (5%)		25.17 KiB (1%)	275
`["Jacobian", "Global", "sparse_matmul", "sparsity=0.05", "BitSet"]`	82.524 μs (5%)		159.98 KiB (1%)	1273
`["Jacobian", "Global", "sparse_matmul", "sparsity=0.05", "DuplicateVector{UInt64}"]`	855.499 μs (5%)		1.21 MiB (1%)	7330
`["Jacobian", "Global", "sparse_matmul", "sparsity=0.05", "Set{UInt64}"]`	281.777 μs (5%)		472.13 KiB (1%)	3114
`["Jacobian", "Global", "sparse_matmul", "sparsity=0.05", "SortedVector{UInt64}"]`	83.537 μs (5%)		167.48 KiB (1%)	751
`["Jacobian", "Global", "sparse_matmul", "sparsity=0.1", "BitSet"]`	167.002 μs (5%)		339.33 KiB (1%)	2479
`["Jacobian", "Global", "sparse_matmul", "sparsity=0.1", "DuplicateVector{UInt64}"]`	5.706 ms (5%)		12.22 MiB (1%)	25043
`["Jacobian", "Global", "sparse_matmul", "sparsity=0.1", "Set{UInt64}"]`	1.342 ms (5%)		2.25 MiB (1%)	8680
`["Jacobian", "Global", "sparse_matmul", "sparsity=0.1", "SortedVector{UInt64}"]`	232.705 μs (5%)		656.92 KiB (1%)	1343
`["Jacobian", "Global", "sparse_matmul", "sparsity=0.25", "BitSet"]`	348.532 μs (5%)		600.38 KiB (1%)	6135
`["Jacobian", "Global", "sparse_matmul", "sparsity=0.25", "DuplicateVector{UInt64}"]`	336.520 ms (5%)	179.166 ms	793.17 MiB (1%)	29912
`["Jacobian", "Global", "sparse_matmul", "sparsity=0.25", "Set{UInt64}"]`	4.435 ms (5%)		8.24 MiB (1%)	25099
`["Jacobian", "Global", "sparse_matmul", "sparsity=0.25", "SortedVector{UInt64}"]`	606.134 μs (5%)		1.96 MiB (1%)	3165

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

["Jacobian", "Global", "brusselator", "N=100"]
["Jacobian", "Global", "brusselator", "N=24"]
["Jacobian", "Global", "brusselator", "N=6"]
["Jacobian", "Global", "brusselator_ode_solve", "N=100"]
["Jacobian", "Global", "brusselator_ode_solve", "N=24"]
["Jacobian", "Global", "brusselator_ode_solve", "N=6"]
["Jacobian", "Global", "conv", "size=128x128x3"]
["Jacobian", "Global", "conv", "size=28x28x3"]
["Jacobian", "Global", "sparse_matmul", "sparsity=0.01"]
["Jacobian", "Global", "sparse_matmul", "sparsity=0.05"]
["Jacobian", "Global", "sparse_matmul", "sparsity=0.1"]
["Jacobian", "Global", "sparse_matmul", "sparsity=0.25"]

Julia versioninfo

Julia Version 1.10.3
Commit 0b4590a5507 (2024-04-30 10:59 UTC)
Build Info:
  Official https://julialang.org/ release
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.4 LTS
  uname: Linux 6.5.0-1021-azure #22~22.04.1-Ubuntu SMP Tue Apr 30 16:08:18 UTC 2024 x86_64 x86_64
  CPU: AMD EPYC 7763 64-Core Processor: 
              speed         user         nice          sys         idle          irq
       #1  2445 MHz       3540 s          0 s        223 s       7554 s          0 s
       #2  2445 MHz       4075 s          0 s        202 s       7042 s          0 s
       #3  3246 MHz       2211 s          0 s        204 s       8901 s          0 s
       #4  3242 MHz       1724 s          0 s        212 s       9386 s          0 s
  Memory: 15.606502532958984 GB (13791.3203125 MB free)
  Uptime: 1136.99 sec
  Load Avg:  1.08  1.07  0.86
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Runtime information

Runtime Info
BLAS #threads	2
`BLAS.vendor()`	`lbt`
`Sys.CPU_THREADS`	4

lscpu output:

Architecture:                       x86_64
CPU op-mode(s):                     32-bit, 64-bit
Address sizes:                      48 bits physical, 48 bits virtual
Byte Order:                         Little Endian
CPU(s):                             4
On-line CPU(s) list:                0-3
Vendor ID:                          AuthenticAMD
Model name:                         AMD EPYC 7763 64-Core Processor
CPU family:                         25
Model:                              1
Thread(s) per core:                 2
Core(s) per socket:                 2
Socket(s):                          1
Stepping:                           1
BogoMIPS:                           4890.85
Flags:                              fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm constant_tsc rep_good nopl tsc_reliable nonstop_tsc cpuid extd_apicid aperfmperf pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext invpcid_single vmmcall fsgsbase bmi1 avx2 smep bmi2 erms invpcid rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr rdpru arat npt nrip_save tsc_scale vmcb_clean flushbyasid decodeassists pausefilter pfthreshold v_vmsave_vmload umip vaes vpclmulqdq rdpid fsrm
Virtualization:                     AMD-V
Hypervisor vendor:                  Microsoft
Virtualization type:                full
L1d cache:                          64 KiB (2 instances)
L1i cache:                          64 KiB (2 instances)
L2 cache:                           1 MiB (2 instances)
L3 cache:                           32 MiB (1 instance)
NUMA node(s):                       1
NUMA node0 CPU(s):                  0-3
Vulnerability Gather data sampling: Not affected
Vulnerability Itlb multihit:        Not affected
Vulnerability L1tf:                 Not affected
Vulnerability Mds:                  Not affected
Vulnerability Meltdown:             Not affected
Vulnerability Mmio stale data:      Not affected
Vulnerability Retbleed:             Not affected
Vulnerability Spec rstack overflow: Vulnerable: Safe RET, no microcode
Vulnerability Spec store bypass:    Vulnerable
Vulnerability Spectre v1:           Mitigation; usercopy/swapgs barriers and __user pointer sanitization
Vulnerability Spectre v2:           Mitigation; Retpolines; STIBP disabled; RSB filling; PBRSB-eIBRS Not affected; BHI Not affected
Vulnerability Srbds:                Not affected
Vulnerability Tsx async abort:      Not affected

Cpu Property	Value
Brand	AMD EPYC 7763 64-Core Processor
Vendor	:AMD
Architecture	:Unknown
Model	Family: 0xaf, Model: 0x01, Stepping: 0x01, Type: 0x00
Cores	16 physical cores, 16 logical cores (on executing CPU)
	No Hyperthreading hardware capability detected
Clock Frequencies	Not supported by CPU
Data Cache	Level 1:3 : (32, 512, 32768) kbytes
	64 byte cache line size
Address Size	48 bits virtual, 48 bits physical
SIMD	256 bit = 32 byte max. SIMD vector size
Time Stamp Counter	TSC is accessible via `rdtsc`
	TSC runs at constant rate (invariant from clock frequency)
Perf. Monitoring	Performance Monitoring Counters (PMC) are not supported
Hypervisor	Yes, Microsoft

adrhill added 14 commits May 15, 2024 18:52

Add operators

957d997

Rename tracers

194adab

Add Dual and accessor functions

dad5e94

Fix ops

c29e035

Update ops

15a2ccf

Please the code coverage docs

5205fb3

Fix typos

1124a84

Monkey-patch operator classific. on min/max

a4db872

Refactor GradientTracer overload

ce5c172

First draft of Dual GradientTracer

6cb875b

add draft for local HessianTracer

b1610ca

Add Hessian overloads on functions 1-to-2

2a0e77d

Update pattern

2c19273

Get local GradientTracer to work

cd5c3ab

adrhill mentioned this pull request May 15, 2024

Add tests for local derivatives #66

Closed

gdalle reviewed May 16, 2024

View reviewed changes

This was referenced May 16, 2024

Support for linear algebra #68

Closed

Sparsity detection fallback method gdalle/DifferentiationInterface.jl#263

Closed

adrhill added 12 commits May 16, 2024 12:03

Remove overload on rem

6c462ae

Help Julia specialize

2f12b8f

Refactor GradientTracer overloads

c3a14aa

Add local first order tests

5fc8218

Minor fixes

a9cffc8

Test on logdet (#68)

efcd18e

Overload comparisons

d9566bb

Remove constant functions from operators.jl

86c6a44

Start adding conversions on duals

424f5a0

Support Dual GradientTracer on ^ and rand

40b27d1

First draft of similar on Duals

770a129

Remove @eval from conversion.jl

951b157

adrhill added 2 commits May 16, 2024 17:26

Minor changes to GradientTracer overloads

52cf2e5

Fixes

103cf56

adrhill added 4 commits May 16, 2024 17:48

omg

9f0b516

omgv2

f72d310

Fix docstring test

e92dcd4

More tests

7ce3d80

gdalle reviewed May 16, 2024

View reviewed changes

adrhill added 5 commits May 16, 2024 22:25

Update tests

68a2310

Fixes

d7b9402

Remove 2_to_1_one_tracer functions

c5edf82

Remove random number TODO

01b6435

Fix hessian_tracer_1_to_1 according to review

609120e

adrhill mentioned this pull request May 16, 2024

Add overloads for Base functions needed for tracing through matrix exponential from ExponentialUtilities #55

Closed

adrhill added 5 commits May 17, 2024 14:01

Fix similar

f0217f4

Update docs

db6929f

Add local_connectivity_pattern

3257e48

Fix similar v2

82f0514

Fix docs

923c5f0

Add MissingPrimalError

5c14422

adrhill marked this pull request as ready for review May 17, 2024 13:37

adrhill added the run benchmark Run benchmarks in CI label May 17, 2024

adrhill merged commit 3e093db into main May 17, 2024
4 checks passed

adrhill deleted the ah/local branch May 17, 2024 14:06

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Add local tracers #65

Add local tracers #65

adrhill commented May 15, 2024

gdalle left a comment

adrhill commented May 16, 2024

gdalle left a comment

codecov-commenter commented May 16, 2024

adrhill commented May 16, 2024

gdalle commented May 17, 2024

gdalle commented May 17, 2024

gdalle commented May 17, 2024

github-actions bot commented May 17, 2024

Judge result

Benchmark Report for /home/runner/work/SparseConnectivityTracer.jl/SparseConnectivityTracer.jl

Job Properties

Results

Benchmark Group List

Julia versioninfo

Target

Baseline

Target result

Benchmark Report for /home/runner/work/SparseConnectivityTracer.jl/SparseConnectivityTracer.jl

Job Properties

Results

Benchmark Group List

Julia versioninfo

Baseline result

Benchmark Report for /home/runner/work/SparseConnectivityTracer.jl/SparseConnectivityTracer.jl

Job Properties

Results

Benchmark Group List

Julia versioninfo

Runtime information

Add local tracers #65

Add local tracers #65

Conversation

adrhill commented May 15, 2024

gdalle left a comment

Choose a reason for hiding this comment

adrhill commented May 16, 2024

gdalle left a comment

Choose a reason for hiding this comment

codecov-commenter commented May 16, 2024

Codecov Report

adrhill commented May 16, 2024

gdalle commented May 17, 2024

gdalle commented May 17, 2024

gdalle commented May 17, 2024

github-actions bot commented May 17, 2024

Judge result

Benchmark Report for /home/runner/work/SparseConnectivityTracer.jl/SparseConnectivityTracer.jl

Job Properties

Results

Benchmark Group List

Julia versioninfo

Target

Baseline

Target result

Benchmark Report for /home/runner/work/SparseConnectivityTracer.jl/SparseConnectivityTracer.jl

Job Properties

Results

Benchmark Group List

Julia versioninfo

Baseline result

Benchmark Report for /home/runner/work/SparseConnectivityTracer.jl/SparseConnectivityTracer.jl

Job Properties

Results

Benchmark Group List

Julia versioninfo

Runtime information