benchmark suite

[plusk01]

introduces a benchmark suite to test and verify algorithmic changes and their effects on timing and precision/recall.

For example, when run on 14d0e6f, the output looks like

Benchmarking over 20 trials


Benchmarking ρ = 90% [██████████████████████████████████████████████████] 100% [01m:16s]               

+-------+---------+---------------+-------------------+---------------+------------+
| ρ [%] | # assoc | affinity [ms] | dense clique [ms] | precision [%] | recall [%] |
+-------+---------+---------------+-------------------+---------------+------------+
| 0     | 64      |  0.28  ±  0.3 |      0.03  ±  0.0 | 100           | 89         |
| 0     | 256     |  0.81  ±  0.1 |      0.33  ±  0.0 | 100           | 89         |
| 0     | 512     |  2.97  ±  0.7 |      1.76  ±  0.0 | 100           | 89         |
| 0     | 1024    | 21.83  ±  1.2 |     11.33  ±  0.0 | 100           | 89         |
| 0     | 2048    | 91.30  ±  3.3 |     73.38  ±  4.1 | 100           | 89         |
+-------+---------+---------------+-------------------+---------------+------------+
| 20    | 64      |  0.22  ±  0.0 |      0.08  ±  0.0 | 100           | 89         |
| 20    | 256     |  0.81  ±  0.1 |      1.19  ±  0.2 | 100           | 89         |
| 20    | 512     |  3.20  ±  0.3 |      8.98  ±  1.3 | 100           | 89         |
| 20    | 1024    | 22.34  ±  0.6 |     48.96  ±  5.7 | 100           | 89         |
| 20    | 2048    | 90.52  ±  3.1 |    356.03  ± 60.0 | 99            | 89         |
+-------+---------+---------------+-------------------+---------------+------------+
| 40    | 64      |  0.23  ±  0.0 |      0.10  ±  0.0 | 100           | 89         |
| 40    | 256     |  0.80  ±  0.1 |      1.48  ±  0.1 | 100           | 89         |
| 40    | 512     |  3.32  ±  0.4 |     10.43  ±  1.4 | 99            | 89         |
| 40    | 1024    | 22.54  ±  0.3 |     57.56  ±  6.4 | 100           | 89         |
| 40    | 2048    | 90.50  ±  3.1 |    415.87  ± 71.5 | 99            | 89         |
+-------+---------+---------------+-------------------+---------------+------------+
| 80    | 64      |  0.21  ±  0.0 |      0.14  ±  0.0 | 99            | 91         |
| 80    | 256     |  0.80  ±  0.1 |      1.74  ±  0.2 | 100           | 90         |
| 80    | 512     |  3.48  ±  0.4 |     12.50  ±  1.5 | 99            | 89         |
| 80    | 1024    | 22.26  ±  0.2 |     77.04  ± 18.3 | 99            | 89         |
| 80    | 2048    | 90.14  ±  2.3 |    473.96  ± 66.6 | 99            | 89         |
+-------+---------+---------------+-------------------+---------------+------------+
| 90    | 64      |  0.22  ±  0.0 |      0.24  ±  0.0 | 100           | 92         |
| 90    | 256     |  0.81  ±  0.1 |      1.94  ±  0.3 | 99            | 90         |
| 90    | 512     |  3.62  ±  0.2 |     13.95  ±  1.3 | 99            | 90         |
| 90    | 1024    | 22.17  ±  0.2 |     78.01  ± 10.8 | 99            | 90         |
| 90    | 2048    | 90.82  ±  2.4 |    521.04  ± 81.2 | 99            | 90         |
+-------+---------+---------------+-------------------+---------------+------------+