Run multiple pre-defined benchmarks

[ghost]

This PR introduces the ability for ETE benchmarks to run multiple pre-defined datasets and group their results into a single output. The idea is that this will allow checking in well-known datasets, representative of behaviour we want to optimise for or track, and compare the evolution of their performance over time.

The comparison part is still pending.

---

• CHANGELOG updated or not needed
• Documentation updated or not needed
• Haddocks updated or not needed
• No new TODOs introduced or explained herafter

[github-actions]

Test Results

330 tests  ±0   324 ✔️ ±0   20m 39s ⏱️ - 4m 36s
111 suites ±0       6 💤 ±0 
    6 files   ±0       0 ❌ ±0 

Results for commit bd82fbe. ± Comparison against base commit 531ccca.

♻️ This comment has been updated with latest results.

[github-actions]

Transactions Costs

Sizes and execution budgets for Hydra protocol transactions. Note that unlisted parameters are currently using arbitrary values and results are not fully deterministic and comparable to previous runs.

Metadata
Generated at	2023-07-03 12:33:50.909113537 UTC
Max. memory units	14000000
Max. CPU units	10000000000
Max. tx size (kB)	16384

Script summary

Name	Hash	Size (Bytes)
νInitial	2212a4ee618434b9b2f366d7c330dbdfb5c7072e793a850fd0de6ddd	4294
νCommit	69e1ccf9ad73dc6d37a5bc8de5aec86f3c4c1710fe5fd334e0e16b18	2124
νHead	8ae095dca4d14a1b8edffb37faa6c84ec60340fbf389a62f027e0b76	9355
μHead	33642a45c7fbb955ce1704ef09229bb211bf9af9980530db28c6aafe*	4148

• The minting policy hash is only usable for comparison. As the script is parameterized, the actual script is unique per Head.

Cost of Init Transaction

Parties	Tx size	% max Mem	% max CPU	Min fee ₳
1	4742	12.54	4.90	0.50
2	4947	16.64	6.51	0.55
3	5152	19.52	7.62	0.59
5	5559	23.65	9.15	0.65
10	6586	34.24	13.10	0.81
37	12121	97.89	37.09	1.74

Cost of Commit Transaction

This is using ada-only outputs for better comparability.

UTxO	Tx size	% max Mem	% max CPU	Min fee ₳
1	596	14.98	5.74	0.34
2	784	19.57	7.70	0.40
3	970	24.75	9.88	0.46
5	1350	36.07	14.56	0.61
10	2278	71.73	28.85	1.04
13	2845	98.03	39.15	1.35

Cost of CollectCom Transaction

Parties	UTxO (bytes)	Tx size	% max Mem	% max CPU	Min fee ₳
1	57	815	27.63	10.73	0.49
2	114	1143	43.42	16.99	0.67
3	169	1453	61.70	24.31	0.89
4	226	1775	82.36	32.59	1.13

Cost of Close Transaction

Parties	Tx size	% max Mem	% max CPU	Min fee ₳
1	672	19.03	8.65	0.40
2	804	20.27	9.68	0.42
3	770	18.49	7.81	0.39
5	1291	24.46	13.45	0.50
10	2124	31.42	19.73	0.64
50	8725	86.87	69.87	1.74

Cost of Contest Transaction

Parties	Tx size	% max Mem	% max CPU	Min fee ₳
1	708	25.22	10.98	0.46
2	840	26.49	12.01	0.49
3	1013	27.77	13.21	0.51
5	1335	31.63	16.12	0.58
10	2161	40.20	22.97	0.74
45	7938	99.74	70.74	1.82

Cost of Abort Transaction

Some variation because of random mixture of still initial and already committed outputs.

Parties	Tx size	% max Mem	% max CPU	Min fee ₳
1	4858	22.40	9.38	0.61
2	5174	36.76	15.59	0.79
3	5496	53.72	22.99	0.99
4	5818	73.47	31.59	1.23
5	5997	90.55	38.85	1.43

Cost of FanOut Transaction

Involves spending head output and burning head tokens. Uses ada-only UTxO for better comparability.

Parties	UTxO	UTxO (bytes)	Tx size	% max Mem	% max CPU	Min fee ₳
5	0	0	4761	8.66	3.57	0.46
5	1	57	4800	10.06	4.39	0.47
5	5	285	4949	15.64	7.69	0.55
5	10	571	5130	22.61	11.82	0.64
5	20	1137	5479	36.56	20.07	0.83
5	30	1706	5842	50.52	28.33	1.02
5	40	2280	6206	64.49	36.60	1.21
5	50	2847	6563	78.46	44.87	1.40
5	65	3701	7102	99.42	57.28	1.68

[v0d1ch]

BAM!