Revert exe tests

[locallycompact]

Fixes the plutus tests being sidestepped due to the golden files being regenerated on each run.

---

• CHANGELOG updated or not needed
• Documentation updated or not needed
• Haddocks updated or not needed
• No new TODOs introduced or explained herafter

[github-actions]

Test Results

436 tests  +9   424 ✅ +9   14m 37s ⏱️ -4s
143 suites +4    12 💤 ±0 
  5 files   +3     0 ❌ ±0 

Results for commit 5b57d9e. ± Comparison against base commit f01be71.

♻️ This comment has been updated with latest results.

[github-actions]

Transactions Costs

Sizes and execution budgets for Hydra protocol transactions. Note that unlisted parameters are currently using arbitrary values and results are not fully deterministic and comparable to previous runs.

Metadata
Generated at	2024-05-29 13:20:52.584895277 UTC
Max. memory units	14000000
Max. CPU units	10000000000
Max. tx size (kB)	16384

Script summary

Name	Hash	Size (Bytes)
νInitial	baafeb5dc37bbe6e068784746bda0a3b1bb1d034fa0c55270f6079c1	4082
νCommit	fe7af84822bcba542fae377ae7311fc5fd20152f925ccd980f73ecdc	2061
νHead	93c08c55e804d7f82ca545a01883b5fda6a6d3623cb78885625800ae	9366
μHead	5e65c73722b4bb3f0cbfcc8433e1dcdfea099eaf0a43060f1731a65b*	4237

• The minting policy hash is only usable for comparison. As the script is parameterized, the actual script is unique per Head.

Cost of Init Transaction

Parties	Tx size	% max Mem	% max CPU	Min fee ₳
1	4816	5.89	2.31	0.43
2	5020	7.27	2.86	0.45
3	5221	8.93	3.52	0.48
5	5625	11.54	4.54	0.52
10	6629	18.51	7.29	0.64
58	16278	86.00	33.91	1.81

Cost of Commit Transaction

This is using ada-only outputs for better comparability.

UTxO	Tx size	% max Mem	% max CPU	Min fee ₳
1	556	9.69	3.82	0.28
2	746	12.48	5.10	0.32
3	933	15.33	6.40	0.36
5	1309	21.26	9.09	0.45
10	2246	37.35	16.27	0.67
25	5056	96.42	41.75	1.45

Cost of CollectCom Transaction

Parties	UTxO (bytes)	Tx size	% max Mem	% max CPU	Min fee ₳
1	57	548	14.78	5.90	0.34
2	114	654	23.43	9.46	0.44
3	170	764	32.40	13.25	0.54
4	224	874	44.59	18.35	0.68
5	283	984	60.04	24.74	0.86
6	338	1095	74.77	30.98	1.03
7	393	1205	89.94	37.48	1.20

Cost of Close Transaction

Parties	Tx size	% max Mem	% max CPU	Min fee ₳
1	564	7.99	3.81	0.27
2	722	8.97	5.64	0.30
3	819	9.26	6.37	0.31
5	1287	12.34	9.86	0.38
10	1211	13.35	7.06	0.36
50	8153	49.35	62.86	1.36

Cost of Contest Transaction

Parties	Tx size	% max Mem	% max CPU	Min fee ₳
1	645	8.60	4.73	0.28
2	716	8.92	5.45	0.29
3	900	10.10	6.88	0.32
5	1174	11.55	9.02	0.36
10	1998	16.77	15.68	0.49
50	7928	49.06	61.93	1.34

Cost of Abort Transaction

Some variation because of random mixture of still initial and already committed outputs.

Parties	Tx size	% max Mem	% max CPU	Min fee ₳
1	4608	13.84	5.73	0.51
2	4811	27.78	12.11	0.67
3	4879	39.59	17.27	0.81
4	5114	57.30	25.23	1.02
5	5166	71.47	31.29	1.18
6	5415	99.98	44.09	1.51

Cost of FanOut Transaction

Involves spending head output and burning head tokens. Uses ada-only UTxO for better comparability.

Parties	UTxO	UTxO (bytes)	Tx size	% max Mem	% max CPU	Min fee ₳
5	0	0	4651	7.82	3.27	0.44
5	1	57	4686	9.39	4.16	0.46
5	5	285	4822	13.58	6.83	0.52
5	10	571	4992	19.34	10.39	0.60
5	20	1139	5331	30.87	17.52	0.76
5	30	1709	5673	43.03	24.92	0.93
5	40	2278	6012	53.72	31.71	1.08
5	50	2847	6350	65.47	38.94	1.24
5	79	4497	7333	99.18	59.76	1.71

End-To-End Benchmark Results

This page is intended to collect the latest end-to-end benchmarks results produced by Hydra's Continuous Integration system from the latest master code.

Please take those results with a grain of salt as they are currently produced from very limited cloud VMs and not controlled hardware. Instead of focusing on the absolute results, the emphasis should be on relative results, eg. how the timings for a scenario evolve as the code changes.

Generated at 2024-05-29 13:23:03.116561479 UTC

Baseline Scenario

Number of nodes	1
Number of txs	3000
Avg. Confirmation Time (ms)	4.097185812
P99	12.554483749999996ms
P95	4.876070649999999ms
P50	3.850821ms
Number of Invalid txs	0

Three local nodes

Number of nodes	3
Number of txs	9000
Avg. Confirmation Time (ms)	22.445838694
P99	109.76333664000002ms
P95	33.07019595ms
P50	19.6875805ms
Number of Invalid txs	0