Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Monthly report November 2023 #1189

Merged
14 commits merged into from
Dec 4, 2023
Merged

Monthly report November 2023 #1189

14 commits merged into from
Dec 4, 2023

Conversation

ch1bo
Copy link
Member

@ch1bo ch1bo commented Nov 30, 2023

Report of the last month with only a few sections beside the usual roadmap update.


  • CHANGELOG updated or not needed
  • Documentation updated or not needed
  • Haddocks updated or not needed
  • No new TODOs introduced or explained herafter

Copy link

github-actions bot commented Nov 30, 2023

Test Results

373 tests  ±0   368 ✔️ ±0   20m 39s ⏱️ -43s
127 suites ±0       5 💤 ±0 
    5 files   ±0       0 ±0 

Results for commit 48efff6. ± Comparison against base commit d6ef7a0.

♻️ This comment has been updated with latest results.

Copy link

github-actions bot commented Nov 30, 2023

Transactions Costs

Sizes and execution budgets for Hydra protocol transactions. Note that unlisted parameters are currently using arbitrary values and results are not fully deterministic and comparable to previous runs.

Metadata
Generated at 2023-12-04 13:01:58.767382514 UTC
Max. memory units 14000000
Max. CPU units 10000000000
Max. tx size (kB) 16384

Script summary

Name Hash Size (Bytes)
νInitial 4868d5365af5120ae0b3c93b819d3452a3cbdcc98595da2a7ae765b5 4069
νCommit 171a1e6bdbc8aa96d957a65b3f505517386af06ba265e3f784741f67 2050
νHead e89b0c4a6155bac2434d1e500bd49c155b2b56744ccf5a0efa72a82e 9092
μHead 6849328242b5912ad218f134378e6baff11f3e74f7e36dcf8e13d53e* 4062
  • The minting policy hash is only usable for comparison. As the script is parameterized, the actual script is unique per Head.

Cost of Init Transaction

Parties Tx size % max Mem % max CPU Min fee ₳
1 4585 11.01 4.37 0.47
2 4786 13.13 5.18 0.50
3 4987 15.35 6.02 0.54
5 5388 19.85 7.74 0.60
10 6393 30.97 11.99 0.77
41 12628 99.61 38.18 1.79

Cost of Commit Transaction

This is using ada-only outputs for better comparability.

UTxO Tx size % max Mem % max CPU Min fee ₳
1 534 12.22 4.81 0.31
2 721 15.93 6.48 0.36
3 911 19.77 8.20 0.41
5 1284 27.87 11.80 0.52
10 2223 50.58 21.69 0.81
18 3728 94.20 40.16 1.36

Cost of CollectCom Transaction

Parties UTxO (bytes) Tx size % max Mem % max CPU Min fee ₳
1 57 484 22.24 8.89 0.42
2 114 590 35.64 14.32 0.57
3 169 700 50.50 20.42 0.74
4 227 810 64.62 26.35 0.90
5 283 920 85.65 34.95 1.13

Cost of Close Transaction

Parties Tx size % max Mem % max CPU Min fee ₳
1 568 17.76 8.36 0.38
2 714 19.56 9.98 0.41
3 942 21.19 11.60 0.45
5 1277 24.47 14.73 0.51
10 2237 32.98 22.77 0.68
50 8995 96.89 83.65 1.93

Cost of Contest Transaction

Parties Tx size % max Mem % max CPU Min fee ₳
1 570 21.37 9.71 0.42
2 789 23.18 11.39 0.45
3 903 24.73 12.74 0.48
5 1309 28.88 16.41 0.56
10 2183 38.07 24.60 0.73
45 8057 99.76 79.92 1.89

Cost of Abort Transaction

Some variation because of random mixture of still initial and already committed outputs.

Parties Tx size % max Mem % max CPU Min fee ₳
1 4528 20.10 8.74 0.57
2 4689 33.57 14.79 0.73
3 4858 50.81 22.49 0.94
4 5057 70.38 31.26 1.17
5 5238 92.34 41.12 1.42

Cost of FanOut Transaction

Involves spending head output and burning head tokens. Uses ada-only UTxO for better comparability.

Parties UTxO UTxO (bytes) Tx size % max Mem % max CPU Min fee ₳
5 0 0 4417 8.98 3.78 0.44
5 1 56 4451 10.37 4.61 0.46
5 5 282 4594 15.56 7.79 0.53
5 10 566 4772 22.18 11.81 0.62
5 20 1138 5134 35.16 19.75 0.80
5 30 1706 5495 47.77 27.55 0.98
5 40 2276 5855 60.99 35.59 1.16
5 50 2845 6213 73.98 43.55 1.34
5 70 3983 6932 99.87 59.42 1.69

End-To-End Benchmark Results

This page is intended to collect the latest end-to-end benchmarks results produced by Hydra's Continuous Integration system from the latest master code.

Please take those results with a grain of salt as they are currently produced from very limited cloud VMs and not controlled hardware. Instead of focusing on the absolute results, the emphasis should be on relative results, eg. how the timings for a scenario evolve as the code changes.

Generated at 2023-12-04 12:54:32.913417241 UTC

3-nodes Scenario

A rather typical setup, with 3 nodes forming a Hydra head.

Number of nodes 3
Number of txs 900
Avg. Confirmation Time (ms) 26.556535605
P99 126.74550861ms
P95 35.08760024999998ms
P50 20.640074ms
Number of Invalid txs 0

Baseline Scenario

This scenario represents a minimal case and as such is a good baseline against which to assess the overhead introduced by more complex setups. There is a single hydra-node d with a single client submitting single input and single output transactions with a constant UTxO set of 1.

Number of nodes 1
Number of txs 300
Avg. Confirmation Time (ms) 4.041028066
P99 5.260613269999994ms
P95 4.86475085ms
P50 3.9277745ms
Number of Invalid txs 0

@ghost ghost requested a review from olgahryniuk December 1, 2023 12:45
@ghost ghost marked this pull request as ready for review December 1, 2023 13:12
@ghost ghost force-pushed the monthly-11-2023 branch from b286e51 to f643a22 Compare December 1, 2023 13:12
docs/monthly/2023-11-monthly.md Outdated Show resolved Hide resolved
docs/monthly/2023-11-monthly.md Outdated Show resolved Hide resolved
docs/monthly/2023-11-monthly.md Outdated Show resolved Hide resolved
docs/monthly/2023-11-monthly.md Outdated Show resolved Hide resolved
docs/monthly/2023-11-monthly.md Outdated Show resolved Hide resolved
docs/monthly/2023-11-monthly.md Outdated Show resolved Hide resolved
docs/monthly/2023-11-monthly.md Outdated Show resolved Hide resolved
docs/monthly/2023-11-monthly.md Outdated Show resolved Hide resolved
docs/monthly/2023-11-monthly.md Outdated Show resolved Hide resolved
docs/monthly/2023-11-monthly.md Outdated Show resolved Hide resolved
docs/monthly/2023-11-monthly.md Outdated Show resolved Hide resolved
docs/monthly/2023-11-monthly.md Outdated Show resolved Hide resolved
docs/monthly/2023-11-monthly.md Outdated Show resolved Hide resolved
docs/monthly/2023-11-monthly.md Outdated Show resolved Hide resolved
docs/monthly/2023-11-monthly.md Outdated Show resolved Hide resolved
docs/monthly/2023-11-monthly.md Outdated Show resolved Hide resolved
docs/monthly/2023-11-monthly.md Outdated Show resolved Hide resolved
docs/monthly/2023-11-monthly.md Outdated Show resolved Hide resolved
docs/monthly/2023-11-monthly.md Outdated Show resolved Hide resolved
docs/monthly/2023-11-monthly.md Outdated Show resolved Hide resolved
(which are _still_ heavily used in the spec). From this we want to have both, a
PDF and HTML rendering.

TODO GIF sebastian
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

You can use this URL which is an IPFS-published version of the GIF: https://gateway.pinata.cloud/ipfs/QmPUTYaSViLEyZcGmsTPL4jHdGSevH3yc3RD7TRhU3ivwH

docs/monthly/2023-11-monthly.md Outdated Show resolved Hide resolved
@ghost ghost requested a review from NeilBurgess42 December 4, 2023 11:18
@ghost
Copy link

ghost commented Dec 4, 2023

@olgahryniuk @NeilBurgess42 I applied your change, could you approve so that we can publish?

Copy link
Contributor

@NeilBurgess42 NeilBurgess42 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I have left some first-person plural references in the conclusion because the intent is clear.

ch1bo and others added 14 commits December 4, 2023 13:50
Co-authored-by: NeilBurgess42 <neil@neilburgess.com.au>
Co-authored-by: NeilBurgess42 <neil@neilburgess.com.au>
Co-authored-by: NeilBurgess42 <neil@neilburgess.com.au>
Co-authored-by: NeilBurgess42 <neil@neilburgess.com.au>
Co-authored-by: olgahryniuk <67585499+olgahryniuk@users.noreply.github.com>
Co-authored-by: olgahryniuk <67585499+olgahryniuk@users.noreply.github.com>
@ghost ghost force-pushed the monthly-11-2023 branch from 2c80629 to 48efff6 Compare December 4, 2023 12:50
@ghost ghost merged commit 66d10b8 into master Dec 4, 2023
21 checks passed
@ghost ghost deleted the monthly-11-2023 branch December 4, 2023 13:21
This pull request was closed.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants