Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

💸 Smoke tests do commit some ADA (for TVL) #1377

Merged
merged 7 commits into from
Mar 28, 2024
Merged

Conversation

ffakenz
Copy link
Contributor

@ffakenz ffakenz commented Mar 27, 2024

Commit some tADA on full head life-cycle scenario.

This enhances our smoke tests as the explorer now reflects an increase in TVL.


  • CHANGELOG updated or not needed
  • Documentation updated or not needed
  • Haddocks updated or not needed
  • No new TODOs introduced or explained herafter

@ffakenz ffakenz self-assigned this Mar 27, 2024
@ffakenz ffakenz requested a review from a team March 27, 2024 13:40
@ffakenz ffakenz changed the title 💸 Commit some TADA on full head life-cycle scenario 💸 Smoke tests do commit some ADA (for TVL) Mar 27, 2024
Copy link

github-actions bot commented Mar 27, 2024

Transactions Costs

Sizes and execution budgets for Hydra protocol transactions. Note that unlisted parameters are currently using arbitrary values and results are not fully deterministic and comparable to previous runs.

Metadata
Generated at 2024-03-28 09:09:25.345687873 UTC
Max. memory units 14000000
Max. CPU units 10000000000
Max. tx size (kB) 16384

Script summary

Name Hash Size (Bytes)
νInitial bccf2a430c016bc960fbf31b02694011cd399d20da8882aac9d33611 4110
νCommit 56b0f0b597150e619c76bed60683f3b1e42d7bc0685ed951b882bfc5 1975
νHead 86bff95ba20e9d1d1b34899a56d86bbacc9fed999260b27dcc92d128 9351
μHead 88f533cf67cd0fc93d7d9ccf0a8b1d69ffd1208a825efbebbc1d36ba* 4213
  • The minting policy hash is only usable for comparison. As the script is parameterized, the actual script is unique per Head.

Cost of Init Transaction

Parties Tx size % max Mem % max CPU Min fee ₳
1 4794 8.89 3.40 0.46
2 4996 10.81 4.13 0.49
3 5201 12.76 4.89 0.52
5 5599 16.43 6.29 0.57
10 6604 26.22 10.05 0.73
48 14244 99.77 38.28 1.86

Cost of Commit Transaction

This is using ada-only outputs for better comparability.

UTxO Tx size % max Mem % max CPU Min fee ₳
1 594 10.24 4.04 0.29
2 776 13.88 5.64 0.34
3 969 17.66 7.29 0.39
5 1342 25.66 10.74 0.49
10 2278 48.19 20.30 0.79
19 3968 97.83 40.79 1.41

Cost of CollectCom Transaction

Parties UTxO (bytes) Tx size % max Mem % max CPU Min fee ₳
1 56 543 16.52 6.53 0.35
2 114 658 26.80 10.68 0.47
3 170 764 37.43 15.08 0.59
4 227 878 51.36 20.81 0.75
5 284 988 68.32 27.76 0.95
6 340 1095 87.52 35.62 1.16

Cost of Close Transaction

Parties Tx size % max Mem % max CPU Min fee ₳
1 611 8.34 4.63 0.28
2 726 9.04 5.67 0.30
3 819 9.17 6.33 0.31
5 1124 10.90 8.75 0.35
10 1952 15.60 15.06 0.47
50 4804 40.47 24.75 0.87

Cost of Contest Transaction

Parties Tx size % max Mem % max CPU Min fee ₳
1 577 8.24 4.39 0.27
2 769 9.38 5.81 0.30
3 936 10.43 7.17 0.33
5 1175 11.35 8.94 0.36
10 2006 16.00 15.24 0.48
50 8166 52.95 64.40 1.40

Cost of Abort Transaction

Some variation because of random mixture of still initial and already committed outputs.

Parties Tx size % max Mem % max CPU Min fee ₳
1 4669 16.96 7.33 0.55
2 4786 27.89 12.15 0.67
3 4852 39.67 17.30 0.81
4 5080 58.34 25.62 1.03
5 5152 71.10 31.16 1.18
6 5264 88.17 38.57 1.37

Cost of FanOut Transaction

Involves spending head output and burning head tokens. Uses ada-only UTxO for better comparability.

Parties UTxO UTxO (bytes) Tx size % max Mem % max CPU Min fee ₳
5 0 0 4627 8.27 3.45 0.45
5 1 56 4660 9.00 3.99 0.46
5 5 284 4796 13.61 6.84 0.52
5 10 570 4967 19.16 10.31 0.60
5 20 1139 5307 30.48 17.36 0.76
5 30 1709 5649 42.43 24.67 0.92
5 40 2277 5986 54.38 31.98 1.08
5 50 2848 6328 65.92 39.13 1.24
5 79 4495 7308 98.79 59.59 1.70

End-To-End Benchmark Results

This page is intended to collect the latest end-to-end benchmarks results produced by Hydra's Continuous Integration system from the latest master code.

Please take those results with a grain of salt as they are currently produced from very limited cloud VMs and not controlled hardware. Instead of focusing on the absolute results, the emphasis should be on relative results, eg. how the timings for a scenario evolve as the code changes.

Generated at 2024-03-28 09:13:23.140289437 UTC

Baseline Scenario

Number of nodes 3
Number of txs 9000
Avg. Confirmation Time (ms) 22.288383418
P99 55.48894175000009ms
P95 32.09850145ms
P50 20.018864ms
Number of Invalid txs 0

Baseline Scenario

Number of nodes 1
Number of txs 3000
Avg. Confirmation Time (ms) 4.639119692
P99 6.96866272999999ms
P95 5.857265849999997ms
P50 4.491244999999999ms
Number of Invalid txs 0

Copy link
Member

@ch1bo ch1bo left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice. This seems to work!

image

hydra-cluster/src/Hydra/Cluster/Scenarios.hs Outdated Show resolved Hide resolved
@ch1bo
Copy link
Member

ch1bo commented Mar 27, 2024

Unfortunately this is broken in the CI: https://github.com/input-output-hk/hydra/actions/runs/8452757942/job/23153858298?pr=1377

(I did test it manually using cabal above so this is likely just missing the alice-funds key to be part of the nix build)

@ffakenz ffakenz force-pushed the smoke-tests-commit-tada branch 2 times, most recently from c76e952 to 588919c Compare March 27, 2024 14:57
Copy link

github-actions bot commented Mar 27, 2024

Test Results

425 tests   418 ✅  15m 16s ⏱️
138 suites    7 💤
  5 files      0 ❌

Results for commit 62656e5.

♻️ This comment has been updated with latest results.

@ffakenz ffakenz requested a review from ch1bo March 27, 2024 16:59
Copy link
Member

@ch1bo ch1bo left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Left some more suggestions. Change looks good though.

hydra-cluster/src/Hydra/Cluster/Util.hs Show resolved Hide resolved
hydra-cluster/src/Hydra/Cluster/Fixture.hs Outdated Show resolved Hide resolved
@ffakenz ffakenz force-pushed the smoke-tests-commit-tada branch from 601b5a1 to 62656e5 Compare March 28, 2024 09:06
@ffakenz ffakenz merged commit 9a6a5ed into master Mar 28, 2024
23 checks passed
@ffakenz ffakenz deleted the smoke-tests-commit-tada branch March 28, 2024 09:52
@ch1bo ch1bo added this to the 0.16.0 milestone Apr 3, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants