Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

chore: improve the sim tests logs #6394

Merged
merged 2 commits into from Feb 6, 2024
Merged

chore: improve the sim tests logs #6394

merged 2 commits into from Feb 6, 2024

Conversation

nazarhussain
Copy link
Contributor

Motivation

Make sim tests more readable and easy to troubleshot.

Description

Improve the sim tests logs.

Steps to test or reproduce

  • Run all tests

@nazarhussain nazarhussain requested a review from a team as a code owner February 6, 2024 09:51
@nazarhussain nazarhussain self-assigned this Feb 6, 2024
@codecov Codecov
Copy link

codecov bot commented Feb 6, 2024 •
edited

Codecov Report

Merging #6394 (f870b6d) into unstable (c4bf385) will not change coverage.
Report is 2 commits behind head on unstable.
The diff coverage is n/a.

❗ Current head f870b6d differs from pull request most recent head de1d22f. Consider uploading reports for the commit de1d22f to get more accurate results

Additional details and impacted files 
@@            Coverage Diff            @@
##           unstable    #6394   +/-   ##
=========================================
  Coverage     60.14%   60.14%           
=========================================
  Files           407      407           
  Lines         46512    46512           
  Branches       1551     1551           
=========================================
  Hits          27975    27975           
  Misses        18505    18505           
  Partials         32       32

@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Feb 6, 2024 •
edited

Performance Report

✔️ no performance regression detected

Full benchmark results
Benchmark suite Current: 5a6a662 Previous: cb754f6 Ratio
getPubkeys - index2pubkey - req 1000 vs - 250000 vc 616.31 us/op 548.88 us/op 1.12
getPubkeys - validatorsArr - req 1000 vs - 250000 vc 138.54 us/op 114.11 us/op 1.21
BLS verify - blst-native 1.4085 ms/op 1.3223 ms/op 1.07
BLS verifyMultipleSignatures 3 - blst-native 2.8942 ms/op 2.7878 ms/op 1.04
BLS verifyMultipleSignatures 8 - blst-native 6.3147 ms/op 6.1552 ms/op 1.03
BLS verifyMultipleSignatures 32 - blst-native 23.126 ms/op 22.497 ms/op 1.03
BLS verifyMultipleSignatures 64 - blst-native 45.474 ms/op 44.399 ms/op 1.02
BLS verifyMultipleSignatures 128 - blst-native 90.999 ms/op 89.758 ms/op 1.01
BLS deserializing 10000 signatures 991.87 ms/op 952.69 ms/op 1.04
BLS deserializing 100000 signatures 9.4859 s/op 9.6456 s/op 0.98
BLS verifyMultipleSignatures - same message - 3 - blst-native 1.3981 ms/op 1.3793 ms/op 1.01
BLS verifyMultipleSignatures - same message - 8 - blst-native 1.5970 ms/op 1.5217 ms/op 1.05
BLS verifyMultipleSignatures - same message - 32 - blst-native 2.4159 ms/op 2.3593 ms/op 1.02
BLS verifyMultipleSignatures - same message - 64 - blst-native 3.5459 ms/op 4.5593 ms/op 0.78
BLS verifyMultipleSignatures - same message - 128 - blst-native 5.7078 ms/op 5.9495 ms/op 0.96
BLS aggregatePubkeys 32 - blst-native 26.993 us/op 26.249 us/op 1.03
BLS aggregatePubkeys 128 - blst-native 101.82 us/op 101.79 us/op 1.00
notSeenSlots=1 numMissedVotes=1 numBadVotes=10 59.458 ms/op 53.187 ms/op 1.12
notSeenSlots=1 numMissedVotes=0 numBadVotes=4 53.710 ms/op 52.958 ms/op 1.01
notSeenSlots=2 numMissedVotes=1 numBadVotes=10 44.197 ms/op 34.074 ms/op 1.30
getSlashingsAndExits - default max 213.22 us/op 198.19 us/op 1.08
getSlashingsAndExits - 2k 465.97 us/op 591.91 us/op 0.79
proposeBlockBody type=full, size=empty 6.7188 ms/op 5.5570 ms/op 1.21
isKnown best case - 1 super set check 546.00 ns/op 560.00 ns/op 0.97
isKnown normal case - 2 super set checks 502.00 ns/op 569.00 ns/op 0.88
isKnown worse case - 16 super set checks 490.00 ns/op 536.00 ns/op 0.91
CheckpointStateCache - add get delete 6.6380 us/op 6.5020 us/op 1.02
validate api signedAggregateAndProof - struct 2.8706 ms/op 2.8785 ms/op 1.00
validate gossip signedAggregateAndProof - struct 2.8726 ms/op 2.8414 ms/op 1.01
validate gossip attestation - vc 640000 1.4253 ms/op 1.3996 ms/op 1.02
batch validate gossip attestation - vc 640000 - chunk 32 171.17 us/op 180.55 us/op 0.95
batch validate gossip attestation - vc 640000 - chunk 64 150.29 us/op 149.47 us/op 1.01
batch validate gossip attestation - vc 640000 - chunk 128 147.71 us/op 146.81 us/op 1.01
batch validate gossip attestation - vc 640000 - chunk 256 131.88 us/op 131.03 us/op 1.01
pickEth1Vote - no votes 1.1832 ms/op 1.2645 ms/op 0.94
pickEth1Vote - max votes 10.233 ms/op 13.339 ms/op 0.77
pickEth1Vote - Eth1Data hashTreeRoot value x2048 21.743 ms/op 17.733 ms/op 1.23
pickEth1Vote - Eth1Data hashTreeRoot tree x2048 28.679 ms/op 35.791 ms/op 0.80
pickEth1Vote - Eth1Data fastSerialize value x2048 612.12 us/op 624.76 us/op 0.98
pickEth1Vote - Eth1Data fastSerialize tree x2048 5.1215 ms/op 4.4230 ms/op 1.16
bytes32 toHexString 505.00 ns/op 669.00 ns/op 0.75
bytes32 Buffer.toString(hex) 282.00 ns/op 306.00 ns/op 0.92
bytes32 Buffer.toString(hex) from Uint8Array 456.00 ns/op 486.00 ns/op 0.94
bytes32 Buffer.toString(hex) + 0x 295.00 ns/op 307.00 ns/op 0.96
Object access 1 prop 0.16700 ns/op 0.20000 ns/op 0.83
Map access 1 prop 0.14400 ns/op 0.15200 ns/op 0.95
Object get x1000 7.2940 ns/op 7.6350 ns/op 0.96
Map get x1000 0.77500 ns/op 0.84500 ns/op 0.92
Object set x1000 54.429 ns/op 54.734 ns/op 0.99
Map set x1000 40.490 ns/op 43.403 ns/op 0.93
Return object 10000 times 0.24050 ns/op 0.24300 ns/op 0.99
Throw Error 10000 times 3.9566 us/op 3.8881 us/op 1.02
fastMsgIdFn sha256 / 200 bytes 3.2970 us/op 3.3520 us/op 0.98
fastMsgIdFn h32 xxhash / 200 bytes 277.00 ns/op 330.00 ns/op 0.84
fastMsgIdFn h64 xxhash / 200 bytes 345.00 ns/op 372.00 ns/op 0.93
fastMsgIdFn sha256 / 1000 bytes 11.417 us/op 11.572 us/op 0.99
fastMsgIdFn h32 xxhash / 1000 bytes 408.00 ns/op 419.00 ns/op 0.97
fastMsgIdFn h64 xxhash / 1000 bytes 411.00 ns/op 419.00 ns/op 0.98
fastMsgIdFn sha256 / 10000 bytes 103.45 us/op 102.64 us/op 1.01
fastMsgIdFn h32 xxhash / 10000 bytes 1.9620 us/op 1.9380 us/op 1.01
fastMsgIdFn h64 xxhash / 10000 bytes 1.3470 us/op 1.3200 us/op 1.02
send data - 1000 256B messages 19.999 ms/op 19.809 ms/op 1.01
send data - 1000 512B messages 28.167 ms/op 26.864 ms/op 1.05
send data - 1000 1024B messages 43.579 ms/op 38.932 ms/op 1.12
send data - 1000 1200B messages 24.275 ms/op 38.857 ms/op 0.62
send data - 1000 2048B messages 48.343 ms/op 49.694 ms/op 0.97
send data - 1000 4096B messages 45.002 ms/op 27.933 ms/op 1.61
send data - 1000 16384B messages 128.85 ms/op 115.69 ms/op 1.11
send data - 1000 65536B messages 445.74 ms/op 522.50 ms/op 0.85
enrSubnets - fastDeserialize 64 bits 1.3850 us/op 1.7090 us/op 0.81
enrSubnets - ssz BitVector 64 bits 424.00 ns/op 554.00 ns/op 0.77
enrSubnets - fastDeserialize 4 bits 168.00 ns/op 243.00 ns/op 0.69
enrSubnets - ssz BitVector 4 bits 439.00 ns/op 567.00 ns/op 0.77
prioritizePeers score -10:0 att 32-0.1 sync 2-0 100.95 us/op 121.50 us/op 0.83
prioritizePeers score 0:0 att 32-0.25 sync 2-0.25 126.21 us/op 160.07 us/op 0.79
prioritizePeers score 0:0 att 32-0.5 sync 2-0.5 162.27 us/op 220.65 us/op 0.74
prioritizePeers score 0:0 att 64-0.75 sync 4-0.75 291.78 us/op 366.45 us/op 0.80
prioritizePeers score 0:0 att 64-1 sync 4-1 339.86 us/op 399.38 us/op 0.85
array of 16000 items push then shift 1.6476 us/op 1.7211 us/op 0.96
LinkedList of 16000 items push then shift 9.0260 ns/op 10.681 ns/op 0.85
array of 16000 items push then pop 97.190 ns/op 129.35 ns/op 0.75
LinkedList of 16000 items push then pop 9.0550 ns/op 9.4230 ns/op 0.96
array of 24000 items push then shift 2.4917 us/op 2.5483 us/op 0.98
LinkedList of 24000 items push then shift 9.0500 ns/op 9.3050 ns/op 0.97
array of 24000 items push then pop 117.12 ns/op 154.67 ns/op 0.76
LinkedList of 24000 items push then pop 8.7230 ns/op 8.7480 ns/op 1.00
intersect bitArray bitLen 8 5.8230 ns/op 5.8180 ns/op 1.00
intersect array and set length 8 64.651 ns/op 66.336 ns/op 0.97
intersect bitArray bitLen 128 35.790 ns/op 36.693 ns/op 0.98
intersect array and set length 128 873.99 ns/op 967.83 ns/op 0.90
bitArray.getTrueBitIndexes() bitLen 128 1.4100 us/op 1.4640 us/op 0.96
bitArray.getTrueBitIndexes() bitLen 248 2.3670 us/op 2.4100 us/op 0.98
bitArray.getTrueBitIndexes() bitLen 512 4.6760 us/op 4.8360 us/op 0.97
Buffer.concat 32 items 936.00 ns/op 1.0870 us/op 0.86
Uint8Array.set 32 items 1.5700 us/op 1.9120 us/op 0.82
Set add up to 64 items then delete first 4.4140 us/op 4.7750 us/op 0.92
OrderedSet add up to 64 items then delete first 5.6238 us/op 5.9941 us/op 0.94
Set add up to 64 items then delete last 4.7716 us/op 5.0287 us/op 0.95
OrderedSet add up to 64 items then delete last 5.8279 us/op 6.0948 us/op 0.96
Set add up to 64 items then delete middle 4.6084 us/op 4.7583 us/op 0.97
OrderedSet add up to 64 items then delete middle 7.0681 us/op 7.1985 us/op 0.98
Set add up to 128 items then delete first 9.3812 us/op 9.7144 us/op 0.97
OrderedSet add up to 128 items then delete first 12.225 us/op 13.001 us/op 0.94
Set add up to 128 items then delete last 9.2067 us/op 9.5932 us/op 0.96
OrderedSet add up to 128 items then delete last 11.784 us/op 12.033 us/op 0.98
Set add up to 128 items then delete middle 9.2232 us/op 9.4470 us/op 0.98
OrderedSet add up to 128 items then delete middle 17.064 us/op 18.582 us/op 0.92
Set add up to 256 items then delete first 18.585 us/op 19.733 us/op 0.94
OrderedSet add up to 256 items then delete first 25.174 us/op 26.170 us/op 0.96
Set add up to 256 items then delete last 18.311 us/op 18.822 us/op 0.97
OrderedSet add up to 256 items then delete last 23.504 us/op 24.143 us/op 0.97
Set add up to 256 items then delete middle 18.250 us/op 19.523 us/op 0.93
OrderedSet add up to 256 items then delete middle 47.953 us/op 46.228 us/op 1.04
transfer serialized Status (84 B) 1.6460 us/op 1.6900 us/op 0.97
copy serialized Status (84 B) 1.2560 us/op 1.2600 us/op 1.00
transfer serialized SignedVoluntaryExit (112 B) 1.7360 us/op 1.8030 us/op 0.96
copy serialized SignedVoluntaryExit (112 B) 1.3260 us/op 1.3840 us/op 0.96
transfer serialized ProposerSlashing (416 B) 1.9000 us/op 2.0760 us/op 0.92
copy serialized ProposerSlashing (416 B) 1.7220 us/op 1.9320 us/op 0.89
transfer serialized Attestation (485 B) 2.0200 us/op 2.1590 us/op 0.94
copy serialized Attestation (485 B) 1.7660 us/op 1.9330 us/op 0.91
transfer serialized AttesterSlashing (33232 B) 2.1260 us/op 2.0500 us/op 1.04
copy serialized AttesterSlashing (33232 B) 5.0570 us/op 7.1600 us/op 0.71
transfer serialized Small SignedBeaconBlock (128000 B) 2.5340 us/op 2.6700 us/op 0.95
copy serialized Small SignedBeaconBlock (128000 B) 14.344 us/op 18.460 us/op 0.78
transfer serialized Avg SignedBeaconBlock (200000 B) 2.9560 us/op 3.1820 us/op 0.93
copy serialized Avg SignedBeaconBlock (200000 B) 21.270 us/op 30.251 us/op 0.70
transfer serialized BlobsSidecar (524380 B) 2.9210 us/op 3.7690 us/op 0.78
copy serialized BlobsSidecar (524380 B) 83.939 us/op 90.652 us/op 0.93
transfer serialized Big SignedBeaconBlock (1000000 B) 3.1350 us/op 3.9770 us/op 0.79
copy serialized Big SignedBeaconBlock (1000000 B) 164.80 us/op 165.56 us/op 1.00
pass gossip attestations to forkchoice per slot 3.8658 ms/op 4.7441 ms/op 0.81
forkChoice updateHead vc 100000 bc 64 eq 0 691.84 us/op 691.23 us/op 1.00
forkChoice updateHead vc 600000 bc 64 eq 0 4.6210 ms/op 8.8591 ms/op 0.52
forkChoice updateHead vc 1000000 bc 64 eq 0 6.9897 ms/op 7.5317 ms/op 0.93
forkChoice updateHead vc 600000 bc 320 eq 0 4.4112 ms/op 4.3029 ms/op 1.03
forkChoice updateHead vc 600000 bc 1200 eq 0 4.3981 ms/op 4.3211 ms/op 1.02
forkChoice updateHead vc 600000 bc 7200 eq 0 5.3259 ms/op 5.6189 ms/op 0.95
forkChoice updateHead vc 600000 bc 64 eq 1000 11.482 ms/op 11.190 ms/op 1.03
forkChoice updateHead vc 600000 bc 64 eq 10000 11.929 ms/op 11.894 ms/op 1.00
forkChoice updateHead vc 600000 bc 64 eq 300000 15.644 ms/op 16.394 ms/op 0.95
computeDeltas 500000 validators 300 proto nodes 7.0677 ms/op 6.6313 ms/op 1.07
computeDeltas 500000 validators 1200 proto nodes 6.8932 ms/op 6.7779 ms/op 1.02
computeDeltas 500000 validators 7200 proto nodes 6.6523 ms/op 6.6595 ms/op 1.00
computeDeltas 750000 validators 300 proto nodes 9.8872 ms/op 10.049 ms/op 0.98
computeDeltas 750000 validators 1200 proto nodes 9.6962 ms/op 9.9207 ms/op 0.98
computeDeltas 750000 validators 7200 proto nodes 10.175 ms/op 10.104 ms/op 1.01
computeDeltas 1400000 validators 300 proto nodes 18.759 ms/op 20.093 ms/op 0.93
computeDeltas 1400000 validators 1200 proto nodes 19.272 ms/op 19.740 ms/op 0.98
computeDeltas 1400000 validators 7200 proto nodes 19.904 ms/op 20.855 ms/op 0.95
computeDeltas 2100000 validators 300 proto nodes 28.182 ms/op 30.900 ms/op 0.91
computeDeltas 2100000 validators 1200 proto nodes 29.618 ms/op 30.338 ms/op 0.98
computeDeltas 2100000 validators 7200 proto nodes 30.211 ms/op 29.257 ms/op 1.03
altair processAttestation - 250000 vs - 7PWei normalcase 2.7133 ms/op 2.9732 ms/op 0.91
altair processAttestation - 250000 vs - 7PWei worstcase 4.1483 ms/op 4.2030 ms/op 0.99
altair processAttestation - setStatus - 1/6 committees join 207.30 us/op 197.11 us/op 1.05
altair processAttestation - setStatus - 1/3 committees join 400.39 us/op 380.99 us/op 1.05
altair processAttestation - setStatus - 1/2 committees join 502.72 us/op 510.41 us/op 0.98
altair processAttestation - setStatus - 2/3 committees join 633.89 us/op 623.70 us/op 1.02
altair processAttestation - setStatus - 4/5 committees join 859.59 us/op 880.31 us/op 0.98
altair processAttestation - setStatus - 100% committees join 1.0347 ms/op 1.0229 ms/op 1.01
altair processBlock - 250000 vs - 7PWei normalcase 12.152 ms/op 12.079 ms/op 1.01
altair processBlock - 250000 vs - 7PWei normalcase hashState 36.277 ms/op 37.690 ms/op 0.96
altair processBlock - 250000 vs - 7PWei worstcase 41.169 ms/op 41.652 ms/op 0.99
altair processBlock - 250000 vs - 7PWei worstcase hashState 104.50 ms/op 104.64 ms/op 1.00
phase0 processBlock - 250000 vs - 7PWei normalcase 3.6533 ms/op 3.0934 ms/op 1.18
phase0 processBlock - 250000 vs - 7PWei worstcase 33.932 ms/op 34.530 ms/op 0.98
altair processEth1Data - 250000 vs - 7PWei normalcase 626.65 us/op 715.75 us/op 0.88
getExpectedWithdrawals 250000 eb:1,eth1:1,we:0,wn:0,smpl:15 16.776 us/op 17.176 us/op 0.98
getExpectedWithdrawals 250000 eb:0.95,eth1:0.1,we:0.05,wn:0,smpl:219 66.203 us/op 50.923 us/op 1.30
getExpectedWithdrawals 250000 eb:0.95,eth1:0.3,we:0.05,wn:0,smpl:42 21.460 us/op 22.845 us/op 0.94
getExpectedWithdrawals 250000 eb:0.95,eth1:0.7,we:0.05,wn:0,smpl:18 15.273 us/op 20.326 us/op 0.75
getExpectedWithdrawals 250000 eb:0.1,eth1:0.1,we:0,wn:0,smpl:1020 192.84 us/op 221.68 us/op 0.87
getExpectedWithdrawals 250000 eb:0.03,eth1:0.03,we:0,wn:0,smpl:11777 1.2543 ms/op 1.4775 ms/op 0.85
getExpectedWithdrawals 250000 eb:0.01,eth1:0.01,we:0,wn:0,smpl:16384 2.2313 ms/op 1.8075 ms/op 1.23
getExpectedWithdrawals 250000 eb:0,eth1:0,we:0,wn:0,smpl:16384 1.8503 ms/op 1.9522 ms/op 0.95
getExpectedWithdrawals 250000 eb:0,eth1:0,we:0,wn:0,nocache,smpl:16384 4.1518 ms/op 4.5208 ms/op 0.92
getExpectedWithdrawals 250000 eb:0,eth1:1,we:0,wn:0,smpl:16384 3.4264 ms/op 2.7895 ms/op 1.23
getExpectedWithdrawals 250000 eb:0,eth1:1,we:0,wn:0,nocache,smpl:16384 5.3900 ms/op 7.0573 ms/op 0.76
Tree 40 250000 create 370.56 ms/op 374.44 ms/op 0.99
Tree 40 250000 get(125000) 219.35 ns/op 222.82 ns/op 0.98
Tree 40 250000 set(125000) 1.2687 us/op 1.0788 us/op 1.18
Tree 40 250000 toArray() 21.347 ms/op 21.927 ms/op 0.97
Tree 40 250000 iterate all - toArray() + loop 21.903 ms/op 20.944 ms/op 1.05
Tree 40 250000 iterate all - get(i) 72.123 ms/op 71.056 ms/op 1.02
MutableVector 250000 create 15.639 ms/op 13.424 ms/op 1.17
MutableVector 250000 get(125000) 7.0070 ns/op 6.5310 ns/op 1.07
MutableVector 250000 set(125000) 521.25 ns/op 293.10 ns/op 1.78
MutableVector 250000 toArray() 4.3798 ms/op 3.4342 ms/op 1.28
MutableVector 250000 iterate all - toArray() + loop 4.3100 ms/op 3.9579 ms/op 1.09
MutableVector 250000 iterate all - get(i) 1.5984 ms/op 1.5573 ms/op 1.03
Array 250000 create 3.9767 ms/op 3.5807 ms/op 1.11
Array 250000 clone - spread 1.6266 ms/op 1.4360 ms/op 1.13
Array 250000 get(125000) 1.3720 ns/op 1.1810 ns/op 1.16
Array 250000 set(125000) 5.6180 ns/op 4.3900 ns/op 1.28
Array 250000 iterate all - loop 167.82 us/op 170.33 us/op 0.99
effectiveBalanceIncrements clone Uint8Array 300000 60.866 us/op 41.806 us/op 1.46
effectiveBalanceIncrements clone MutableVector 300000 484.00 ns/op 454.00 ns/op 1.07
effectiveBalanceIncrements rw all Uint8Array 300000 204.04 us/op 201.46 us/op 1.01
effectiveBalanceIncrements rw all MutableVector 300000 100.72 ms/op 98.074 ms/op 1.03
phase0 afterProcessEpoch - 250000 vs - 7PWei 116.34 ms/op 114.39 ms/op 1.02
phase0 beforeProcessEpoch - 250000 vs - 7PWei 51.107 ms/op 52.825 ms/op 0.97
altair processEpoch - mainnet_e81889 541.09 ms/op 532.72 ms/op 1.02
mainnet_e81889 - altair beforeProcessEpoch 94.780 ms/op 86.994 ms/op 1.09
mainnet_e81889 - altair processJustificationAndFinalization 19.784 us/op 16.593 us/op 1.19
mainnet_e81889 - altair processInactivityUpdates 6.7287 ms/op 6.9656 ms/op 0.97
mainnet_e81889 - altair processRewardsAndPenalties 70.750 ms/op 45.878 ms/op 1.54
mainnet_e81889 - altair processRegistryUpdates 2.8360 us/op 3.1020 us/op 0.91
mainnet_e81889 - altair processSlashings 487.00 ns/op 443.00 ns/op 1.10
mainnet_e81889 - altair processEth1DataReset 647.00 ns/op 693.00 ns/op 0.93
mainnet_e81889 - altair processEffectiveBalanceUpdates 1.5049 ms/op 1.4429 ms/op 1.04
mainnet_e81889 - altair processSlashingsReset 4.5050 us/op 5.7030 us/op 0.79
mainnet_e81889 - altair processRandaoMixesReset 7.6790 us/op 5.6310 us/op 1.36
mainnet_e81889 - altair processHistoricalRootsUpdate 899.00 ns/op 743.00 ns/op 1.21
mainnet_e81889 - altair processParticipationFlagUpdates 1.7700 us/op 3.2820 us/op 0.54
mainnet_e81889 - altair processSyncCommitteeUpdates 760.00 ns/op 770.00 ns/op 0.99
mainnet_e81889 - altair afterProcessEpoch 125.07 ms/op 120.87 ms/op 1.03
capella processEpoch - mainnet_e217614 2.2322 s/op 2.4569 s/op 0.91
mainnet_e217614 - capella beforeProcessEpoch 508.65 ms/op 550.79 ms/op 0.92
mainnet_e217614 - capella processJustificationAndFinalization 22.941 us/op 20.586 us/op 1.11
mainnet_e217614 - capella processInactivityUpdates 27.289 ms/op 20.308 ms/op 1.34
mainnet_e217614 - capella processRewardsAndPenalties 420.59 ms/op 412.34 ms/op 1.02
mainnet_e217614 - capella processRegistryUpdates 36.273 us/op 37.181 us/op 0.98
mainnet_e217614 - capella processSlashings 649.00 ns/op 523.00 ns/op 1.24
mainnet_e217614 - capella processEth1DataReset 505.00 ns/op 544.00 ns/op 0.93
mainnet_e217614 - capella processEffectiveBalanceUpdates 5.1103 ms/op 10.458 ms/op 0.49
mainnet_e217614 - capella processSlashingsReset 3.5010 us/op 4.5790 us/op 0.76
mainnet_e217614 - capella processRandaoMixesReset 4.9170 us/op 4.9160 us/op 1.00
mainnet_e217614 - capella processHistoricalRootsUpdate 559.00 ns/op 695.00 ns/op 0.80
mainnet_e217614 - capella processParticipationFlagUpdates 2.7730 us/op 1.6930 us/op 1.64
mainnet_e217614 - capella afterProcessEpoch 325.96 ms/op 335.29 ms/op 0.97
phase0 processEpoch - mainnet_e58758 475.35 ms/op 472.09 ms/op 1.01
mainnet_e58758 - phase0 beforeProcessEpoch 113.86 ms/op 140.90 ms/op 0.81
mainnet_e58758 - phase0 processJustificationAndFinalization 15.761 us/op 16.422 us/op 0.96
mainnet_e58758 - phase0 processRewardsAndPenalties 56.028 ms/op 54.088 ms/op 1.04
mainnet_e58758 - phase0 processRegistryUpdates 9.9670 us/op 10.610 us/op 0.94
mainnet_e58758 - phase0 processSlashings 495.00 ns/op 521.00 ns/op 0.95
mainnet_e58758 - phase0 processEth1DataReset 420.00 ns/op 410.00 ns/op 1.02
mainnet_e58758 - phase0 processEffectiveBalanceUpdates 1.1528 ms/op 1.1715 ms/op 0.98
mainnet_e58758 - phase0 processSlashingsReset 2.9960 us/op 2.7330 us/op 1.10
mainnet_e58758 - phase0 processRandaoMixesReset 3.8100 us/op 4.0110 us/op 0.95
mainnet_e58758 - phase0 processHistoricalRootsUpdate 460.00 ns/op 362.00 ns/op 1.27
mainnet_e58758 - phase0 processParticipationRecordUpdates 3.3710 us/op 4.7320 us/op 0.71
mainnet_e58758 - phase0 afterProcessEpoch 93.840 ms/op 96.590 ms/op 0.97
phase0 processEffectiveBalanceUpdates - 250000 normalcase 1.4191 ms/op 1.4476 ms/op 0.98
phase0 processEffectiveBalanceUpdates - 250000 worstcase 0.5 1.5450 ms/op 1.5441 ms/op 1.00
altair processInactivityUpdates - 250000 normalcase 20.599 ms/op 33.371 ms/op 0.62
altair processInactivityUpdates - 250000 worstcase 21.128 ms/op 33.123 ms/op 0.64
phase0 processRegistryUpdates - 250000 normalcase 9.0010 us/op 9.8600 us/op 0.91
phase0 processRegistryUpdates - 250000 badcase_full_deposits 378.32 us/op 434.29 us/op 0.87
phase0 processRegistryUpdates - 250000 worstcase 0.5 148.69 ms/op 155.69 ms/op 0.96
altair processRewardsAndPenalties - 250000 normalcase 57.102 ms/op 62.111 ms/op 0.92
altair processRewardsAndPenalties - 250000 worstcase 52.967 ms/op 61.482 ms/op 0.86
phase0 getAttestationDeltas - 250000 normalcase 8.9549 ms/op 11.423 ms/op 0.78
phase0 getAttestationDeltas - 250000 worstcase 8.8322 ms/op 11.792 ms/op 0.75
phase0 processSlashings - 250000 worstcase 81.295 us/op 133.33 us/op 0.61
altair processSyncCommitteeUpdates - 250000 153.59 ms/op 167.29 ms/op 0.92
BeaconState.hashTreeRoot - No change 394.00 ns/op 674.00 ns/op 0.58
BeaconState.hashTreeRoot - 1 full validator 116.31 us/op 185.64 us/op 0.63
BeaconState.hashTreeRoot - 32 full validator 1.2542 ms/op 1.6074 ms/op 0.78
BeaconState.hashTreeRoot - 512 full validator 12.503 ms/op 19.137 ms/op 0.65
BeaconState.hashTreeRoot - 1 validator.effectiveBalance 133.65 us/op 200.65 us/op 0.67
BeaconState.hashTreeRoot - 32 validator.effectiveBalance 1.8767 ms/op 2.7472 ms/op 0.68
BeaconState.hashTreeRoot - 512 validator.effectiveBalance 30.365 ms/op 33.597 ms/op 0.90
BeaconState.hashTreeRoot - 1 balances 143.71 us/op 145.51 us/op 0.99
BeaconState.hashTreeRoot - 32 balances 1.4472 ms/op 1.1830 ms/op 1.22
BeaconState.hashTreeRoot - 512 balances 10.261 ms/op 14.032 ms/op 0.73
BeaconState.hashTreeRoot - 250000 balances 171.21 ms/op 231.36 ms/op 0.74
aggregationBits - 2048 els - zipIndexesInBitList 17.774 us/op 21.947 us/op 0.81
byteArrayEquals 32 78.978 ns/op 77.535 ns/op 1.02
Buffer.compare 32 56.225 ns/op 58.306 ns/op 0.96
byteArrayEquals 1024 2.0545 us/op 2.1079 us/op 0.97
Buffer.compare 1024 70.627 ns/op 73.945 ns/op 0.96
byteArrayEquals 16384 32.967 us/op 33.803 us/op 0.98
Buffer.compare 16384 276.37 ns/op 270.67 ns/op 1.02
byteArrayEquals 123687377 240.85 ms/op 263.83 ms/op 0.91
Buffer.compare 123687377 6.5378 ms/op 10.284 ms/op 0.64
byteArrayEquals 32 - diff last byte 72.997 ns/op 78.304 ns/op 0.93
Buffer.compare 32 - diff last byte 56.026 ns/op 57.925 ns/op 0.97
byteArrayEquals 1024 - diff last byte 2.0223 us/op 2.2443 us/op 0.90
Buffer.compare 1024 - diff last byte 70.609 ns/op 74.049 ns/op 0.95
byteArrayEquals 16384 - diff last byte 32.301 us/op 35.555 us/op 0.91
Buffer.compare 16384 - diff last byte 270.99 ns/op 261.95 ns/op 1.03
byteArrayEquals 123687377 - diff last byte 266.23 ms/op 261.82 ms/op 1.02
Buffer.compare 123687377 - diff last byte 7.5318 ms/op 8.4688 ms/op 0.89
byteArrayEquals 32 - random bytes 5.2920 ns/op 6.5570 ns/op 0.81
Buffer.compare 32 - random bytes 60.296 ns/op 63.932 ns/op 0.94
byteArrayEquals 1024 - random bytes 5.1510 ns/op 6.3180 ns/op 0.82
Buffer.compare 1024 - random bytes 59.813 ns/op 63.106 ns/op 0.95
byteArrayEquals 16384 - random bytes 5.2060 ns/op 6.3000 ns/op 0.83
Buffer.compare 16384 - random bytes 61.108 ns/op 63.194 ns/op 0.97
byteArrayEquals 123687377 - random bytes 8.4500 ns/op 9.3700 ns/op 0.90
Buffer.compare 123687377 - random bytes 70.690 ns/op 75.220 ns/op 0.94
regular array get 100000 times 46.968 us/op 47.132 us/op 1.00
wrappedArray get 100000 times 46.169 us/op 47.403 us/op 0.97
arrayWithProxy get 100000 times 14.684 ms/op 14.802 ms/op 0.99
ssz.Root.equals 54.441 ns/op 56.130 ns/op 0.97
byteArrayEquals 57.692 ns/op 55.481 ns/op 1.04
Buffer.compare 11.308 ns/op 12.210 ns/op 0.93
shuffle list - 16384 els 7.2536 ms/op 7.2286 ms/op 1.00
shuffle list - 250000 els 101.38 ms/op 108.52 ms/op 0.93
processSlot - 1 slots 17.052 us/op 18.366 us/op 0.93
processSlot - 32 slots 3.5398 ms/op 4.5940 ms/op 0.77
getEffectiveBalanceIncrementsZeroInactive - 250000 vs - 7PWei 58.781 ms/op 63.490 ms/op 0.93
getCommitteeAssignments - req 1 vs - 250000 vc 2.5527 ms/op 2.6030 ms/op 0.98
getCommitteeAssignments - req 100 vs - 250000 vc 3.8031 ms/op 3.7253 ms/op 1.02
getCommitteeAssignments - req 1000 vs - 250000 vc 4.1433 ms/op 4.1100 ms/op 1.01
findModifiedValidators - 10000 modified validators 532.57 ms/op 547.68 ms/op 0.97
findModifiedValidators - 1000 modified validators 428.60 ms/op 462.63 ms/op 0.93
findModifiedValidators - 100 modified validators 398.13 ms/op 427.58 ms/op 0.93
findModifiedValidators - 10 modified validators 414.03 ms/op 433.52 ms/op 0.96
findModifiedValidators - 1 modified validators 406.10 ms/op 413.46 ms/op 0.98
findModifiedValidators - no difference 409.01 ms/op 400.03 ms/op 1.02
compare ViewDUs 4.3840 s/op 4.5912 s/op 0.95
compare each validator Uint8Array 1.8551 s/op 1.6007 s/op 1.16
compare ViewDU to Uint8Array 1.1567 s/op 1.3866 s/op 0.83
migrate state 1000000 validators, 24 modified, 0 new 821.38 ms/op 863.24 ms/op 0.95
migrate state 1000000 validators, 1700 modified, 1000 new 1.0764 s/op 1.0714 s/op 1.00
migrate state 1000000 validators, 3400 modified, 2000 new 1.4371 s/op 1.3535 s/op 1.06
migrate state 1500000 validators, 24 modified, 0 new 970.09 ms/op 827.74 ms/op 1.17
migrate state 1500000 validators, 1700 modified, 1000 new 1.5200 s/op 1.0906 s/op 1.39
migrate state 1500000 validators, 3400 modified, 2000 new 1.6077 s/op 1.3264 s/op 1.21
RootCache.getBlockRootAtSlot - 250000 vs - 7PWei 5.2700 ns/op 4.4500 ns/op 1.18
state getBlockRootAtSlot - 250000 vs - 7PWei 914.80 ns/op 557.37 ns/op 1.64
computeProposers - vc 250000 11.432 ms/op 9.3982 ms/op 1.22
computeEpochShuffling - vc 250000 116.57 ms/op 106.92 ms/op 1.09
getNextSyncCommittee - vc 250000 174.95 ms/op 159.91 ms/op 1.09
computeSigningRoot for AttestationData 36.564 us/op 26.436 us/op 1.38
hash AttestationData serialized data then Buffer.toString(base64) 2.5476 us/op 2.4054 us/op 1.06
toHexString serialized data 1.3721 us/op 1.1814 us/op 1.16
Buffer.toString(base64) 231.36 ns/op 245.01 ns/op 0.94

by benchmarkbot/action

nflaig
nflaig reviewed Feb 6, 2024
View reviewed changes
packages/utils/src/format.ts Outdated Show resolved Hide resolved
@nazarhussain nazarhussain merged commit 274871d into unstable Feb 6, 2024
13 of 15 checks passed
@nazarhussain nazarhussain deleted the nh/improve-sim-logs branch February 6, 2024 16:02
@wemeetagain
Copy link
Member

🎉 This PR is included in v1.16.0 🎉

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@nflaig nflaig nflaig approved these changes

Assignees

@nazarhussain nazarhussain

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

None yet
3 participants
@nazarhussain @wemeetagain @nflaig