Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

test: add debug messages to waitForSlot helper #6639

Merged
merged 3 commits into from Apr 5, 2024
Merged

test: add debug messages to waitForSlot helper #6639

merged 3 commits into from Apr 5, 2024

Conversation

nazarhussain
Copy link
Contributor

Motivation

Make the logs more clear and understandable.

Description

  • Add a clear message for the logging whenever we are waiting for some slot.

Steps to test or reproduce

  • Run all tests

@nazarhussain nazarhussain requested a review from a team as a code owner April 5, 2024 13:24
@nazarhussain nazarhussain self-assigned this Apr 5, 2024
@codecov Codecov
Copy link

codecov bot commented Apr 5, 2024 •
edited

Codecov Report

Merging #6639 (851eb07) into unstable (91801fa) will not change coverage.
The diff coverage is n/a.

Additional details and impacted files 
@@            Coverage Diff            @@
##           unstable    #6639   +/-   ##
=========================================
  Coverage     61.69%   61.69%           
=========================================
  Files           556      556           
  Lines         58820    58820           
  Branches       1887     1887           
=========================================
  Hits          36287    36287           
  Misses        22492    22492           
  Partials         41       41

@nflaig nflaig changed the title refactor: add debug messages to waitForSlot helper test: add debug messages to waitForSlot helper Apr 5, 2024
Base automatically changed from nh/sim-refactor-1 to unstable April 5, 2024 14:31
matthewkeil
matthewkeil approved these changes Apr 5, 2024
View reviewed changes
Copy link
Member

@matthewkeil matthewkeil left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM!! 🚀

@nazarhussain nazarhussain enabled auto-merge (squash) April 5, 2024 14:40
@nazarhussain nazarhussain merged commit ee1169a into unstable Apr 5, 2024
19 of 20 checks passed
@nazarhussain nazarhussain deleted the nh/sim-refactor-2 branch April 5, 2024 14:45
@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Apr 5, 2024

Performance Report

✔️ no performance regression detected

Full benchmark results
Benchmark suite Current: 844a010 Previous: e202592 Ratio
getPubkeys - index2pubkey - req 1000 vs - 250000 vc 381.34 us/op 580.47 us/op 0.66
getPubkeys - validatorsArr - req 1000 vs - 250000 vc 52.773 us/op 106.08 us/op 0.50
BLS verify - blst-native 1.1333 ms/op 1.3251 ms/op 0.86
BLS verifyMultipleSignatures 3 - blst-native 2.4124 ms/op 2.7329 ms/op 0.88
BLS verifyMultipleSignatures 8 - blst-native 5.4099 ms/op 6.2065 ms/op 0.87
BLS verifyMultipleSignatures 32 - blst-native 19.730 ms/op 22.360 ms/op 0.88
BLS verifyMultipleSignatures 64 - blst-native 38.719 ms/op 43.503 ms/op 0.89
BLS verifyMultipleSignatures 128 - blst-native 76.703 ms/op 85.514 ms/op 0.90
BLS deserializing 10000 signatures 855.93 ms/op 908.72 ms/op 0.94
BLS deserializing 100000 signatures 8.4450 s/op 9.5040 s/op 0.89
BLS verifyMultipleSignatures - same message - 3 - blst-native 1.1487 ms/op 1.3670 ms/op 0.84
BLS verifyMultipleSignatures - same message - 8 - blst-native 1.3283 ms/op 1.7009 ms/op 0.78
BLS verifyMultipleSignatures - same message - 32 - blst-native 2.9369 ms/op 2.8853 ms/op 1.02
BLS verifyMultipleSignatures - same message - 64 - blst-native 3.0579 ms/op 4.7312 ms/op 0.65
BLS verifyMultipleSignatures - same message - 128 - blst-native 7.3652 ms/op 5.6790 ms/op 1.30
BLS aggregatePubkeys 32 - blst-native 24.659 us/op 25.955 us/op 0.95
BLS aggregatePubkeys 128 - blst-native 90.011 us/op 102.09 us/op 0.88
notSeenSlots=1 numMissedVotes=1 numBadVotes=10 65.119 ms/op 59.524 ms/op 1.09
notSeenSlots=1 numMissedVotes=0 numBadVotes=4 73.108 ms/op 61.654 ms/op 1.19
notSeenSlots=2 numMissedVotes=1 numBadVotes=10 29.100 ms/op 49.807 ms/op 0.58
getSlashingsAndExits - default max 171.20 us/op 452.97 us/op 0.38
getSlashingsAndExits - 2k 461.30 us/op 874.70 us/op 0.53
proposeBlockBody type=full, size=empty 4.8234 ms/op 7.5664 ms/op 0.64
isKnown best case - 1 super set check 243.00 ns/op 715.00 ns/op 0.34
isKnown normal case - 2 super set checks 531.00 ns/op 768.00 ns/op 0.69
isKnown worse case - 16 super set checks 451.00 ns/op 749.00 ns/op 0.60
InMemoryCheckpointStateCache - add get delete 5.8760 us/op 8.7650 us/op 0.67
validate api signedAggregateAndProof - struct 2.4247 ms/op 3.5039 ms/op 0.69
validate gossip signedAggregateAndProof - struct 2.4090 ms/op 3.2698 ms/op 0.74
validate gossip attestation - vc 640000 1.1904 ms/op 1.6311 ms/op 0.73
batch validate gossip attestation - vc 640000 - chunk 32 158.76 us/op 178.50 us/op 0.89
batch validate gossip attestation - vc 640000 - chunk 64 145.91 us/op 148.23 us/op 0.98
batch validate gossip attestation - vc 640000 - chunk 128 147.14 us/op 145.10 us/op 1.01
batch validate gossip attestation - vc 640000 - chunk 256 162.27 us/op 135.25 us/op 1.20
pickEth1Vote - no votes 1.7115 ms/op 1.1855 ms/op 1.44
pickEth1Vote - max votes 22.669 ms/op 11.089 ms/op 2.04
pickEth1Vote - Eth1Data hashTreeRoot value x2048 47.714 ms/op 20.518 ms/op 2.33
pickEth1Vote - Eth1Data hashTreeRoot tree x2048 57.259 ms/op 26.096 ms/op 2.19
pickEth1Vote - Eth1Data fastSerialize value x2048 823.37 us/op 695.64 us/op 1.18
pickEth1Vote - Eth1Data fastSerialize tree x2048 10.047 ms/op 5.1475 ms/op 1.95
bytes32 toHexString 1.1960 us/op 594.00 ns/op 2.01
bytes32 Buffer.toString(hex) 291.00 ns/op 308.00 ns/op 0.94
bytes32 Buffer.toString(hex) from Uint8Array 749.00 ns/op 433.00 ns/op 1.73
bytes32 Buffer.toString(hex) + 0x 317.00 ns/op 312.00 ns/op 1.02
Object access 1 prop 0.21400 ns/op 0.17900 ns/op 1.20
Map access 1 prop 0.11800 ns/op 0.16100 ns/op 0.73
Object get x1000 5.0800 ns/op 7.5710 ns/op 0.67
Map get x1000 0.84700 ns/op 0.81900 ns/op 1.03
Object set x1000 55.155 ns/op 55.818 ns/op 0.99
Map set x1000 35.234 ns/op 43.577 ns/op 0.81
Return object 10000 times 0.23010 ns/op 0.24480 ns/op 0.94
Throw Error 10000 times 2.8345 us/op 3.9267 us/op 0.72
fastMsgIdFn sha256 / 200 bytes 2.3540 us/op 3.3330 us/op 0.71
fastMsgIdFn h32 xxhash / 200 bytes 277.00 ns/op 321.00 ns/op 0.86
fastMsgIdFn h64 xxhash / 200 bytes 351.00 ns/op 375.00 ns/op 0.94
fastMsgIdFn sha256 / 1000 bytes 6.2710 us/op 11.565 us/op 0.54
fastMsgIdFn h32 xxhash / 1000 bytes 456.00 ns/op 464.00 ns/op 0.98
fastMsgIdFn h64 xxhash / 1000 bytes 366.00 ns/op 449.00 ns/op 0.82
fastMsgIdFn sha256 / 10000 bytes 53.813 us/op 104.07 us/op 0.52
fastMsgIdFn h32 xxhash / 10000 bytes 1.7750 us/op 1.9870 us/op 0.89
fastMsgIdFn h64 xxhash / 10000 bytes 1.2330 us/op 1.3880 us/op 0.89
send data - 1000 256B messages 17.641 ms/op 21.571 ms/op 0.82
send data - 1000 512B messages 19.473 ms/op 27.478 ms/op 0.71
send data - 1000 1024B messages 32.270 ms/op 44.634 ms/op 0.72
send data - 1000 1200B messages 41.261 ms/op 37.665 ms/op 1.10
send data - 1000 2048B messages 51.200 ms/op 45.750 ms/op 1.12
send data - 1000 4096B messages 47.321 ms/op 25.463 ms/op 1.86
send data - 1000 16384B messages 118.07 ms/op 105.33 ms/op 1.12
send data - 1000 65536B messages 487.39 ms/op 449.21 ms/op 1.08
enrSubnets - fastDeserialize 64 bits 1.0480 us/op 1.2970 us/op 0.81
enrSubnets - ssz BitVector 64 bits 468.00 ns/op 428.00 ns/op 1.09
enrSubnets - fastDeserialize 4 bits 214.00 ns/op 168.00 ns/op 1.27
enrSubnets - ssz BitVector 4 bits 476.00 ns/op 417.00 ns/op 1.14
prioritizePeers score -10:0 att 32-0.1 sync 2-0 105.48 us/op 100.97 us/op 1.04
prioritizePeers score 0:0 att 32-0.25 sync 2-0.25 130.16 us/op 143.78 us/op 0.91
prioritizePeers score 0:0 att 32-0.5 sync 2-0.5 176.71 us/op 192.85 us/op 0.92
prioritizePeers score 0:0 att 64-0.75 sync 4-0.75 289.15 us/op 338.25 us/op 0.85
prioritizePeers score 0:0 att 64-1 sync 4-1 332.37 us/op 371.42 us/op 0.89
array of 16000 items push then shift 1.3880 us/op 1.6295 us/op 0.85
LinkedList of 16000 items push then shift 9.1000 ns/op 8.9980 ns/op 1.01
array of 16000 items push then pop 126.71 ns/op 96.010 ns/op 1.32
LinkedList of 16000 items push then pop 9.8450 ns/op 8.5290 ns/op 1.15
array of 24000 items push then shift 1.9975 us/op 2.5381 us/op 0.79
LinkedList of 24000 items push then shift 8.5650 ns/op 8.9420 ns/op 0.96
array of 24000 items push then pop 164.02 ns/op 119.62 ns/op 1.37
LinkedList of 24000 items push then pop 6.4650 ns/op 8.5660 ns/op 0.75
intersect bitArray bitLen 8 4.9810 ns/op 5.7410 ns/op 0.87
intersect array and set length 8 51.127 ns/op 60.075 ns/op 0.85
intersect bitArray bitLen 128 29.661 ns/op 34.064 ns/op 0.87
intersect array and set length 128 776.78 ns/op 867.90 ns/op 0.90
bitArray.getTrueBitIndexes() bitLen 128 1.4650 us/op 1.6110 us/op 0.91
bitArray.getTrueBitIndexes() bitLen 248 2.7420 us/op 2.8630 us/op 0.96
bitArray.getTrueBitIndexes() bitLen 512 5.7640 us/op 5.0820 us/op 1.13
Buffer.concat 32 items 929.00 ns/op 1.0030 us/op 0.93
Uint8Array.set 32 items 2.4510 us/op 1.7380 us/op 1.41
Set add up to 64 items then delete first 1.8754 us/op 4.4463 us/op 0.42
OrderedSet add up to 64 items then delete first 4.0485 us/op 5.5699 us/op 0.73
Set add up to 64 items then delete last 2.7931 us/op 4.8303 us/op 0.58
OrderedSet add up to 64 items then delete last 4.3032 us/op 6.2230 us/op 0.69
Set add up to 64 items then delete middle 2.8085 us/op 4.6384 us/op 0.61
OrderedSet add up to 64 items then delete middle 5.5942 us/op 7.2445 us/op 0.77
Set add up to 128 items then delete first 5.5674 us/op 9.8545 us/op 0.56
OrderedSet add up to 128 items then delete first 9.1489 us/op 13.442 us/op 0.68
Set add up to 128 items then delete last 5.4352 us/op 9.6281 us/op 0.56
OrderedSet add up to 128 items then delete last 9.0213 us/op 11.895 us/op 0.76
Set add up to 128 items then delete middle 5.3833 us/op 9.3376 us/op 0.58
OrderedSet add up to 128 items then delete middle 13.708 us/op 17.104 us/op 0.80
Set add up to 256 items then delete first 11.855 us/op 18.781 us/op 0.63
OrderedSet add up to 256 items then delete first 18.999 us/op 25.978 us/op 0.73
Set add up to 256 items then delete last 12.194 us/op 19.221 us/op 0.63
OrderedSet add up to 256 items then delete last 18.522 us/op 23.155 us/op 0.80
Set add up to 256 items then delete middle 11.644 us/op 18.829 us/op 0.62
OrderedSet add up to 256 items then delete middle 37.491 us/op 46.916 us/op 0.80
transfer serialized Status (84 B) 1.9150 us/op 1.6900 us/op 1.13
copy serialized Status (84 B) 1.3370 us/op 1.2790 us/op 1.05
transfer serialized SignedVoluntaryExit (112 B) 1.6640 us/op 1.9240 us/op 0.86
copy serialized SignedVoluntaryExit (112 B) 1.3030 us/op 1.4740 us/op 0.88
transfer serialized ProposerSlashing (416 B) 2.1730 us/op 1.9740 us/op 1.10
copy serialized ProposerSlashing (416 B) 2.3430 us/op 1.9680 us/op 1.19
transfer serialized Attestation (485 B) 2.7500 us/op 2.7810 us/op 0.99
copy serialized Attestation (485 B) 2.5100 us/op 1.9790 us/op 1.27
transfer serialized AttesterSlashing (33232 B) 2.6350 us/op 2.0870 us/op 1.26
copy serialized AttesterSlashing (33232 B) 11.028 us/op 7.2200 us/op 1.53
transfer serialized Small SignedBeaconBlock (128000 B) 3.8420 us/op 3.3580 us/op 1.14
copy serialized Small SignedBeaconBlock (128000 B) 29.334 us/op 19.035 us/op 1.54
transfer serialized Avg SignedBeaconBlock (200000 B) 4.4660 us/op 3.2320 us/op 1.38
copy serialized Avg SignedBeaconBlock (200000 B) 46.301 us/op 24.561 us/op 1.89
transfer serialized BlobsSidecar (524380 B) 4.9510 us/op 3.4530 us/op 1.43
copy serialized BlobsSidecar (524380 B) 132.83 us/op 102.81 us/op 1.29
transfer serialized Big SignedBeaconBlock (1000000 B) 5.0450 us/op 3.8580 us/op 1.31
copy serialized Big SignedBeaconBlock (1000000 B) 239.58 us/op 168.69 us/op 1.42
pass gossip attestations to forkchoice per slot 2.8490 ms/op 4.3173 ms/op 0.66
forkChoice updateHead vc 100000 bc 64 eq 0 673.37 us/op 715.62 us/op 0.94
forkChoice updateHead vc 600000 bc 64 eq 0 3.1219 ms/op 5.0178 ms/op 0.62
forkChoice updateHead vc 1000000 bc 64 eq 0 5.1377 ms/op 7.1896 ms/op 0.71
forkChoice updateHead vc 600000 bc 320 eq 0 3.4404 ms/op 4.3475 ms/op 0.79
forkChoice updateHead vc 600000 bc 1200 eq 0 3.5727 ms/op 4.6396 ms/op 0.77
forkChoice updateHead vc 600000 bc 7200 eq 0 5.4998 ms/op 5.4306 ms/op 1.01
forkChoice updateHead vc 600000 bc 64 eq 1000 10.609 ms/op 11.449 ms/op 0.93
forkChoice updateHead vc 600000 bc 64 eq 10000 11.233 ms/op 12.221 ms/op 0.92
forkChoice updateHead vc 600000 bc 64 eq 300000 36.098 ms/op 16.691 ms/op 2.16
computeDeltas 500000 validators 300 proto nodes 3.8133 ms/op 6.7785 ms/op 0.56
computeDeltas 500000 validators 1200 proto nodes 3.6187 ms/op 6.8662 ms/op 0.53
computeDeltas 500000 validators 7200 proto nodes 3.3271 ms/op 6.5255 ms/op 0.51
computeDeltas 750000 validators 300 proto nodes 5.3097 ms/op 9.8621 ms/op 0.54
computeDeltas 750000 validators 1200 proto nodes 5.3570 ms/op 9.9350 ms/op 0.54
computeDeltas 750000 validators 7200 proto nodes 5.8599 ms/op 10.390 ms/op 0.56
computeDeltas 1400000 validators 300 proto nodes 11.616 ms/op 20.013 ms/op 0.58
computeDeltas 1400000 validators 1200 proto nodes 11.090 ms/op 20.339 ms/op 0.55
computeDeltas 1400000 validators 7200 proto nodes 11.177 ms/op 20.732 ms/op 0.54
computeDeltas 2100000 validators 300 proto nodes 15.327 ms/op 30.790 ms/op 0.50
computeDeltas 2100000 validators 1200 proto nodes 15.665 ms/op 29.483 ms/op 0.53
computeDeltas 2100000 validators 7200 proto nodes 14.956 ms/op 29.520 ms/op 0.51
altair processAttestation - 250000 vs - 7PWei normalcase 2.8557 ms/op 2.4745 ms/op 1.15
altair processAttestation - 250000 vs - 7PWei worstcase 3.7947 ms/op 3.3977 ms/op 1.12
altair processAttestation - setStatus - 1/6 committees join 103.77 us/op 194.33 us/op 0.53
altair processAttestation - setStatus - 1/3 committees join 157.72 us/op 381.16 us/op 0.41
altair processAttestation - setStatus - 1/2 committees join 248.12 us/op 490.48 us/op 0.51
altair processAttestation - setStatus - 2/3 committees join 331.82 us/op 611.96 us/op 0.54
altair processAttestation - setStatus - 4/5 committees join 459.71 us/op 871.79 us/op 0.53
altair processAttestation - setStatus - 100% committees join 506.53 us/op 978.89 us/op 0.52
altair processBlock - 250000 vs - 7PWei normalcase 8.3730 ms/op 8.7717 ms/op 0.95
altair processBlock - 250000 vs - 7PWei normalcase hashState 32.207 ms/op 35.961 ms/op 0.90
altair processBlock - 250000 vs - 7PWei worstcase 37.436 ms/op 47.877 ms/op 0.78
altair processBlock - 250000 vs - 7PWei worstcase hashState 77.694 ms/op 95.943 ms/op 0.81
phase0 processBlock - 250000 vs - 7PWei normalcase 2.4168 ms/op 2.7448 ms/op 0.88
phase0 processBlock - 250000 vs - 7PWei worstcase 26.616 ms/op 31.784 ms/op 0.84
altair processEth1Data - 250000 vs - 7PWei normalcase 284.90 us/op 494.76 us/op 0.58
getExpectedWithdrawals 250000 eb:1,eth1:1,we:0,wn:0,smpl:15 13.542 us/op 13.911 us/op 0.97
getExpectedWithdrawals 250000 eb:0.95,eth1:0.1,we:0.05,wn:0,smpl:219 55.232 us/op 47.913 us/op 1.15
getExpectedWithdrawals 250000 eb:0.95,eth1:0.3,we:0.05,wn:0,smpl:42 16.985 us/op 18.359 us/op 0.93
getExpectedWithdrawals 250000 eb:0.95,eth1:0.7,we:0.05,wn:0,smpl:18 12.950 us/op 15.890 us/op 0.81
getExpectedWithdrawals 250000 eb:0.1,eth1:0.1,we:0,wn:0,smpl:1020 179.25 us/op 243.84 us/op 0.74
getExpectedWithdrawals 250000 eb:0.03,eth1:0.03,we:0,wn:0,smpl:11777 1.1730 ms/op 1.3522 ms/op 0.87
getExpectedWithdrawals 250000 eb:0.01,eth1:0.01,we:0,wn:0,smpl:16384 1.3742 ms/op 1.7781 ms/op 0.77
getExpectedWithdrawals 250000 eb:0,eth1:0,we:0,wn:0,smpl:16384 1.2103 ms/op 1.7730 ms/op 0.68
getExpectedWithdrawals 250000 eb:0,eth1:0,we:0,wn:0,nocache,smpl:16384 3.0134 ms/op 3.2835 ms/op 0.92
getExpectedWithdrawals 250000 eb:0,eth1:1,we:0,wn:0,smpl:16384 2.3171 ms/op 2.8917 ms/op 0.80
getExpectedWithdrawals 250000 eb:0,eth1:1,we:0,wn:0,nocache,smpl:16384 5.9203 ms/op 5.4212 ms/op 1.09
Tree 40 250000 create 327.54 ms/op 369.11 ms/op 0.89
Tree 40 250000 get(125000) 125.06 ns/op 208.11 ns/op 0.60
Tree 40 250000 set(125000) 865.14 ns/op 1.0653 us/op 0.81
Tree 40 250000 toArray() 21.472 ms/op 24.575 ms/op 0.87
Tree 40 250000 iterate all - toArray() + loop 21.952 ms/op 26.735 ms/op 0.82
Tree 40 250000 iterate all - get(i) 54.798 ms/op 77.973 ms/op 0.70
MutableVector 250000 create 10.322 ms/op 17.607 ms/op 0.59
MutableVector 250000 get(125000) 5.8250 ns/op 6.7400 ns/op 0.86
MutableVector 250000 set(125000) 288.37 ns/op 528.49 ns/op 0.55
MutableVector 250000 toArray() 3.5573 ms/op 4.7756 ms/op 0.74
MutableVector 250000 iterate all - toArray() + loop 3.9592 ms/op 4.2648 ms/op 0.93
MutableVector 250000 iterate all - get(i) 1.3811 ms/op 1.5496 ms/op 0.89
Array 250000 create 2.4449 ms/op 3.8098 ms/op 0.64
Array 250000 clone - spread 1.3739 ms/op 1.4657 ms/op 0.94
Array 250000 get(125000) 1.0290 ns/op 1.8060 ns/op 0.57
Array 250000 set(125000) 1.2460 ns/op 5.7530 ns/op 0.22
Array 250000 iterate all - loop 160.20 us/op 173.65 us/op 0.92
effectiveBalanceIncrements clone Uint8Array 300000 15.923 us/op 56.900 us/op 0.28
effectiveBalanceIncrements clone MutableVector 300000 402.00 ns/op 444.00 ns/op 0.91
effectiveBalanceIncrements rw all Uint8Array 300000 201.79 us/op 209.71 us/op 0.96
effectiveBalanceIncrements rw all MutableVector 300000 68.898 ms/op 117.48 ms/op 0.59
phase0 afterProcessEpoch - 250000 vs - 7PWei 78.285 ms/op 116.87 ms/op 0.67
phase0 beforeProcessEpoch - 250000 vs - 7PWei 48.429 ms/op 51.862 ms/op 0.93
altair processEpoch - mainnet_e81889 478.77 ms/op 525.42 ms/op 0.91
mainnet_e81889 - altair beforeProcessEpoch 84.559 ms/op 97.397 ms/op 0.87
mainnet_e81889 - altair processJustificationAndFinalization 12.297 us/op 17.703 us/op 0.69
mainnet_e81889 - altair processInactivityUpdates 7.8081 ms/op 6.9630 ms/op 1.12
mainnet_e81889 - altair processRewardsAndPenalties 72.032 ms/op 74.450 ms/op 0.97
mainnet_e81889 - altair processRegistryUpdates 1.9220 us/op 4.0050 us/op 0.48
mainnet_e81889 - altair processSlashings 385.00 ns/op 539.00 ns/op 0.71
mainnet_e81889 - altair processEth1DataReset 387.00 ns/op 651.00 ns/op 0.59
mainnet_e81889 - altair processEffectiveBalanceUpdates 1.0004 ms/op 1.4178 ms/op 0.71
mainnet_e81889 - altair processSlashingsReset 1.8600 us/op 3.5190 us/op 0.53
mainnet_e81889 - altair processRandaoMixesReset 3.0850 us/op 5.7510 us/op 0.54
mainnet_e81889 - altair processHistoricalRootsUpdate 491.00 ns/op 1.1230 us/op 0.44
mainnet_e81889 - altair processParticipationFlagUpdates 1.8390 us/op 2.4360 us/op 0.75
mainnet_e81889 - altair processSyncCommitteeUpdates 562.00 ns/op 669.00 ns/op 0.84
mainnet_e81889 - altair afterProcessEpoch 82.695 ms/op 124.20 ms/op 0.67
capella processEpoch - mainnet_e217614 1.5992 s/op 2.2937 s/op 0.70
mainnet_e217614 - capella beforeProcessEpoch 398.03 ms/op 511.93 ms/op 0.78
mainnet_e217614 - capella processJustificationAndFinalization 11.712 us/op 17.357 us/op 0.67
mainnet_e217614 - capella processInactivityUpdates 14.351 ms/op 23.704 ms/op 0.61
mainnet_e217614 - capella processRewardsAndPenalties 438.99 ms/op 602.62 ms/op 0.73
mainnet_e217614 - capella processRegistryUpdates 10.420 us/op 38.558 us/op 0.27
mainnet_e217614 - capella processSlashings 234.00 ns/op 1.1340 us/op 0.21
mainnet_e217614 - capella processEth1DataReset 336.00 ns/op 1.7680 us/op 0.19
mainnet_e217614 - capella processEffectiveBalanceUpdates 11.867 ms/op 5.0577 ms/op 2.35
mainnet_e217614 - capella processSlashingsReset 1.0620 us/op 5.9320 us/op 0.18
mainnet_e217614 - capella processRandaoMixesReset 1.5000 us/op 5.6510 us/op 0.27
mainnet_e217614 - capella processHistoricalRootsUpdate 223.00 ns/op 1.0050 us/op 0.22
mainnet_e217614 - capella processParticipationFlagUpdates 714.00 ns/op 2.1810 us/op 0.33
mainnet_e217614 - capella afterProcessEpoch 205.98 ms/op 404.11 ms/op 0.51
phase0 processEpoch - mainnet_e58758 403.51 ms/op 549.37 ms/op 0.73
mainnet_e58758 - phase0 beforeProcessEpoch 123.41 ms/op 141.56 ms/op 0.87
mainnet_e58758 - phase0 processJustificationAndFinalization 6.2360 us/op 18.539 us/op 0.34
mainnet_e58758 - phase0 processRewardsAndPenalties 49.128 ms/op 48.246 ms/op 1.02
mainnet_e58758 - phase0 processRegistryUpdates 9.0580 us/op 12.212 us/op 0.74
mainnet_e58758 - phase0 processSlashings 415.00 ns/op 759.00 ns/op 0.55
mainnet_e58758 - phase0 processEth1DataReset 326.00 ns/op 846.00 ns/op 0.39
mainnet_e58758 - phase0 processEffectiveBalanceUpdates 1.3348 ms/op 1.2134 ms/op 1.10
mainnet_e58758 - phase0 processSlashingsReset 2.1470 us/op 4.7670 us/op 0.45
mainnet_e58758 - phase0 processRandaoMixesReset 2.3930 us/op 5.9630 us/op 0.40
mainnet_e58758 - phase0 processHistoricalRootsUpdate 338.00 ns/op 703.00 ns/op 0.48
mainnet_e58758 - phase0 processParticipationRecordUpdates 2.0170 us/op 4.3410 us/op 0.46
mainnet_e58758 - phase0 afterProcessEpoch 66.072 ms/op 104.30 ms/op 0.63
phase0 processEffectiveBalanceUpdates - 250000 normalcase 927.58 us/op 1.3524 ms/op 0.69
phase0 processEffectiveBalanceUpdates - 250000 worstcase 0.5 1.0213 ms/op 1.5484 ms/op 0.66
altair processInactivityUpdates - 250000 normalcase 21.865 ms/op 33.894 ms/op 0.65
altair processInactivityUpdates - 250000 worstcase 24.273 ms/op 34.717 ms/op 0.70
phase0 processRegistryUpdates - 250000 normalcase 7.0770 us/op 14.222 us/op 0.50
phase0 processRegistryUpdates - 250000 badcase_full_deposits 423.04 us/op 404.40 us/op 1.05
phase0 processRegistryUpdates - 250000 worstcase 0.5 115.50 ms/op 172.60 ms/op 0.67
altair processRewardsAndPenalties - 250000 normalcase 70.801 ms/op 83.652 ms/op 0.85
altair processRewardsAndPenalties - 250000 worstcase 65.639 ms/op 79.911 ms/op 0.82
phase0 getAttestationDeltas - 250000 normalcase 5.5769 ms/op 10.729 ms/op 0.52
phase0 getAttestationDeltas - 250000 worstcase 5.5076 ms/op 12.070 ms/op 0.46
phase0 processSlashings - 250000 worstcase 80.030 us/op 116.04 us/op 0.69
altair processSyncCommitteeUpdates - 250000 105.65 ms/op 169.29 ms/op 0.62
BeaconState.hashTreeRoot - No change 277.00 ns/op 674.00 ns/op 0.41
BeaconState.hashTreeRoot - 1 full validator 138.25 us/op 148.41 us/op 0.93
BeaconState.hashTreeRoot - 32 full validator 1.6161 ms/op 1.7343 ms/op 0.93
BeaconState.hashTreeRoot - 512 full validator 17.390 ms/op 22.923 ms/op 0.76
BeaconState.hashTreeRoot - 1 validator.effectiveBalance 183.55 us/op 240.88 us/op 0.76
BeaconState.hashTreeRoot - 32 validator.effectiveBalance 2.0668 ms/op 2.5162 ms/op 0.82
BeaconState.hashTreeRoot - 512 validator.effectiveBalance 26.187 ms/op 33.428 ms/op 0.78
BeaconState.hashTreeRoot - 1 balances 128.86 us/op 144.32 us/op 0.89
BeaconState.hashTreeRoot - 32 balances 1.1762 ms/op 1.5551 ms/op 0.76
BeaconState.hashTreeRoot - 512 balances 9.9605 ms/op 15.880 ms/op 0.63
BeaconState.hashTreeRoot - 250000 balances 203.06 ms/op 220.23 ms/op 0.92
aggregationBits - 2048 els - zipIndexesInBitList 19.448 us/op 30.397 us/op 0.64
byteArrayEquals 32 59.701 ns/op 76.028 ns/op 0.79
Buffer.compare 32 34.922 ns/op 55.889 ns/op 0.62
byteArrayEquals 1024 1.5912 us/op 2.0765 us/op 0.77
Buffer.compare 1024 40.816 ns/op 71.254 ns/op 0.57
byteArrayEquals 16384 25.995 us/op 33.015 us/op 0.79
Buffer.compare 16384 191.42 ns/op 267.61 ns/op 0.72
byteArrayEquals 123687377 196.47 ms/op 250.18 ms/op 0.79
Buffer.compare 123687377 4.2581 ms/op 7.2844 ms/op 0.58
byteArrayEquals 32 - diff last byte 60.405 ns/op 72.920 ns/op 0.83
Buffer.compare 32 - diff last byte 35.507 ns/op 57.348 ns/op 0.62
byteArrayEquals 1024 - diff last byte 1.5895 us/op 2.0793 us/op 0.76
Buffer.compare 1024 - diff last byte 40.875 ns/op 73.793 ns/op 0.55
byteArrayEquals 16384 - diff last byte 25.187 us/op 32.791 us/op 0.77
Buffer.compare 16384 - diff last byte 199.75 ns/op 269.07 ns/op 0.74
byteArrayEquals 123687377 - diff last byte 207.56 ms/op 262.72 ms/op 0.79
Buffer.compare 123687377 - diff last byte 4.3885 ms/op 9.5225 ms/op 0.46
byteArrayEquals 32 - random bytes 4.4230 ns/op 6.5280 ns/op 0.68
Buffer.compare 32 - random bytes 42.624 ns/op 63.029 ns/op 0.68
byteArrayEquals 1024 - random bytes 4.4380 ns/op 6.7140 ns/op 0.66
Buffer.compare 1024 - random bytes 39.505 ns/op 64.714 ns/op 0.61
byteArrayEquals 16384 - random bytes 4.3540 ns/op 6.7560 ns/op 0.64
Buffer.compare 16384 - random bytes 39.699 ns/op 64.585 ns/op 0.61
byteArrayEquals 123687377 - random bytes 7.0300 ns/op 12.290 ns/op 0.57
Buffer.compare 123687377 - random bytes 42.780 ns/op 78.280 ns/op 0.55
regular array get 100000 times 42.121 us/op 47.978 us/op 0.88
wrappedArray get 100000 times 41.938 us/op 47.320 us/op 0.89
arrayWithProxy get 100000 times 10.272 ms/op 15.131 ms/op 0.68
ssz.Root.equals 55.754 ns/op 57.365 ns/op 0.97
byteArrayEquals 53.902 ns/op 55.515 ns/op 0.97
Buffer.compare 9.5190 ns/op 12.490 ns/op 0.76
shuffle list - 16384 els 5.9932 ms/op 9.3073 ms/op 0.64
shuffle list - 250000 els 89.203 ms/op 136.83 ms/op 0.65
processSlot - 1 slots 15.522 us/op 19.877 us/op 0.78
processSlot - 32 slots 2.9161 ms/op 3.6167 ms/op 0.81
getEffectiveBalanceIncrementsZeroInactive - 250000 vs - 7PWei 47.984 ms/op 63.741 ms/op 0.75
getCommitteeAssignments - req 1 vs - 250000 vc 2.4156 ms/op 2.7890 ms/op 0.87
getCommitteeAssignments - req 100 vs - 250000 vc 3.5984 ms/op 4.0366 ms/op 0.89
getCommitteeAssignments - req 1000 vs - 250000 vc 4.0431 ms/op 4.4190 ms/op 0.91
findModifiedValidators - 10000 modified validators 308.93 ms/op 387.63 ms/op 0.80
findModifiedValidators - 1000 modified validators 157.08 ms/op 233.15 ms/op 0.67
findModifiedValidators - 100 modified validators 193.29 ms/op 210.04 ms/op 0.92
findModifiedValidators - 10 modified validators 181.21 ms/op 232.89 ms/op 0.78
findModifiedValidators - 1 modified validators 183.85 ms/op 215.68 ms/op 0.85
findModifiedValidators - no difference 263.26 ms/op 313.93 ms/op 0.84
compare ViewDUs 4.4780 s/op 4.9613 s/op 0.90
compare each validator Uint8Array 1.9736 s/op 1.8057 s/op 1.09
compare ViewDU to Uint8Array 854.42 ms/op 1.4496 s/op 0.59
migrate state 1000000 validators, 24 modified, 0 new 671.86 ms/op 821.38 ms/op 0.82
migrate state 1000000 validators, 1700 modified, 1000 new 985.98 ms/op 1.1055 s/op 0.89
migrate state 1000000 validators, 3400 modified, 2000 new 1.2212 s/op 1.3048 s/op 0.94
migrate state 1500000 validators, 24 modified, 0 new 599.22 ms/op 752.09 ms/op 0.80
migrate state 1500000 validators, 1700 modified, 1000 new 1.0465 s/op 1.0388 s/op 1.01
migrate state 1500000 validators, 3400 modified, 2000 new 1.3711 s/op 1.2635 s/op 1.09
RootCache.getBlockRootAtSlot - 250000 vs - 7PWei 4.7000 ns/op 4.2900 ns/op 1.10
state getBlockRootAtSlot - 250000 vs - 7PWei 1.0161 us/op 867.42 ns/op 1.17
computeProposers - vc 250000 9.6355 ms/op 9.6279 ms/op 1.00
computeEpochShuffling - vc 250000 94.092 ms/op 127.56 ms/op 0.74
getNextSyncCommittee - vc 250000 141.87 ms/op 164.83 ms/op 0.86
computeSigningRoot for AttestationData 31.630 us/op 24.798 us/op 1.28
hash AttestationData serialized data then Buffer.toString(base64) 1.5048 us/op 2.3016 us/op 0.65
toHexString serialized data 1.0649 us/op 1.0486 us/op 1.02
Buffer.toString(base64) 253.70 ns/op 208.46 ns/op 1.22

by benchmarkbot/action

@wemeetagain
Copy link
Member

🎉 This PR is included in v1.18.0 🎉

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@matthewkeil matthewkeil matthewkeil approved these changes

Assignees

@nazarhussain nazarhussain

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

None yet
3 participants
@nazarhussain @wemeetagain @matthewkeil