Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

docs: reflect vitest migration #6247

Merged
merged 4 commits into from Jan 30, 2024
Merged

docs: reflect vitest migration #6247

merged 4 commits into from Jan 30, 2024

Conversation

jeluard
Copy link
Member

@jeluard jeluard commented Jan 2, 2024

Motivation

Update docs to reflect the recent migration to vitest

@jeluard jeluard requested a review from a team as a code owner January 2, 2024 20:38
jeluard
jeluard commented Jan 2, 2024
View reviewed changes
CONTRIBUTING.md Outdated Show resolved Hide resolved
jeluard
jeluard commented Jan 2, 2024
View reviewed changes
CONTRIBUTING.md Outdated Show resolved Hide resolved
@codecov Codecov
Copy link

codecov bot commented Jan 2, 2024 •
edited

Codecov Report

Merging #6247 (09e9904) into unstable (ed43a98) will decrease coverage by 0.01%.
The diff coverage is n/a.

❗ Current head 09e9904 differs from pull request most recent head da92d0a. Consider uploading reports for the commit da92d0a to get more accurate results

Additional details and impacted files 
@@             Coverage Diff              @@
##           unstable    #6247      +/-   ##
============================================
- Coverage     60.15%   60.15%   -0.01%     
============================================
  Files           407      407              
  Lines         46511    46503       -8     
  Branches       1550     1547       -3     
============================================
- Hits          27980    27975       -5     
+ Misses        18499    18496       -3     
  Partials         32       32

@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Jan 2, 2024 •
edited

Performance Report

✔️ no performance regression detected

Full benchmark results
Benchmark suite Current: 1ad26fa Previous: ed43a98 Ratio
getPubkeys - index2pubkey - req 1000 vs - 250000 vc 391.52 us/op 578.74 us/op 0.68
getPubkeys - validatorsArr - req 1000 vs - 250000 vc 61.337 us/op 123.11 us/op 0.50
BLS verify - blst-native 1.1338 ms/op 1.3391 ms/op 0.85
BLS verifyMultipleSignatures 3 - blst-native 2.4215 ms/op 2.7858 ms/op 0.87
BLS verifyMultipleSignatures 8 - blst-native 5.3667 ms/op 6.1180 ms/op 0.88
BLS verifyMultipleSignatures 32 - blst-native 19.696 ms/op 22.196 ms/op 0.89
BLS verifyMultipleSignatures 64 - blst-native 38.898 ms/op 43.883 ms/op 0.89
BLS verifyMultipleSignatures 128 - blst-native 77.311 ms/op 87.836 ms/op 0.88
BLS deserializing 10000 signatures 851.73 ms/op 951.16 ms/op 0.90
BLS deserializing 100000 signatures 8.5155 s/op 9.2077 s/op 0.92
BLS verifyMultipleSignatures - same message - 3 - blst-native 1.1684 ms/op 1.3800 ms/op 0.85
BLS verifyMultipleSignatures - same message - 8 - blst-native 1.3216 ms/op 1.5968 ms/op 0.83
BLS verifyMultipleSignatures - same message - 32 - blst-native 2.0763 ms/op 2.3782 ms/op 0.87
BLS verifyMultipleSignatures - same message - 64 - blst-native 3.8130 ms/op 3.5077 ms/op 1.09
BLS verifyMultipleSignatures - same message - 128 - blst-native 5.1090 ms/op 5.7801 ms/op 0.88
BLS aggregatePubkeys 32 - blst-native 23.106 us/op 26.442 us/op 0.87
BLS aggregatePubkeys 128 - blst-native 90.276 us/op 102.77 us/op 0.88
getAttestationsForBlock 30.898 ms/op 57.168 ms/op 0.54
getSlashingsAndExits - default max 89.033 us/op 150.22 us/op 0.59
getSlashingsAndExits - 2k 326.21 us/op 537.38 us/op 0.61
proposeBlockBody type=full, size=empty 3.4906 ms/op 5.3949 ms/op 0.65
isKnown best case - 1 super set check 345.00 ns/op 324.00 ns/op 1.06
isKnown normal case - 2 super set checks 330.00 ns/op 324.00 ns/op 1.02
isKnown worse case - 16 super set checks 334.00 ns/op 339.00 ns/op 0.99
CheckpointStateCache - add get delete 4.2370 us/op 6.0090 us/op 0.71
validate api signedAggregateAndProof - struct 2.5466 ms/op 2.8199 ms/op 0.90
validate gossip signedAggregateAndProof - struct 2.4466 ms/op 2.8096 ms/op 0.87
validate gossip attestation - vc 640000 1.1581 ms/op 1.3771 ms/op 0.84
batch validate gossip attestation - vc 640000 - chunk 32 142.89 us/op 167.40 us/op 0.85
batch validate gossip attestation - vc 640000 - chunk 64 126.34 us/op 146.44 us/op 0.86
batch validate gossip attestation - vc 640000 - chunk 128 117.67 us/op 133.74 us/op 0.88
batch validate gossip attestation - vc 640000 - chunk 256 112.64 us/op 130.03 us/op 0.87
pickEth1Vote - no votes 912.84 us/op 1.2819 ms/op 0.71
pickEth1Vote - max votes 9.6404 ms/op 7.8639 ms/op 1.23
pickEth1Vote - Eth1Data hashTreeRoot value x2048 22.765 ms/op 17.378 ms/op 1.31
pickEth1Vote - Eth1Data hashTreeRoot tree x2048 28.333 ms/op 33.090 ms/op 0.86
pickEth1Vote - Eth1Data fastSerialize value x2048 396.57 us/op 614.39 us/op 0.65
pickEth1Vote - Eth1Data fastSerialize tree x2048 8.7284 ms/op 4.5916 ms/op 1.90
bytes32 toHexString 497.00 ns/op 537.00 ns/op 0.93
bytes32 Buffer.toString(hex) 292.00 ns/op 298.00 ns/op 0.98
bytes32 Buffer.toString(hex) from Uint8Array 443.00 ns/op 444.00 ns/op 1.00
bytes32 Buffer.toString(hex) + 0x 306.00 ns/op 296.00 ns/op 1.03
Object access 1 prop 0.20200 ns/op 0.15900 ns/op 1.27
Map access 1 prop 0.19200 ns/op 0.15500 ns/op 1.24
Object get x1000 5.5800 ns/op 7.7870 ns/op 0.72
Map get x1000 0.75200 ns/op 0.87200 ns/op 0.86
Object set x1000 25.895 ns/op 59.082 ns/op 0.44
Map set x1000 17.910 ns/op 45.448 ns/op 0.39
Return object 10000 times 0.24420 ns/op 0.24760 ns/op 0.99
Throw Error 10000 times 2.9948 us/op 3.8709 us/op 0.77
fastMsgIdFn sha256 / 200 bytes 2.0450 us/op 3.3990 us/op 0.60
fastMsgIdFn h32 xxhash / 200 bytes 292.00 ns/op 293.00 ns/op 1.00
fastMsgIdFn h64 xxhash / 200 bytes 349.00 ns/op 346.00 ns/op 1.01
fastMsgIdFn sha256 / 1000 bytes 6.3010 us/op 11.627 us/op 0.54
fastMsgIdFn h32 xxhash / 1000 bytes 431.00 ns/op 447.00 ns/op 0.96
fastMsgIdFn h64 xxhash / 1000 bytes 425.00 ns/op 444.00 ns/op 0.96
fastMsgIdFn sha256 / 10000 bytes 54.407 us/op 103.00 us/op 0.53
fastMsgIdFn h32 xxhash / 10000 bytes 1.8980 us/op 2.0000 us/op 0.95
fastMsgIdFn h64 xxhash / 10000 bytes 1.3230 us/op 1.3540 us/op 0.98
send data - 1000 256B messages 14.187 ms/op 19.166 ms/op 0.74
send data - 1000 512B messages 19.845 ms/op 27.931 ms/op 0.71
send data - 1000 1024B messages 27.523 ms/op 40.623 ms/op 0.68
send data - 1000 1200B messages 28.157 ms/op 38.023 ms/op 0.74
send data - 1000 2048B messages 23.494 ms/op 47.976 ms/op 0.49
send data - 1000 4096B messages 30.671 ms/op 43.221 ms/op 0.71
send data - 1000 16384B messages 84.089 ms/op 121.25 ms/op 0.69
send data - 1000 65536B messages 391.46 ms/op 450.15 ms/op 0.87
enrSubnets - fastDeserialize 64 bits 1.0960 us/op 1.3180 us/op 0.83
enrSubnets - ssz BitVector 64 bits 474.00 ns/op 435.00 ns/op 1.09
enrSubnets - fastDeserialize 4 bits 247.00 ns/op 170.00 ns/op 1.45
enrSubnets - ssz BitVector 4 bits 443.00 ns/op 476.00 ns/op 0.93
prioritizePeers score -10:0 att 32-0.1 sync 2-0 69.038 us/op 106.48 us/op 0.65
prioritizePeers score 0:0 att 32-0.25 sync 2-0.25 83.385 us/op 134.85 us/op 0.62
prioritizePeers score 0:0 att 32-0.5 sync 2-0.5 121.52 us/op 190.10 us/op 0.64
prioritizePeers score 0:0 att 64-0.75 sync 4-0.75 186.42 us/op 325.39 us/op 0.57
prioritizePeers score 0:0 att 64-1 sync 4-1 242.63 us/op 366.94 us/op 0.66
array of 16000 items push then shift 1.3869 us/op 1.6773 us/op 0.83
LinkedList of 16000 items push then shift 6.0230 ns/op 9.1230 ns/op 0.66
array of 16000 items push then pop 95.102 ns/op 101.46 ns/op 0.94
LinkedList of 16000 items push then pop 5.7270 ns/op 8.8190 ns/op 0.65
array of 24000 items push then shift 2.0340 us/op 2.5267 us/op 0.80
LinkedList of 24000 items push then shift 6.0090 ns/op 9.2090 ns/op 0.65
array of 24000 items push then pop 99.637 ns/op 112.84 ns/op 0.88
LinkedList of 24000 items push then pop 6.1350 ns/op 9.2360 ns/op 0.66
intersect bitArray bitLen 8 4.9910 ns/op 6.5410 ns/op 0.76
intersect array and set length 8 52.637 ns/op 65.140 ns/op 0.81
intersect bitArray bitLen 128 28.022 ns/op 34.419 ns/op 0.81
intersect array and set length 128 880.82 ns/op 895.84 ns/op 0.98
bitArray.getTrueBitIndexes() bitLen 128 1.3200 us/op 1.6030 us/op 0.82
bitArray.getTrueBitIndexes() bitLen 248 2.0270 us/op 2.4420 us/op 0.83
bitArray.getTrueBitIndexes() bitLen 512 3.7260 us/op 5.0640 us/op 0.74
Buffer.concat 32 items 840.00 ns/op 1.0940 us/op 0.77
Uint8Array.set 32 items 1.4230 us/op 1.9700 us/op 0.72
Set add up to 64 items then delete first 1.7978 us/op 4.9905 us/op 0.36
OrderedSet add up to 64 items then delete first 2.7065 us/op 6.1921 us/op 0.44
Set add up to 64 items then delete last 2.0234 us/op 5.0000 us/op 0.40
OrderedSet add up to 64 items then delete last 3.0302 us/op 6.1881 us/op 0.49
Set add up to 64 items then delete middle 2.0225 us/op 4.6460 us/op 0.44
OrderedSet add up to 64 items then delete middle 4.2538 us/op 7.2685 us/op 0.59
Set add up to 128 items then delete first 3.9452 us/op 9.3606 us/op 0.42
OrderedSet add up to 128 items then delete first 6.1857 us/op 12.577 us/op 0.49
Set add up to 128 items then delete last 3.9003 us/op 9.2721 us/op 0.42
OrderedSet add up to 128 items then delete last 6.1549 us/op 11.756 us/op 0.52
Set add up to 128 items then delete middle 4.0150 us/op 9.2847 us/op 0.43
OrderedSet add up to 128 items then delete middle 10.811 us/op 17.072 us/op 0.63
Set add up to 256 items then delete first 7.8243 us/op 19.531 us/op 0.40
OrderedSet add up to 256 items then delete first 12.621 us/op 25.885 us/op 0.49
Set add up to 256 items then delete last 7.7002 us/op 18.663 us/op 0.41
OrderedSet add up to 256 items then delete last 11.858 us/op 23.459 us/op 0.51
Set add up to 256 items then delete middle 7.7752 us/op 18.434 us/op 0.42
OrderedSet add up to 256 items then delete middle 31.547 us/op 46.073 us/op 0.68
transfer serialized Status (84 B) 1.3930 us/op 1.7540 us/op 0.79
copy serialized Status (84 B) 1.1290 us/op 1.2460 us/op 0.91
transfer serialized SignedVoluntaryExit (112 B) 1.5060 us/op 1.8540 us/op 0.81
copy serialized SignedVoluntaryExit (112 B) 1.1560 us/op 1.3280 us/op 0.87
transfer serialized ProposerSlashing (416 B) 2.5330 us/op 2.0740 us/op 1.22
copy serialized ProposerSlashing (416 B) 2.4110 us/op 1.7710 us/op 1.36
transfer serialized Attestation (485 B) 2.5400 us/op 2.1280 us/op 1.19
copy serialized Attestation (485 B) 2.3790 us/op 1.9510 us/op 1.22
transfer serialized AttesterSlashing (33232 B) 2.9340 us/op 2.0740 us/op 1.41
copy serialized AttesterSlashing (33232 B) 8.7890 us/op 6.2360 us/op 1.41
transfer serialized Small SignedBeaconBlock (128000 B) 3.1820 us/op 3.3620 us/op 0.95
copy serialized Small SignedBeaconBlock (128000 B) 20.523 us/op 19.557 us/op 1.05
transfer serialized Avg SignedBeaconBlock (200000 B) 2.8580 us/op 3.7370 us/op 0.76
copy serialized Avg SignedBeaconBlock (200000 B) 12.449 us/op 27.306 us/op 0.46
transfer serialized BlobsSidecar (524380 B) 2.5430 us/op 2.9740 us/op 0.86
copy serialized BlobsSidecar (524380 B) 76.315 us/op 106.39 us/op 0.72
transfer serialized Big SignedBeaconBlock (1000000 B) 2.6120 us/op 3.7080 us/op 0.70
copy serialized Big SignedBeaconBlock (1000000 B) 137.78 us/op 270.58 us/op 0.51
pass gossip attestations to forkchoice per slot 2.9821 ms/op 4.5160 ms/op 0.66
forkChoice updateHead vc 100000 bc 64 eq 0 508.83 us/op 692.33 us/op 0.73
forkChoice updateHead vc 600000 bc 64 eq 0 2.7059 ms/op 4.5256 ms/op 0.60
forkChoice updateHead vc 1000000 bc 64 eq 0 4.3759 ms/op 7.3672 ms/op 0.59
forkChoice updateHead vc 600000 bc 320 eq 0 2.7067 ms/op 4.3301 ms/op 0.63
forkChoice updateHead vc 600000 bc 1200 eq 0 2.7154 ms/op 4.4835 ms/op 0.61
forkChoice updateHead vc 600000 bc 7200 eq 0 3.4086 ms/op 5.6148 ms/op 0.61
forkChoice updateHead vc 600000 bc 64 eq 1000 9.9283 ms/op 12.063 ms/op 0.82
forkChoice updateHead vc 600000 bc 64 eq 10000 9.8077 ms/op 12.205 ms/op 0.80
forkChoice updateHead vc 600000 bc 64 eq 300000 12.098 ms/op 16.509 ms/op 0.73
computeDeltas 500000 validators 300 proto nodes 3.0881 ms/op 7.2644 ms/op 0.43
computeDeltas 500000 validators 1200 proto nodes 2.9541 ms/op 7.0790 ms/op 0.42
computeDeltas 500000 validators 7200 proto nodes 2.9484 ms/op 6.7170 ms/op 0.44
computeDeltas 750000 validators 300 proto nodes 4.8341 ms/op 10.255 ms/op 0.47
computeDeltas 750000 validators 1200 proto nodes 5.5500 ms/op 9.8883 ms/op 0.56
computeDeltas 750000 validators 7200 proto nodes 5.5079 ms/op 10.175 ms/op 0.54
computeDeltas 1400000 validators 300 proto nodes 9.2648 ms/op 19.385 ms/op 0.48
computeDeltas 1400000 validators 1200 proto nodes 9.1474 ms/op 19.990 ms/op 0.46
computeDeltas 1400000 validators 7200 proto nodes 9.0777 ms/op 20.817 ms/op 0.44
computeDeltas 2100000 validators 300 proto nodes 14.746 ms/op 30.793 ms/op 0.48
computeDeltas 2100000 validators 1200 proto nodes 13.861 ms/op 28.865 ms/op 0.48
computeDeltas 2100000 validators 7200 proto nodes 13.114 ms/op 29.728 ms/op 0.44
altair processAttestation - 250000 vs - 7PWei normalcase 1.5924 ms/op 3.5391 ms/op 0.45
altair processAttestation - 250000 vs - 7PWei worstcase 2.3890 ms/op 5.0751 ms/op 0.47
altair processAttestation - setStatus - 1/6 committees join 102.17 us/op 161.70 us/op 0.63
altair processAttestation - setStatus - 1/3 committees join 191.09 us/op 282.36 us/op 0.68
altair processAttestation - setStatus - 1/2 committees join 279.18 us/op 392.89 us/op 0.71
altair processAttestation - setStatus - 2/3 committees join 367.55 us/op 475.54 us/op 0.77
altair processAttestation - setStatus - 4/5 committees join 486.91 us/op 721.47 us/op 0.67
altair processAttestation - setStatus - 100% committees join 592.39 us/op 794.52 us/op 0.75
altair processBlock - 250000 vs - 7PWei normalcase 9.2254 ms/op 11.194 ms/op 0.82
altair processBlock - 250000 vs - 7PWei normalcase hashState 32.726 ms/op 44.829 ms/op 0.73
altair processBlock - 250000 vs - 7PWei worstcase 32.505 ms/op 42.933 ms/op 0.76
altair processBlock - 250000 vs - 7PWei worstcase hashState 84.217 ms/op 114.30 ms/op 0.74
phase0 processBlock - 250000 vs - 7PWei normalcase 2.3517 ms/op 3.2319 ms/op 0.73
phase0 processBlock - 250000 vs - 7PWei worstcase 24.604 ms/op 35.322 ms/op 0.70
altair processEth1Data - 250000 vs - 7PWei normalcase 315.88 us/op 705.00 us/op 0.45
getExpectedWithdrawals 250000 eb:1,eth1:1,we:0,wn:0,smpl:15 7.6300 us/op 18.556 us/op 0.41
getExpectedWithdrawals 250000 eb:0.95,eth1:0.1,we:0.05,wn:0,smpl:219 52.148 us/op 59.278 us/op 0.88
getExpectedWithdrawals 250000 eb:0.95,eth1:0.3,we:0.05,wn:0,smpl:42 14.537 us/op 26.068 us/op 0.56
getExpectedWithdrawals 250000 eb:0.95,eth1:0.7,we:0.05,wn:0,smpl:18 11.200 us/op 18.346 us/op 0.61
getExpectedWithdrawals 250000 eb:0.1,eth1:0.1,we:0,wn:0,smpl:1020 165.53 us/op 223.85 us/op 0.74
getExpectedWithdrawals 250000 eb:0.03,eth1:0.03,we:0,wn:0,smpl:11777 812.93 us/op 1.6376 ms/op 0.50
getExpectedWithdrawals 250000 eb:0.01,eth1:0.01,we:0,wn:0,smpl:16384 914.64 us/op 2.0279 ms/op 0.45
getExpectedWithdrawals 250000 eb:0,eth1:0,we:0,wn:0,smpl:16384 1.2537 ms/op 1.9046 ms/op 0.66
getExpectedWithdrawals 250000 eb:0,eth1:0,we:0,wn:0,nocache,smpl:16384 2.0131 ms/op 4.2016 ms/op 0.48
getExpectedWithdrawals 250000 eb:0,eth1:1,we:0,wn:0,smpl:16384 1.4304 ms/op 3.0264 ms/op 0.47
getExpectedWithdrawals 250000 eb:0,eth1:1,we:0,wn:0,nocache,smpl:16384 3.8747 ms/op 6.4870 ms/op 0.60
Tree 40 250000 create 257.08 ms/op 478.30 ms/op 0.54
Tree 40 250000 get(125000) 113.61 ns/op 224.69 ns/op 0.51
Tree 40 250000 set(125000) 750.10 ns/op 1.3882 us/op 0.54
Tree 40 250000 toArray() 10.144 ms/op 26.413 ms/op 0.38
Tree 40 250000 iterate all - toArray() + loop 10.121 ms/op 26.006 ms/op 0.39
Tree 40 250000 iterate all - get(i) 42.716 ms/op 81.027 ms/op 0.53
MutableVector 250000 create 8.0905 ms/op 15.339 ms/op 0.53
MutableVector 250000 get(125000) 6.0890 ns/op 6.8570 ns/op 0.89
MutableVector 250000 set(125000) 198.94 ns/op 555.39 ns/op 0.36
MutableVector 250000 toArray() 2.3701 ms/op 4.9517 ms/op 0.48
MutableVector 250000 iterate all - toArray() + loop 2.5193 ms/op 5.0667 ms/op 0.50
MutableVector 250000 iterate all - get(i) 1.3409 ms/op 1.5956 ms/op 0.84
Array 250000 create 2.1312 ms/op 4.6289 ms/op 0.46
Array 250000 clone - spread 1.0341 ms/op 1.7595 ms/op 0.59
Array 250000 get(125000) 1.0070 ns/op 1.9020 ns/op 0.53
Array 250000 set(125000) 1.2180 ns/op 5.6420 ns/op 0.22
Array 250000 iterate all - loop 155.03 us/op 175.16 us/op 0.89
effectiveBalanceIncrements clone Uint8Array 300000 12.971 us/op 70.213 us/op 0.18
effectiveBalanceIncrements clone MutableVector 300000 380.00 ns/op 508.00 ns/op 0.75
effectiveBalanceIncrements rw all Uint8Array 300000 187.35 us/op 204.58 us/op 0.92
effectiveBalanceIncrements rw all MutableVector 300000 63.203 ms/op 171.28 ms/op 0.37
phase0 afterProcessEpoch - 250000 vs - 7PWei 75.078 ms/op 132.30 ms/op 0.57
phase0 beforeProcessEpoch - 250000 vs - 7PWei 44.575 ms/op 47.557 ms/op 0.94
altair processEpoch - mainnet_e81889 457.91 ms/op 563.96 ms/op 0.81
mainnet_e81889 - altair beforeProcessEpoch 73.995 ms/op 94.742 ms/op 0.78
mainnet_e81889 - altair processJustificationAndFinalization 10.999 us/op 17.674 us/op 0.62
mainnet_e81889 - altair processInactivityUpdates 5.5750 ms/op 5.9791 ms/op 0.93
mainnet_e81889 - altair processRewardsAndPenalties 65.695 ms/op 43.043 ms/op 1.53
mainnet_e81889 - altair processRegistryUpdates 1.7900 us/op 2.6080 us/op 0.69
mainnet_e81889 - altair processSlashings 515.00 ns/op 530.00 ns/op 0.97
mainnet_e81889 - altair processEth1DataReset 611.00 ns/op 522.00 ns/op 1.17
mainnet_e81889 - altair processEffectiveBalanceUpdates 1.1333 ms/op 1.4473 ms/op 0.78
mainnet_e81889 - altair processSlashingsReset 2.3610 us/op 3.4870 us/op 0.68
mainnet_e81889 - altair processRandaoMixesReset 4.3710 us/op 7.2750 us/op 0.60
mainnet_e81889 - altair processHistoricalRootsUpdate 709.00 ns/op 1.0420 us/op 0.68
mainnet_e81889 - altair processParticipationFlagUpdates 2.6920 us/op 2.1650 us/op 1.24
mainnet_e81889 - altair processSyncCommitteeUpdates 841.00 ns/op 1.3480 us/op 0.62
mainnet_e81889 - altair afterProcessEpoch 80.739 ms/op 123.33 ms/op 0.65
capella processEpoch - mainnet_e217614 1.9566 s/op 2.5325 s/op 0.77
mainnet_e217614 - capella beforeProcessEpoch 480.79 ms/op 617.58 ms/op 0.78
mainnet_e217614 - capella processJustificationAndFinalization 20.752 us/op 31.018 us/op 0.67
mainnet_e217614 - capella processInactivityUpdates 22.621 ms/op 31.802 ms/op 0.71
mainnet_e217614 - capella processRewardsAndPenalties 373.68 ms/op 447.85 ms/op 0.83
mainnet_e217614 - capella processRegistryUpdates 31.747 us/op 32.475 us/op 0.98
mainnet_e217614 - capella processSlashings 990.00 ns/op 1.0660 us/op 0.93
mainnet_e217614 - capella processEth1DataReset 827.00 ns/op 1.1550 us/op 0.72
mainnet_e217614 - capella processEffectiveBalanceUpdates 4.7488 ms/op 6.4566 ms/op 0.74
mainnet_e217614 - capella processSlashingsReset 2.9810 us/op 5.3090 us/op 0.56
mainnet_e217614 - capella processRandaoMixesReset 2.7070 us/op 8.6010 us/op 0.31
mainnet_e217614 - capella processHistoricalRootsUpdate 764.00 ns/op 1.4180 us/op 0.54
mainnet_e217614 - capella processParticipationFlagUpdates 1.5160 us/op 2.4530 us/op 0.62
mainnet_e217614 - capella afterProcessEpoch 223.50 ms/op 322.09 ms/op 0.69
phase0 processEpoch - mainnet_e58758 433.38 ms/op 534.80 ms/op 0.81
mainnet_e58758 - phase0 beforeProcessEpoch 110.88 ms/op 163.00 ms/op 0.68
mainnet_e58758 - phase0 processJustificationAndFinalization 19.536 us/op 24.980 us/op 0.78
mainnet_e58758 - phase0 processRewardsAndPenalties 54.418 ms/op 60.148 ms/op 0.90
mainnet_e58758 - phase0 processRegistryUpdates 6.9240 us/op 14.460 us/op 0.48
mainnet_e58758 - phase0 processSlashings 686.00 ns/op 786.00 ns/op 0.87
mainnet_e58758 - phase0 processEth1DataReset 517.00 ns/op 676.00 ns/op 0.76
mainnet_e58758 - phase0 processEffectiveBalanceUpdates 1.4736 ms/op 1.2370 ms/op 1.19
mainnet_e58758 - phase0 processSlashingsReset 3.9270 us/op 3.7970 us/op 1.03
mainnet_e58758 - phase0 processRandaoMixesReset 2.7980 us/op 8.8600 us/op 0.32
mainnet_e58758 - phase0 processHistoricalRootsUpdate 524.00 ns/op 700.00 ns/op 0.75
mainnet_e58758 - phase0 processParticipationRecordUpdates 3.7980 us/op 4.1050 us/op 0.93
mainnet_e58758 - phase0 afterProcessEpoch 64.296 ms/op 96.744 ms/op 0.66
phase0 processEffectiveBalanceUpdates - 250000 normalcase 1.0247 ms/op 1.4392 ms/op 0.71
phase0 processEffectiveBalanceUpdates - 250000 worstcase 0.5 1.1181 ms/op 1.6247 ms/op 0.69
altair processInactivityUpdates - 250000 normalcase 25.787 ms/op 30.786 ms/op 0.84
altair processInactivityUpdates - 250000 worstcase 21.056 ms/op 27.200 ms/op 0.77
phase0 processRegistryUpdates - 250000 normalcase 10.728 us/op 11.395 us/op 0.94
phase0 processRegistryUpdates - 250000 badcase_full_deposits 421.88 us/op 434.61 us/op 0.97
phase0 processRegistryUpdates - 250000 worstcase 0.5 112.67 ms/op 159.28 ms/op 0.71
altair processRewardsAndPenalties - 250000 normalcase 57.947 ms/op 52.897 ms/op 1.10
altair processRewardsAndPenalties - 250000 worstcase 54.487 ms/op 62.662 ms/op 0.87
phase0 getAttestationDeltas - 250000 normalcase 5.9884 ms/op 11.167 ms/op 0.54
phase0 getAttestationDeltas - 250000 worstcase 5.7994 ms/op 12.481 ms/op 0.46
phase0 processSlashings - 250000 worstcase 88.692 us/op 128.00 us/op 0.69
altair processSyncCommitteeUpdates - 250000 111.42 ms/op 173.97 ms/op 0.64
BeaconState.hashTreeRoot - No change 726.00 ns/op 736.00 ns/op 0.99
BeaconState.hashTreeRoot - 1 full validator 116.49 us/op 151.26 us/op 0.77
BeaconState.hashTreeRoot - 32 full validator 1.0832 ms/op 1.5728 ms/op 0.69
BeaconState.hashTreeRoot - 512 full validator 13.622 ms/op 22.116 ms/op 0.62
BeaconState.hashTreeRoot - 1 validator.effectiveBalance 174.59 us/op 195.42 us/op 0.89
BeaconState.hashTreeRoot - 32 validator.effectiveBalance 2.5037 ms/op 2.3697 ms/op 1.06
BeaconState.hashTreeRoot - 512 validator.effectiveBalance 31.995 ms/op 33.906 ms/op 0.94
BeaconState.hashTreeRoot - 1 balances 135.68 us/op 128.58 us/op 1.06
BeaconState.hashTreeRoot - 32 balances 1.2190 ms/op 1.3087 ms/op 0.93
BeaconState.hashTreeRoot - 512 balances 11.394 ms/op 16.927 ms/op 0.67
BeaconState.hashTreeRoot - 250000 balances 173.69 ms/op 218.23 ms/op 0.80
aggregationBits - 2048 els - zipIndexesInBitList 13.960 us/op 21.281 us/op 0.66
byteArrayEquals 32 62.012 ns/op 77.793 ns/op 0.80
Buffer.compare 32 36.987 ns/op 58.565 ns/op 0.63
byteArrayEquals 1024 1.6768 us/op 2.1320 us/op 0.79
Buffer.compare 1024 42.382 ns/op 73.747 ns/op 0.57
byteArrayEquals 16384 26.335 us/op 33.912 us/op 0.78
Buffer.compare 16384 202.89 ns/op 285.68 ns/op 0.71
byteArrayEquals 123687377 213.12 ms/op 251.40 ms/op 0.85
Buffer.compare 123687377 4.7836 ms/op 6.2332 ms/op 0.77
byteArrayEquals 32 - diff last byte 63.148 ns/op 73.700 ns/op 0.86
Buffer.compare 32 - diff last byte 40.338 ns/op 56.404 ns/op 0.72
byteArrayEquals 1024 - diff last byte 1.8083 us/op 2.0849 us/op 0.87
Buffer.compare 1024 - diff last byte 45.720 ns/op 72.042 ns/op 0.63
byteArrayEquals 16384 - diff last byte 28.779 us/op 32.407 us/op 0.89
Buffer.compare 16384 - diff last byte 229.05 ns/op 276.79 ns/op 0.83
byteArrayEquals 123687377 - diff last byte 209.24 ms/op 249.76 ms/op 0.84
Buffer.compare 123687377 - diff last byte 4.5669 ms/op 7.9721 ms/op 0.57
byteArrayEquals 32 - random bytes 4.7520 ns/op 5.9150 ns/op 0.80
Buffer.compare 32 - random bytes 40.135 ns/op 62.913 ns/op 0.64
byteArrayEquals 1024 - random bytes 4.6470 ns/op 5.6050 ns/op 0.83
Buffer.compare 1024 - random bytes 38.627 ns/op 62.140 ns/op 0.62
byteArrayEquals 16384 - random bytes 4.7910 ns/op 5.4970 ns/op 0.87
Buffer.compare 16384 - random bytes 38.576 ns/op 62.345 ns/op 0.62
byteArrayEquals 123687377 - random bytes 8.0900 ns/op 9.4500 ns/op 0.86
Buffer.compare 123687377 - random bytes 44.950 ns/op 69.530 ns/op 0.65
regular array get 100000 times 43.199 us/op 46.253 us/op 0.93
wrappedArray get 100000 times 42.957 us/op 46.262 us/op 0.93
arrayWithProxy get 100000 times 10.055 ms/op 14.345 ms/op 0.70
ssz.Root.equals 56.309 ns/op 55.168 ns/op 1.02
byteArrayEquals 55.247 ns/op 54.205 ns/op 1.02
Buffer.compare 9.8170 ns/op 12.276 ns/op 0.80
shuffle list - 16384 els 4.5512 ms/op 7.1604 ms/op 0.64
shuffle list - 250000 els 68.931 ms/op 105.01 ms/op 0.66
processSlot - 1 slots 11.910 us/op 17.471 us/op 0.68
processSlot - 32 slots 2.3542 ms/op 3.5126 ms/op 0.67
getEffectiveBalanceIncrementsZeroInactive - 250000 vs - 7PWei 49.504 ms/op 60.058 ms/op 0.82
getCommitteeAssignments - req 1 vs - 250000 vc 2.3712 ms/op 2.5045 ms/op 0.95
getCommitteeAssignments - req 100 vs - 250000 vc 3.8492 ms/op 3.7498 ms/op 1.03
getCommitteeAssignments - req 1000 vs - 250000 vc 3.8614 ms/op 4.0164 ms/op 0.96
findModifiedValidators - 10000 modified validators 491.54 ms/op 546.18 ms/op 0.90
findModifiedValidators - 1000 modified validators 414.23 ms/op 436.85 ms/op 0.95
findModifiedValidators - 100 modified validators 410.52 ms/op 404.82 ms/op 1.01
findModifiedValidators - 10 modified validators 356.98 ms/op 464.56 ms/op 0.77
findModifiedValidators - 1 modified validators 675.28 ms/op 430.69 ms/op 1.57
findModifiedValidators - no difference 475.80 ms/op 454.20 ms/op 1.05
compare ViewDUs 4.5613 s/op 4.7274 s/op 0.96
compare each validator Uint8Array 1.9257 s/op 1.8256 s/op 1.05
compare ViewDU to Uint8Array 1.2335 s/op 1.3148 s/op 0.94
migrate state 1000000 validators, 24 modified, 0 new 715.86 ms/op 827.61 ms/op 0.86
migrate state 1000000 validators, 1700 modified, 1000 new 1.0264 s/op 1.1480 s/op 0.89
migrate state 1000000 validators, 3400 modified, 2000 new 1.2756 s/op 1.3755 s/op 0.93
migrate state 1500000 validators, 24 modified, 0 new 682.14 ms/op 839.32 ms/op 0.81
migrate state 1500000 validators, 1700 modified, 1000 new 897.58 ms/op 1.1903 s/op 0.75
migrate state 1500000 validators, 3400 modified, 2000 new 1.0418 s/op 1.4908 s/op 0.70
RootCache.getBlockRootAtSlot - 250000 vs - 7PWei 5.0900 ns/op 5.3500 ns/op 0.95
state getBlockRootAtSlot - 250000 vs - 7PWei 860.17 ns/op 689.17 ns/op 1.25
computeProposers - vc 250000 7.3546 ms/op 10.183 ms/op 0.72
computeEpochShuffling - vc 250000 69.576 ms/op 108.06 ms/op 0.64
getNextSyncCommittee - vc 250000 119.88 ms/op 174.60 ms/op 0.69
computeSigningRoot for AttestationData 28.265 us/op 30.940 us/op 0.91
hash AttestationData serialized data then Buffer.toString(base64) 1.2549 us/op 2.4678 us/op 0.51
toHexString serialized data 855.14 ns/op 1.4613 us/op 0.59
Buffer.toString(base64) 164.44 ns/op 285.94 ns/op 0.58

by benchmarkbot/action

@nflaig nflaig changed the title fix: reflect vitest migration docs: reflect vitest migration Jan 2, 2024
nflaig
nflaig reviewed Jan 2, 2024
View reviewed changes
CONTRIBUTING.md Outdated Show resolved Hide resolved
CONTRIBUTING.md Outdated Show resolved Hide resolved
@jeluard jeluard marked this pull request as draft January 3, 2024 14:54
@nflaig nflaig mentioned this pull request Jan 19, 2024
Merged
@jeluard jeluard marked this pull request as ready for review January 26, 2024 16:07
nflaig
nflaig previously requested changes Jan 29, 2024
View reviewed changes
CONTRIBUTING.md Outdated Show resolved Hide resolved
@jeluard jeluard requested a review from nflaig January 29, 2024 09:10
wemeetagain
wemeetagain reviewed Jan 29, 2024
View reviewed changes
CONTRIBUTING.md Outdated Show resolved Hide resolved
CONTRIBUTING.md Outdated Show resolved Hide resolved
wemeetagain
wemeetagain previously approved these changes Jan 29, 2024
View reviewed changes
@wemeetagain wemeetagain merged commit 8e0078b into unstable Jan 30, 2024
13 of 15 checks passed
@wemeetagain wemeetagain deleted the jeluard/fix-contributing branch January 30, 2024 22:54
@wemeetagain
Copy link
Member

🎉 This PR is included in v1.16.0 🎉

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@wemeetagain wemeetagain wemeetagain approved these changes

@nflaig nflaig Awaiting requested review from nflaig

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

None yet
3 participants
@jeluard @wemeetagain @nflaig