Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update merge CI to latest commits of ELs #4504

Merged
merged 3 commits into from Sep 26, 2022
Merged

Conversation

g11tech
Copy link
Contributor

@g11tech g11tech commented Sep 2, 2022

Update merge CI to latest commits of geth/nethermind and fix flags along the way

@g11tech g11tech requested a review from a team as a code owner September 2, 2022 10:01
@github-actions
Copy link
Contributor

github-actions bot commented Sep 2, 2022

Performance Report

✔️ no performance regression detected

Full benchmark results
Benchmark suite Current: f16477c Previous: 8fb0d8b Ratio
getPubkeys - index2pubkey - req 1000 vs - 250000 vc 2.3222 ms/op 2.1370 ms/op 1.09
getPubkeys - validatorsArr - req 1000 vs - 250000 vc 84.915 us/op 74.825 us/op 1.13
BLS verify - blst-native 2.2247 ms/op 2.0820 ms/op 1.07
BLS verifyMultipleSignatures 3 - blst-native 4.5642 ms/op 3.9931 ms/op 1.14
BLS verifyMultipleSignatures 8 - blst-native 9.7861 ms/op 8.6045 ms/op 1.14
BLS verifyMultipleSignatures 32 - blst-native 35.341 ms/op 32.064 ms/op 1.10
BLS aggregatePubkeys 32 - blst-native 47.239 us/op 43.865 us/op 1.08
BLS aggregatePubkeys 128 - blst-native 184.18 us/op 170.90 us/op 1.08
getAttestationsForBlock 103.48 ms/op 90.308 ms/op 1.15
isKnown best case - 1 super set check 515.00 ns/op 476.00 ns/op 1.08
isKnown normal case - 2 super set checks 499.00 ns/op 469.00 ns/op 1.06
isKnown worse case - 16 super set checks 499.00 ns/op 450.00 ns/op 1.11
CheckpointStateCache - add get delete 10.633 us/op 9.1990 us/op 1.16
validate gossip signedAggregateAndProof - struct 5.1168 ms/op 4.5258 ms/op 1.13
validate gossip attestation - struct 2.4614 ms/op 2.1883 ms/op 1.12
pickEth1Vote - no votes 2.6193 ms/op 2.3255 ms/op 1.13
pickEth1Vote - max votes 22.521 ms/op 19.599 ms/op 1.15
pickEth1Vote - Eth1Data hashTreeRoot value x2048 12.994 ms/op 11.459 ms/op 1.13
pickEth1Vote - Eth1Data hashTreeRoot tree x2048 23.744 ms/op 21.075 ms/op 1.13
pickEth1Vote - Eth1Data fastSerialize value x2048 1.7756 ms/op 1.5533 ms/op 1.14
pickEth1Vote - Eth1Data fastSerialize tree x2048 14.846 ms/op 13.676 ms/op 1.09
bytes32 toHexString 1.1990 us/op 1.1100 us/op 1.08
bytes32 Buffer.toString(hex) 834.00 ns/op 739.00 ns/op 1.13
bytes32 Buffer.toString(hex) from Uint8Array 1.0660 us/op 1.0170 us/op 1.05
bytes32 Buffer.toString(hex) + 0x 827.00 ns/op 738.00 ns/op 1.12
Object access 1 prop 0.44400 ns/op 0.37900 ns/op 1.17
Map access 1 prop 0.35500 ns/op 0.32300 ns/op 1.10
Object get x1000 21.297 ns/op 19.225 ns/op 1.11
Map get x1000 1.1980 ns/op 1.0890 ns/op 1.10
Object set x1000 139.03 ns/op 128.78 ns/op 1.08
Map set x1000 81.171 ns/op 76.547 ns/op 1.06
Return object 10000 times 0.44710 ns/op 0.40490 ns/op 1.10
Throw Error 10000 times 6.9566 us/op 6.5361 us/op 1.06
enrSubnets - fastDeserialize 64 bits 3.0480 us/op 2.7400 us/op 1.11
enrSubnets - ssz BitVector 64 bits 850.00 ns/op 768.00 ns/op 1.11
enrSubnets - fastDeserialize 4 bits 443.00 ns/op 405.00 ns/op 1.09
enrSubnets - ssz BitVector 4 bits 863.00 ns/op 791.00 ns/op 1.09
prioritizePeers score -10:0 att 32-0.1 sync 2-0 107.95 us/op 98.915 us/op 1.09
prioritizePeers score 0:0 att 32-0.25 sync 2-0.25 144.37 us/op 130.69 us/op 1.10
prioritizePeers score 0:0 att 32-0.5 sync 2-0.5 252.12 us/op 252.17 us/op 1.00
prioritizePeers score 0:0 att 64-0.75 sync 4-0.75 536.51 us/op 513.93 us/op 1.04
prioritizePeers score 0:0 att 64-1 sync 4-1 546.73 us/op 501.68 us/op 1.09
RateTracker 1000000 limit, 1 obj count per request 235.85 ns/op 203.55 ns/op 1.16
RateTracker 1000000 limit, 2 obj count per request 179.11 ns/op 162.18 ns/op 1.10
RateTracker 1000000 limit, 4 obj count per request 150.59 ns/op 138.17 ns/op 1.09
RateTracker 1000000 limit, 8 obj count per request 141.17 ns/op 121.04 ns/op 1.17
RateTracker with prune 4.8990 us/op 5.0040 us/op 0.98
array of 16000 items push then shift 3.7252 us/op 3.7203 us/op 1.00
LinkedList of 16000 items push then shift 19.850 ns/op 19.420 ns/op 1.02
array of 16000 items push then pop 265.20 ns/op 272.87 ns/op 0.97
LinkedList of 16000 items push then pop 19.574 ns/op 18.339 ns/op 1.07
array of 24000 items push then shift 5.3749 us/op 4.8566 us/op 1.11
LinkedList of 24000 items push then shift 22.458 ns/op 22.232 ns/op 1.01
array of 24000 items push then pop 247.00 ns/op 228.91 ns/op 1.08
LinkedList of 24000 items push then pop 21.245 ns/op 20.427 ns/op 1.04
intersect bitArray bitLen 8 13.958 ns/op 13.737 ns/op 1.02
intersect array and set length 8 188.26 ns/op 191.77 ns/op 0.98
intersect bitArray bitLen 128 74.200 ns/op 71.477 ns/op 1.04
intersect array and set length 128 2.6038 us/op 2.5068 us/op 1.04
Buffer.concat 32 items 2.2780 ns/op 2.0640 ns/op 1.10
pass gossip attestations to forkchoice per slot 3.6990 ms/op 6.7383 ms/op 0.55
computeDeltas 4.1813 ms/op 3.4606 ms/op 1.21
computeProposerBoostScoreFromBalances 1.1001 ms/op 985.31 us/op 1.12
altair processAttestation - 250000 vs - 7PWei normalcase 4.2073 ms/op 4.1700 ms/op 1.01
altair processAttestation - 250000 vs - 7PWei worstcase 6.5224 ms/op 7.0033 ms/op 0.93
altair processAttestation - setStatus - 1/6 committees join 245.43 us/op 252.17 us/op 0.97
altair processAttestation - setStatus - 1/3 committees join 474.12 us/op 436.03 us/op 1.09
altair processAttestation - setStatus - 1/2 committees join 664.90 us/op 691.11 us/op 0.96
altair processAttestation - setStatus - 2/3 committees join 857.42 us/op 803.45 us/op 1.07
altair processAttestation - setStatus - 4/5 committees join 1.1996 ms/op 1.1901 ms/op 1.01
altair processAttestation - setStatus - 100% committees join 1.3994 ms/op 1.3496 ms/op 1.04
altair processBlock - 250000 vs - 7PWei normalcase 32.180 ms/op 33.441 ms/op 0.96
altair processBlock - 250000 vs - 7PWei normalcase hashState 42.793 ms/op 43.478 ms/op 0.98
altair processBlock - 250000 vs - 7PWei worstcase 93.065 ms/op 87.933 ms/op 1.06
altair processBlock - 250000 vs - 7PWei worstcase hashState 119.13 ms/op 120.50 ms/op 0.99
phase0 processBlock - 250000 vs - 7PWei normalcase 4.1237 ms/op 3.7084 ms/op 1.11
phase0 processBlock - 250000 vs - 7PWei worstcase 55.157 ms/op 51.956 ms/op 1.06
altair processEth1Data - 250000 vs - 7PWei normalcase 965.22 us/op 879.36 us/op 1.10
Tree 40 250000 create 916.69 ms/op 918.13 ms/op 1.00
Tree 40 250000 get(125000) 343.35 ns/op 301.87 ns/op 1.14
Tree 40 250000 set(125000) 2.7588 us/op 2.9380 us/op 0.94
Tree 40 250000 toArray() 37.712 ms/op 36.132 ms/op 1.04
Tree 40 250000 iterate all - toArray() + loop 37.244 ms/op 38.984 ms/op 0.96
Tree 40 250000 iterate all - get(i) 131.14 ms/op 117.59 ms/op 1.12
MutableVector 250000 create 18.232 ms/op 15.888 ms/op 1.15
MutableVector 250000 get(125000) 15.709 ns/op 16.829 ns/op 0.93
MutableVector 250000 set(125000) 730.21 ns/op 630.18 ns/op 1.16
MutableVector 250000 toArray() 8.8126 ms/op 7.7221 ms/op 1.14
MutableVector 250000 iterate all - toArray() + loop 8.5853 ms/op 7.6218 ms/op 1.13
MutableVector 250000 iterate all - get(i) 4.1298 ms/op 3.7528 ms/op 1.10
Array 250000 create 7.9625 ms/op 7.4464 ms/op 1.07
Array 250000 clone - spread 4.4698 ms/op 3.3753 ms/op 1.32
Array 250000 get(125000) 1.8350 ns/op 1.5290 ns/op 1.20
Array 250000 set(125000) 1.7860 ns/op 1.4290 ns/op 1.25
Array 250000 iterate all - loop 200.26 us/op 187.03 us/op 1.07
effectiveBalanceIncrements clone Uint8Array 300000 91.856 us/op 89.068 us/op 1.03
effectiveBalanceIncrements clone MutableVector 300000 1.3370 us/op 1.0390 us/op 1.29
effectiveBalanceIncrements rw all Uint8Array 300000 300.85 us/op 297.45 us/op 1.01
effectiveBalanceIncrements rw all MutableVector 300000 238.33 ms/op 203.29 ms/op 1.17
phase0 afterProcessEpoch - 250000 vs - 7PWei 220.09 ms/op 199.57 ms/op 1.10
phase0 beforeProcessEpoch - 250000 vs - 7PWei 114.33 ms/op 105.70 ms/op 1.08
altair processEpoch - mainnet_e81889 685.44 ms/op 652.35 ms/op 1.05
mainnet_e81889 - altair beforeProcessEpoch 195.26 ms/op 167.73 ms/op 1.16
mainnet_e81889 - altair processJustificationAndFinalization 39.463 us/op 43.865 us/op 0.90
mainnet_e81889 - altair processInactivityUpdates 12.792 ms/op 12.063 ms/op 1.06
mainnet_e81889 - altair processRewardsAndPenalties 106.61 ms/op 106.52 ms/op 1.00
mainnet_e81889 - altair processRegistryUpdates 8.6180 us/op 8.2170 us/op 1.05
mainnet_e81889 - altair processSlashings 1.9320 us/op 1.4540 us/op 1.33
mainnet_e81889 - altair processEth1DataReset 2.0770 us/op 1.6710 us/op 1.24
mainnet_e81889 - altair processEffectiveBalanceUpdates 3.0133 ms/op 2.8621 ms/op 1.05
mainnet_e81889 - altair processSlashingsReset 12.282 us/op 14.933 us/op 0.82
mainnet_e81889 - altair processRandaoMixesReset 14.938 us/op 14.917 us/op 1.00
mainnet_e81889 - altair processHistoricalRootsUpdate 1.8260 us/op 2.0110 us/op 0.91
mainnet_e81889 - altair processParticipationFlagUpdates 6.7120 us/op 7.3660 us/op 0.91
mainnet_e81889 - altair processSyncCommitteeUpdates 2.0060 us/op 1.7260 us/op 1.16
mainnet_e81889 - altair afterProcessEpoch 228.43 ms/op 219.15 ms/op 1.04
phase0 processEpoch - mainnet_e58758 620.37 ms/op 683.93 ms/op 0.91
mainnet_e58758 - phase0 beforeProcessEpoch 263.55 ms/op 250.08 ms/op 1.05
mainnet_e58758 - phase0 processJustificationAndFinalization 38.682 us/op 39.069 us/op 0.99
mainnet_e58758 - phase0 processRewardsAndPenalties 91.934 ms/op 148.60 ms/op 0.62
mainnet_e58758 - phase0 processRegistryUpdates 20.630 us/op 24.347 us/op 0.85
mainnet_e58758 - phase0 processSlashings 1.7320 us/op 1.8440 us/op 0.94
mainnet_e58758 - phase0 processEth1DataReset 2.1420 us/op 2.4550 us/op 0.87
mainnet_e58758 - phase0 processEffectiveBalanceUpdates 2.3725 ms/op 2.7952 ms/op 0.85
mainnet_e58758 - phase0 processSlashingsReset 9.4900 us/op 12.566 us/op 0.76
mainnet_e58758 - phase0 processRandaoMixesReset 13.776 us/op 14.223 us/op 0.97
mainnet_e58758 - phase0 processHistoricalRootsUpdate 2.2890 us/op 2.3840 us/op 0.96
mainnet_e58758 - phase0 processParticipationRecordUpdates 13.907 us/op 15.156 us/op 0.92
mainnet_e58758 - phase0 afterProcessEpoch 190.58 ms/op 172.43 ms/op 1.11
phase0 processEffectiveBalanceUpdates - 250000 normalcase 3.1120 ms/op 3.0088 ms/op 1.03
phase0 processEffectiveBalanceUpdates - 250000 worstcase 0.5 4.2263 ms/op 3.9343 ms/op 1.07
altair processInactivityUpdates - 250000 normalcase 46.294 ms/op 44.605 ms/op 1.04
altair processInactivityUpdates - 250000 worstcase 47.127 ms/op 50.704 ms/op 0.93
phase0 processRegistryUpdates - 250000 normalcase 19.211 us/op 18.453 us/op 1.04
phase0 processRegistryUpdates - 250000 badcase_full_deposits 588.49 us/op 623.83 us/op 0.94
phase0 processRegistryUpdates - 250000 worstcase 0.5 279.38 ms/op 230.36 ms/op 1.21
altair processRewardsAndPenalties - 250000 normalcase 107.68 ms/op 129.28 ms/op 0.83
altair processRewardsAndPenalties - 250000 worstcase 95.089 ms/op 141.54 ms/op 0.67
phase0 getAttestationDeltas - 250000 normalcase 14.703 ms/op 13.987 ms/op 1.05
phase0 getAttestationDeltas - 250000 worstcase 15.597 ms/op 14.037 ms/op 1.11
phase0 processSlashings - 250000 worstcase 6.6635 ms/op 6.2063 ms/op 1.07
altair processSyncCommitteeUpdates - 250000 327.43 ms/op 305.34 ms/op 1.07
BeaconState.hashTreeRoot - No change 579.00 ns/op 619.00 ns/op 0.94
BeaconState.hashTreeRoot - 1 full validator 72.520 us/op 71.828 us/op 1.01
BeaconState.hashTreeRoot - 32 full validator 776.13 us/op 727.65 us/op 1.07
BeaconState.hashTreeRoot - 512 full validator 7.5690 ms/op 7.7673 ms/op 0.97
BeaconState.hashTreeRoot - 1 validator.effectiveBalance 102.44 us/op 92.138 us/op 1.11
BeaconState.hashTreeRoot - 32 validator.effectiveBalance 1.3580 ms/op 1.3779 ms/op 0.99
BeaconState.hashTreeRoot - 512 validator.effectiveBalance 18.647 ms/op 18.210 ms/op 1.02
BeaconState.hashTreeRoot - 1 balances 71.431 us/op 70.920 us/op 1.01
BeaconState.hashTreeRoot - 32 balances 696.48 us/op 726.74 us/op 0.96
BeaconState.hashTreeRoot - 512 balances 6.8937 ms/op 6.5449 ms/op 1.05
BeaconState.hashTreeRoot - 250000 balances 112.94 ms/op 101.72 ms/op 1.11
aggregationBits - 2048 els - zipIndexesInBitList 38.846 us/op 36.185 us/op 1.07
regular array get 100000 times 80.765 us/op 75.171 us/op 1.07
wrappedArray get 100000 times 80.589 us/op 75.715 us/op 1.06
arrayWithProxy get 100000 times 34.440 ms/op 33.640 ms/op 1.02
ssz.Root.equals 579.00 ns/op 550.00 ns/op 1.05
byteArrayEquals 550.00 ns/op 562.00 ns/op 0.98
shuffle list - 16384 els 13.288 ms/op 12.462 ms/op 1.07
shuffle list - 250000 els 195.27 ms/op 178.58 ms/op 1.09
processSlot - 1 slots 16.408 us/op 13.607 us/op 1.21
processSlot - 32 slots 2.0241 ms/op 2.0080 ms/op 1.01
getEffectiveBalanceIncrementsZeroInactive - 250000 vs - 7PWei 443.25 us/op 420.25 us/op 1.05
getCommitteeAssignments - req 1 vs - 250000 vc 6.3976 ms/op 6.2031 ms/op 1.03
getCommitteeAssignments - req 100 vs - 250000 vc 8.7540 ms/op 8.0961 ms/op 1.08
getCommitteeAssignments - req 1000 vs - 250000 vc 9.3809 ms/op 8.6075 ms/op 1.09
RootCache.getBlockRootAtSlot - 250000 vs - 7PWei 12.270 ns/op 11.120 ns/op 1.10
state getBlockRootAtSlot - 250000 vs - 7PWei 1.4120 us/op 1.3587 us/op 1.04
computeProposers - vc 250000 19.146 ms/op 18.230 ms/op 1.05
computeEpochShuffling - vc 250000 196.40 ms/op 187.47 ms/op 1.05
getNextSyncCommittee - vc 250000 321.32 ms/op 308.38 ms/op 1.04

by benchmarkbot/action

@dapplion dapplion marked this pull request as draft September 3, 2022 15:08
@g11tech g11tech marked this pull request as ready for review September 24, 2022 07:34
@g11tech g11tech enabled auto-merge (squash) September 24, 2022 15:51
@g11tech g11tech merged commit 071cecf into unstable Sep 26, 2022
@g11tech g11tech deleted the g11tech/update-merge-ci branch September 26, 2022 16:03
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants