Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

chore: add job names to __inputs if used by dashboard #5672

Merged
merged 2 commits into from
Jun 20, 2023

Conversation

nflaig
Copy link
Member

@nflaig nflaig commented Jun 20, 2023

Motivation

As noted in #5525, __inputs must be manually set. Currently, the script to lint/update dashboards only adds Prometheus to __inputs but we also need to set job names (#5211) if job variables are used by the dashboard.

Description

Add job names to __inputs if used by dashboard.

Lint script now checks templating list for query and if it finds match, adds job name to __inputs.

"query": "${VAR_BEACON_JOB}",

@github-actions
Copy link
Contributor

Performance Report

✔️ no performance regression detected

Full benchmark results
Benchmark suite Current: 607f5ec Previous: 7c54a7b Ratio
getPubkeys - index2pubkey - req 1000 vs - 250000 vc 843.71 us/op 999.28 us/op 0.84
getPubkeys - validatorsArr - req 1000 vs - 250000 vc 46.655 us/op 49.398 us/op 0.94
BLS verify - blst-native 1.2029 ms/op 1.2294 ms/op 0.98
BLS verifyMultipleSignatures 3 - blst-native 2.4579 ms/op 2.4835 ms/op 0.99
BLS verifyMultipleSignatures 8 - blst-native 5.2641 ms/op 5.3432 ms/op 0.99
BLS verifyMultipleSignatures 32 - blst-native 19.005 ms/op 19.363 ms/op 0.98
BLS aggregatePubkeys 32 - blst-native 25.607 us/op 25.802 us/op 0.99
BLS aggregatePubkeys 128 - blst-native 100.09 us/op 101.26 us/op 0.99
getAttestationsForBlock 50.282 ms/op 58.965 ms/op 0.85
isKnown best case - 1 super set check 247.00 ns/op 263.00 ns/op 0.94
isKnown normal case - 2 super set checks 246.00 ns/op 255.00 ns/op 0.96
isKnown worse case - 16 super set checks 244.00 ns/op 257.00 ns/op 0.95
CheckpointStateCache - add get delete 5.0140 us/op 5.3580 us/op 0.94
validate gossip signedAggregateAndProof - struct 2.7781 ms/op 2.8639 ms/op 0.97
validate gossip attestation - struct 1.2978 ms/op 1.3503 ms/op 0.96
pickEth1Vote - no votes 1.2069 ms/op 1.3847 ms/op 0.87
pickEth1Vote - max votes 8.3556 ms/op 10.475 ms/op 0.80
pickEth1Vote - Eth1Data hashTreeRoot value x2048 8.5288 ms/op 9.4063 ms/op 0.91
pickEth1Vote - Eth1Data hashTreeRoot tree x2048 14.127 ms/op 15.320 ms/op 0.92
pickEth1Vote - Eth1Data fastSerialize value x2048 649.04 us/op 678.66 us/op 0.96
pickEth1Vote - Eth1Data fastSerialize tree x2048 5.6475 ms/op 7.3198 ms/op 0.77
bytes32 toHexString 483.00 ns/op 580.00 ns/op 0.83
bytes32 Buffer.toString(hex) 354.00 ns/op 417.00 ns/op 0.85
bytes32 Buffer.toString(hex) from Uint8Array 546.00 ns/op 616.00 ns/op 0.89
bytes32 Buffer.toString(hex) + 0x 351.00 ns/op 405.00 ns/op 0.87
Object access 1 prop 0.16400 ns/op 0.18900 ns/op 0.87
Map access 1 prop 0.15400 ns/op 0.16800 ns/op 0.92
Object get x1000 6.4680 ns/op 6.8420 ns/op 0.95
Map get x1000 0.62000 ns/op 0.67100 ns/op 0.92
Object set x1000 52.168 ns/op 67.850 ns/op 0.77
Map set x1000 47.012 ns/op 55.320 ns/op 0.85
Return object 10000 times 0.23540 ns/op 0.24930 ns/op 0.94
Throw Error 10000 times 4.1350 us/op 4.4592 us/op 0.93
fastMsgIdFn sha256 / 200 bytes 3.4140 us/op 3.7520 us/op 0.91
fastMsgIdFn h32 xxhash / 200 bytes 273.00 ns/op 331.00 ns/op 0.82
fastMsgIdFn h64 xxhash / 200 bytes 394.00 ns/op 517.00 ns/op 0.76
fastMsgIdFn sha256 / 1000 bytes 11.544 us/op 12.149 us/op 0.95
fastMsgIdFn h32 xxhash / 1000 bytes 402.00 ns/op 468.00 ns/op 0.86
fastMsgIdFn h64 xxhash / 1000 bytes 471.00 ns/op 587.00 ns/op 0.80
fastMsgIdFn sha256 / 10000 bytes 103.67 us/op 110.20 us/op 0.94
fastMsgIdFn h32 xxhash / 10000 bytes 1.9150 us/op 2.0610 us/op 0.93
fastMsgIdFn h64 xxhash / 10000 bytes 1.3610 us/op 1.5160 us/op 0.90
enrSubnets - fastDeserialize 64 bits 1.2690 us/op 2.0830 us/op 0.61
enrSubnets - ssz BitVector 64 bits 486.00 ns/op 699.00 ns/op 0.70
enrSubnets - fastDeserialize 4 bits 180.00 ns/op 233.00 ns/op 0.77
enrSubnets - ssz BitVector 4 bits 496.00 ns/op 696.00 ns/op 0.71
prioritizePeers score -10:0 att 32-0.1 sync 2-0 106.74 us/op 141.38 us/op 0.75
prioritizePeers score 0:0 att 32-0.25 sync 2-0.25 135.26 us/op 153.54 us/op 0.88
prioritizePeers score 0:0 att 32-0.5 sync 2-0.5 171.66 us/op 195.89 us/op 0.88
prioritizePeers score 0:0 att 64-0.75 sync 4-0.75 299.14 us/op 375.83 us/op 0.80
prioritizePeers score 0:0 att 64-1 sync 4-1 374.45 us/op 455.24 us/op 0.82
array of 16000 items push then shift 1.6503 us/op 1.7552 us/op 0.94
LinkedList of 16000 items push then shift 8.7500 ns/op 10.505 ns/op 0.83
array of 16000 items push then pop 100.75 ns/op 130.59 ns/op 0.77
LinkedList of 16000 items push then pop 8.8570 ns/op 10.301 ns/op 0.86
array of 24000 items push then shift 2.2873 us/op 2.4906 us/op 0.92
LinkedList of 24000 items push then shift 8.7110 ns/op 11.606 ns/op 0.75
array of 24000 items push then pop 75.897 ns/op 100.75 ns/op 0.75
LinkedList of 24000 items push then pop 8.4490 ns/op 10.552 ns/op 0.80
intersect bitArray bitLen 8 12.975 ns/op 14.189 ns/op 0.91
intersect array and set length 8 76.836 ns/op 105.05 ns/op 0.73
intersect bitArray bitLen 128 42.761 ns/op 46.730 ns/op 0.92
intersect array and set length 128 1.0646 us/op 1.3194 us/op 0.81
Buffer.concat 32 items 2.9320 us/op 2.9010 us/op 1.01
Uint8Array.set 32 items 2.6620 us/op 2.5610 us/op 1.04
transfer serialized Status (84 B) 2.1330 us/op 2.2690 us/op 0.94
copy serialized Status (84 B) 1.8600 us/op 1.8530 us/op 1.00
transfer serialized SignedVoluntaryExit (112 B) 2.2760 us/op 2.7100 us/op 0.84
copy serialized SignedVoluntaryExit (112 B) 1.8850 us/op 1.9140 us/op 0.98
transfer serialized ProposerSlashing (416 B) 3.1180 us/op 2.8090 us/op 1.11
copy serialized ProposerSlashing (416 B) 2.8130 us/op 3.4940 us/op 0.81
transfer serialized Attestation (485 B) 2.9090 us/op 2.9190 us/op 1.00
copy serialized Attestation (485 B) 3.2000 us/op 3.4120 us/op 0.94
transfer serialized AttesterSlashing (33232 B) 3.2190 us/op 2.9080 us/op 1.11
copy serialized AttesterSlashing (33232 B) 6.4460 us/op 8.3450 us/op 0.77
transfer serialized Small SignedBeaconBlock (128000 B) 3.5800 us/op 2.8980 us/op 1.24
copy serialized Small SignedBeaconBlock (128000 B) 42.078 us/op 21.109 us/op 1.99
transfer serialized Avg SignedBeaconBlock (200000 B) 3.7400 us/op 3.4130 us/op 1.10
copy serialized Avg SignedBeaconBlock (200000 B) 69.200 us/op 36.623 us/op 1.89
transfer serialized BlobsSidecar (524380 B) 3.6500 us/op 3.3190 us/op 1.10
copy serialized BlobsSidecar (524380 B) 165.96 us/op 83.488 us/op 1.99
transfer serialized Big SignedBeaconBlock (1000000 B) 3.7190 us/op 3.6590 us/op 1.02
copy serialized Big SignedBeaconBlock (1000000 B) 274.65 us/op 385.38 us/op 0.71
pass gossip attestations to forkchoice per slot 2.6248 ms/op 2.7385 ms/op 0.96
forkChoice updateHead vc 100000 bc 64 eq 0 2.0461 ms/op 2.2827 ms/op 0.90
forkChoice updateHead vc 600000 bc 64 eq 0 11.414 ms/op 15.436 ms/op 0.74
forkChoice updateHead vc 1000000 bc 64 eq 0 21.489 ms/op 18.979 ms/op 1.13
forkChoice updateHead vc 600000 bc 320 eq 0 17.148 ms/op 17.071 ms/op 1.00
forkChoice updateHead vc 600000 bc 1200 eq 0 78.819 ms/op 85.143 ms/op 0.93
forkChoice updateHead vc 600000 bc 64 eq 1000 20.376 ms/op 21.018 ms/op 0.97
forkChoice updateHead vc 600000 bc 64 eq 10000 22.551 ms/op 22.753 ms/op 0.99
forkChoice updateHead vc 600000 bc 64 eq 300000 30.094 ms/op 33.689 ms/op 0.89
computeDeltas 3.7073 ms/op 3.0721 ms/op 1.21
computeProposerBoostScoreFromBalances 1.7859 ms/op 1.8093 ms/op 0.99
altair processAttestation - 250000 vs - 7PWei normalcase 2.1663 ms/op 3.4067 ms/op 0.64
altair processAttestation - 250000 vs - 7PWei worstcase 4.1356 ms/op 4.3271 ms/op 0.96
altair processAttestation - setStatus - 1/6 committees join 139.72 us/op 150.63 us/op 0.93
altair processAttestation - setStatus - 1/3 committees join 276.00 us/op 299.13 us/op 0.92
altair processAttestation - setStatus - 1/2 committees join 369.46 us/op 399.18 us/op 0.93
altair processAttestation - setStatus - 2/3 committees join 464.15 us/op 483.36 us/op 0.96
altair processAttestation - setStatus - 4/5 committees join 648.64 us/op 695.04 us/op 0.93
altair processAttestation - setStatus - 100% committees join 787.75 us/op 809.25 us/op 0.97
altair processBlock - 250000 vs - 7PWei normalcase 16.864 ms/op 18.498 ms/op 0.91
altair processBlock - 250000 vs - 7PWei normalcase hashState 25.213 ms/op 27.078 ms/op 0.93
altair processBlock - 250000 vs - 7PWei worstcase 45.852 ms/op 50.977 ms/op 0.90
altair processBlock - 250000 vs - 7PWei worstcase hashState 66.627 ms/op 74.414 ms/op 0.90
phase0 processBlock - 250000 vs - 7PWei normalcase 2.1251 ms/op 2.3185 ms/op 0.92
phase0 processBlock - 250000 vs - 7PWei worstcase 28.587 ms/op 31.311 ms/op 0.91
altair processEth1Data - 250000 vs - 7PWei normalcase 453.87 us/op 587.80 us/op 0.77
getExpectedWithdrawals 250000 eb:1,eth1:1,we:0,wn:0,smpl:15 7.0040 us/op 8.8160 us/op 0.79
getExpectedWithdrawals 250000 eb:0.95,eth1:0.1,we:0.05,wn:0,smpl:219 19.407 us/op 29.622 us/op 0.66
getExpectedWithdrawals 250000 eb:0.95,eth1:0.3,we:0.05,wn:0,smpl:42 8.6930 us/op 11.396 us/op 0.76
getExpectedWithdrawals 250000 eb:0.95,eth1:0.7,we:0.05,wn:0,smpl:18 6.3580 us/op 10.031 us/op 0.63
getExpectedWithdrawals 250000 eb:0.1,eth1:0.1,we:0,wn:0,smpl:1020 74.485 us/op 121.88 us/op 0.61
getExpectedWithdrawals 250000 eb:0.03,eth1:0.03,we:0,wn:0,smpl:11777 672.23 us/op 1.0109 ms/op 0.66
getExpectedWithdrawals 250000 eb:0.01,eth1:0.01,we:0,wn:0,smpl:16384 891.19 us/op 969.32 us/op 0.92
getExpectedWithdrawals 250000 eb:0,eth1:0,we:0,wn:0,smpl:16384 884.65 us/op 909.13 us/op 0.97
getExpectedWithdrawals 250000 eb:0,eth1:0,we:0,wn:0,nocache,smpl:16384 2.2782 ms/op 2.7209 ms/op 0.84
getExpectedWithdrawals 250000 eb:0,eth1:1,we:0,wn:0,smpl:16384 1.6640 ms/op 1.5087 ms/op 1.10
getExpectedWithdrawals 250000 eb:0,eth1:1,we:0,wn:0,nocache,smpl:16384 3.9385 ms/op 4.1415 ms/op 0.95
Tree 40 250000 create 284.98 ms/op 416.49 ms/op 0.68
Tree 40 250000 get(125000) 172.24 ns/op 190.85 ns/op 0.90
Tree 40 250000 set(125000) 858.46 ns/op 1.0286 us/op 0.83
Tree 40 250000 toArray() 19.163 ms/op 22.266 ms/op 0.86
Tree 40 250000 iterate all - toArray() + loop 19.273 ms/op 21.139 ms/op 0.91
Tree 40 250000 iterate all - get(i) 68.942 ms/op 76.250 ms/op 0.90
MutableVector 250000 create 10.117 ms/op 11.697 ms/op 0.86
MutableVector 250000 get(125000) 6.3270 ns/op 6.4500 ns/op 0.98
MutableVector 250000 set(125000) 264.01 ns/op 293.80 ns/op 0.90
MutableVector 250000 toArray() 2.9106 ms/op 4.3259 ms/op 0.67
MutableVector 250000 iterate all - toArray() + loop 3.1327 ms/op 4.0404 ms/op 0.78
MutableVector 250000 iterate all - get(i) 1.4621 ms/op 1.5584 ms/op 0.94
Array 250000 create 2.5740 ms/op 2.9307 ms/op 0.88
Array 250000 clone - spread 1.0819 ms/op 1.1283 ms/op 0.96
Array 250000 get(125000) 0.51900 ns/op 0.55700 ns/op 0.93
Array 250000 set(125000) 0.59200 ns/op 0.62700 ns/op 0.94
Array 250000 iterate all - loop 87.688 us/op 83.141 us/op 1.05
effectiveBalanceIncrements clone Uint8Array 300000 27.019 us/op 30.999 us/op 0.87
effectiveBalanceIncrements clone MutableVector 300000 333.00 ns/op 338.00 ns/op 0.99
effectiveBalanceIncrements rw all Uint8Array 300000 175.43 us/op 170.44 us/op 1.03
effectiveBalanceIncrements rw all MutableVector 300000 80.022 ms/op 90.105 ms/op 0.89
phase0 afterProcessEpoch - 250000 vs - 7PWei 113.13 ms/op 117.89 ms/op 0.96
phase0 beforeProcessEpoch - 250000 vs - 7PWei 43.211 ms/op 43.978 ms/op 0.98
altair processEpoch - mainnet_e81889 347.91 ms/op 327.52 ms/op 1.06
mainnet_e81889 - altair beforeProcessEpoch 72.337 ms/op 53.086 ms/op 1.36
mainnet_e81889 - altair processJustificationAndFinalization 19.606 us/op 19.284 us/op 1.02
mainnet_e81889 - altair processInactivityUpdates 5.5216 ms/op 6.3005 ms/op 0.88
mainnet_e81889 - altair processRewardsAndPenalties 50.625 ms/op 65.228 ms/op 0.78
mainnet_e81889 - altair processRegistryUpdates 4.1610 us/op 2.7470 us/op 1.51
mainnet_e81889 - altair processSlashings 538.00 ns/op 541.00 ns/op 0.99
mainnet_e81889 - altair processEth1DataReset 534.00 ns/op 572.00 ns/op 0.93
mainnet_e81889 - altair processEffectiveBalanceUpdates 1.2738 ms/op 1.2623 ms/op 1.01
mainnet_e81889 - altair processSlashingsReset 5.4990 us/op 4.7430 us/op 1.16
mainnet_e81889 - altair processRandaoMixesReset 6.1010 us/op 7.2620 us/op 0.84
mainnet_e81889 - altair processHistoricalRootsUpdate 1.5920 us/op 838.00 ns/op 1.90
mainnet_e81889 - altair processParticipationFlagUpdates 7.5420 us/op 2.4060 us/op 3.13
mainnet_e81889 - altair processSyncCommitteeUpdates 1.3130 us/op 779.00 ns/op 1.69
mainnet_e81889 - altair afterProcessEpoch 159.41 ms/op 131.69 ms/op 1.21
phase0 processEpoch - mainnet_e58758 472.88 ms/op 371.22 ms/op 1.27
mainnet_e58758 - phase0 beforeProcessEpoch 194.33 ms/op 114.26 ms/op 1.70
mainnet_e58758 - phase0 processJustificationAndFinalization 33.690 us/op 17.820 us/op 1.89
mainnet_e58758 - phase0 processRewardsAndPenalties 77.353 ms/op 61.876 ms/op 1.25
mainnet_e58758 - phase0 processRegistryUpdates 16.294 us/op 8.6890 us/op 1.88
mainnet_e58758 - phase0 processSlashings 1.1800 us/op 565.00 ns/op 2.09
mainnet_e58758 - phase0 processEth1DataReset 1.4950 us/op 709.00 ns/op 2.11
mainnet_e58758 - phase0 processEffectiveBalanceUpdates 2.0436 ms/op 1.1167 ms/op 1.83
mainnet_e58758 - phase0 processSlashingsReset 13.306 us/op 3.9500 us/op 3.37
mainnet_e58758 - phase0 processRandaoMixesReset 11.650 us/op 4.9880 us/op 2.34
mainnet_e58758 - phase0 processHistoricalRootsUpdate 2.1350 us/op 1.1200 us/op 1.91
mainnet_e58758 - phase0 processParticipationRecordUpdates 8.6620 us/op 4.7860 us/op 1.81
mainnet_e58758 - phase0 afterProcessEpoch 135.55 ms/op 102.27 ms/op 1.33
phase0 processEffectiveBalanceUpdates - 250000 normalcase 2.7234 ms/op 1.2511 ms/op 2.18
phase0 processEffectiveBalanceUpdates - 250000 worstcase 0.5 2.6728 ms/op 1.5188 ms/op 1.76
altair processInactivityUpdates - 250000 normalcase 38.304 ms/op 25.358 ms/op 1.51
altair processInactivityUpdates - 250000 worstcase 27.139 ms/op 29.813 ms/op 0.91
phase0 processRegistryUpdates - 250000 normalcase 8.6210 us/op 7.9780 us/op 1.08
phase0 processRegistryUpdates - 250000 badcase_full_deposits 281.97 us/op 274.66 us/op 1.03
phase0 processRegistryUpdates - 250000 worstcase 0.5 142.74 ms/op 114.42 ms/op 1.25
altair processRewardsAndPenalties - 250000 normalcase 72.660 ms/op 72.339 ms/op 1.00
altair processRewardsAndPenalties - 250000 worstcase 70.099 ms/op 77.500 ms/op 0.90
phase0 getAttestationDeltas - 250000 normalcase 8.3995 ms/op 10.486 ms/op 0.80
phase0 getAttestationDeltas - 250000 worstcase 7.1214 ms/op 9.5280 ms/op 0.75
phase0 processSlashings - 250000 worstcase 3.8452 ms/op 3.9337 ms/op 0.98
altair processSyncCommitteeUpdates - 250000 181.86 ms/op 185.02 ms/op 0.98
BeaconState.hashTreeRoot - No change 356.00 ns/op 280.00 ns/op 1.27
BeaconState.hashTreeRoot - 1 full validator 56.058 us/op 53.718 us/op 1.04
BeaconState.hashTreeRoot - 32 full validator 571.30 us/op 571.64 us/op 1.00
BeaconState.hashTreeRoot - 512 full validator 5.7550 ms/op 5.7095 ms/op 1.01
BeaconState.hashTreeRoot - 1 validator.effectiveBalance 64.505 us/op 67.097 us/op 0.96
BeaconState.hashTreeRoot - 32 validator.effectiveBalance 966.12 us/op 908.80 us/op 1.06
BeaconState.hashTreeRoot - 512 validator.effectiveBalance 11.635 ms/op 12.471 ms/op 0.93
BeaconState.hashTreeRoot - 1 balances 50.572 us/op 51.750 us/op 0.98
BeaconState.hashTreeRoot - 32 balances 485.91 us/op 459.68 us/op 1.06
BeaconState.hashTreeRoot - 512 balances 4.6614 ms/op 4.5646 ms/op 1.02
BeaconState.hashTreeRoot - 250000 balances 78.793 ms/op 77.613 ms/op 1.02
aggregationBits - 2048 els - zipIndexesInBitList 20.563 us/op 18.862 us/op 1.09
regular array get 100000 times 34.449 us/op 43.459 us/op 0.79
wrappedArray get 100000 times 34.954 us/op 33.290 us/op 1.05
arrayWithProxy get 100000 times 17.090 ms/op 17.213 ms/op 0.99
ssz.Root.equals 602.00 ns/op 572.00 ns/op 1.05
byteArrayEquals 571.00 ns/op 570.00 ns/op 1.00
shuffle list - 16384 els 6.9573 ms/op 7.0420 ms/op 0.99
shuffle list - 250000 els 101.01 ms/op 102.63 ms/op 0.98
processSlot - 1 slots 9.2460 us/op 9.9770 us/op 0.93
processSlot - 32 slots 1.4343 ms/op 1.4398 ms/op 1.00
getEffectiveBalanceIncrementsZeroInactive - 250000 vs - 7PWei 37.065 ms/op 37.287 ms/op 0.99
getCommitteeAssignments - req 1 vs - 250000 vc 3.0511 ms/op 2.9839 ms/op 1.02
getCommitteeAssignments - req 100 vs - 250000 vc 4.3484 ms/op 4.2224 ms/op 1.03
getCommitteeAssignments - req 1000 vs - 250000 vc 4.6591 ms/op 4.5788 ms/op 1.02
RootCache.getBlockRootAtSlot - 250000 vs - 7PWei 5.2100 ns/op 4.9900 ns/op 1.04
state getBlockRootAtSlot - 250000 vs - 7PWei 671.22 ns/op 1.1684 us/op 0.57
computeProposers - vc 250000 11.264 ms/op 11.336 ms/op 0.99
computeEpochShuffling - vc 250000 108.13 ms/op 105.83 ms/op 1.02
getNextSyncCommittee - vc 250000 197.22 ms/op 186.06 ms/op 1.06
computeSigningRoot for AttestationData 15.889 us/op 14.331 us/op 1.11
hash AttestationData serialized data then Buffer.toString(base64) 2.6012 us/op 2.5052 us/op 1.04
toHexString serialized data 1.3656 us/op 1.2089 us/op 1.13
Buffer.toString(base64) 385.66 ns/op 359.56 ns/op 1.07

by benchmarkbot/action

@nflaig nflaig merged commit d1ba8c1 into unstable Jun 20, 2023
11 checks passed
@nflaig nflaig deleted the nflaig/lint-script-add-job-vars branch June 20, 2023 09:56
@wemeetagain
Copy link
Member

🎉 This PR is included in v1.10.0 🎉

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants