Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

chore: use stable firefox release in browser tests #7318

Draft
wants to merge 1 commit into
base: unstable
Choose a base branch
from
Draft

chore: use stable firefox release in browser tests #7318

wants to merge 1 commit into from
+1 −1

Conversation

nflaig
Copy link
Member

@nflaig nflaig commented Dec 19, 2024

Motivation

Closes #7307

Description

Use stable firefox release in browser tests

Their latest tag seems to refer to nightly builds (works on mac as confirmed by @nazarhussain)

❯ npx @puppeteer/browsers install firefox@latest --path /tmp
Need to install the following packages:
@puppeteer/browsers@2.6.1
Ok to proceed? (y) y

Downloading firefox nightly_135.0a1 - 148.3 MB [====================] 100% 0.0s

but the specific version is missing for Linux which causes the CI to fail

@codecov Codecov
Copy link

codecov bot commented Dec 19, 2024

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 48.75%. Comparing base (8c7eaf8) to head (955e3d6).

Additional details and impacted files 
@@            Coverage Diff            @@
##           unstable    #7318   +/-   ##
=========================================
  Coverage     48.75%   48.75%           
=========================================
  Files           601      601           
  Lines         40222    40222           
  Branches       2061     2061           
=========================================
  Hits          19609    19609           
  Misses        20575    20575           
  Partials         38       38

@github-actions GitHub Actions
Copy link
Contributor

Performance Report

✔️ no performance regression detected

Full benchmark results
Benchmark suite Current: 0e1cb19 Previous: 8c7eaf8 Ratio
getPubkeys - index2pubkey - req 1000 vs - 250000 vc 2.8565 ms/op 1.8074 ms/op 1.58
getPubkeys - validatorsArr - req 1000 vs - 250000 vc 67.748 us/op 38.990 us/op 1.74
BLS verify - blst 1.0328 ms/op 890.64 us/op 1.16
BLS verifyMultipleSignatures 3 - blst 1.2850 ms/op 1.3164 ms/op 0.98
BLS verifyMultipleSignatures 8 - blst 2.2156 ms/op 1.5055 ms/op 1.47
BLS verifyMultipleSignatures 32 - blst 5.7691 ms/op 4.5042 ms/op 1.28
BLS verifyMultipleSignatures 64 - blst 10.864 ms/op 8.3678 ms/op 1.30
BLS verifyMultipleSignatures 128 - blst 17.961 ms/op 16.133 ms/op 1.11
BLS deserializing 10000 signatures 714.99 ms/op 621.87 ms/op 1.15
BLS deserializing 100000 signatures 7.2037 s/op 6.3319 s/op 1.14
BLS verifyMultipleSignatures - same message - 3 - blst 1.1476 ms/op 1.0087 ms/op 1.14
BLS verifyMultipleSignatures - same message - 8 - blst 1.2810 ms/op 1.1079 ms/op 1.16
BLS verifyMultipleSignatures - same message - 32 - blst 1.8862 ms/op 1.7670 ms/op 1.07
BLS verifyMultipleSignatures - same message - 64 - blst 2.8590 ms/op 2.4694 ms/op 1.16
BLS verifyMultipleSignatures - same message - 128 - blst 4.8514 ms/op 4.1264 ms/op 1.18
BLS aggregatePubkeys 32 - blst 21.044 us/op 18.352 us/op 1.15
BLS aggregatePubkeys 128 - blst 72.382 us/op 63.289 us/op 1.14
notSeenSlots=1 numMissedVotes=1 numBadVotes=10 75.221 ms/op 96.685 ms/op 0.78
notSeenSlots=1 numMissedVotes=0 numBadVotes=4 68.393 ms/op 51.215 ms/op 1.34
notSeenSlots=2 numMissedVotes=1 numBadVotes=10 47.681 ms/op 39.351 ms/op 1.21
getSlashingsAndExits - default max 121.89 us/op 90.377 us/op 1.35
getSlashingsAndExits - 2k 440.79 us/op 323.01 us/op 1.36
proposeBlockBody type=full, size=empty 6.1881 ms/op 5.8224 ms/op 1.06
isKnown best case - 1 super set check 309.00 ns/op 520.00 ns/op 0.59
isKnown normal case - 2 super set checks 305.00 ns/op 490.00 ns/op 0.62
isKnown worse case - 16 super set checks 306.00 ns/op 493.00 ns/op 0.62
InMemoryCheckpointStateCache - add get delete 3.0600 us/op 3.0460 us/op 1.00
validate api signedAggregateAndProof - struct 2.1256 ms/op 2.1584 ms/op 0.98
validate gossip signedAggregateAndProof - struct 2.1685 ms/op 1.6121 ms/op 1.35
batch validate gossip attestation - vc 640000 - chunk 32 139.44 us/op 135.44 us/op 1.03
batch validate gossip attestation - vc 640000 - chunk 64 123.88 us/op 116.98 us/op 1.06
batch validate gossip attestation - vc 640000 - chunk 128 114.86 us/op 104.77 us/op 1.10
batch validate gossip attestation - vc 640000 - chunk 256 112.13 us/op 97.351 us/op 1.15
pickEth1Vote - no votes 1.1341 ms/op 853.22 us/op 1.33
pickEth1Vote - max votes 7.9908 ms/op 4.9477 ms/op 1.62
pickEth1Vote - Eth1Data hashTreeRoot value x2048 15.971 ms/op 12.384 ms/op 1.29
pickEth1Vote - Eth1Data hashTreeRoot tree x2048 23.748 ms/op 18.687 ms/op 1.27
pickEth1Vote - Eth1Data fastSerialize value x2048 536.69 us/op 354.70 us/op 1.51
pickEth1Vote - Eth1Data fastSerialize tree x2048 3.9296 ms/op 2.5529 ms/op 1.54
bytes32 toHexString 512.00 ns/op 571.00 ns/op 0.90
bytes32 Buffer.toString(hex) 260.00 ns/op 430.00 ns/op 0.60
bytes32 Buffer.toString(hex) from Uint8Array 408.00 ns/op 519.00 ns/op 0.79
bytes32 Buffer.toString(hex) + 0x 260.00 ns/op 426.00 ns/op 0.61
Object access 1 prop 0.14600 ns/op 0.30700 ns/op 0.48
Map access 1 prop 0.13600 ns/op 0.31500 ns/op 0.43
Object get x1000 6.0770 ns/op 4.8800 ns/op 1.25
Map get x1000 6.6140 ns/op 5.5960 ns/op 1.18
Object set x1000 36.102 ns/op 22.748 ns/op 1.59
Map set x1000 23.247 ns/op 19.035 ns/op 1.22
Return object 10000 times 0.30110 ns/op 0.28900 ns/op 1.04
Throw Error 10000 times 3.5233 us/op 2.6490 us/op 1.33
toHex 173.69 ns/op 102.02 ns/op 1.70
Buffer.from 145.71 ns/op 95.163 ns/op 1.53
shared Buffer 90.450 ns/op 64.194 ns/op 1.41
fastMsgIdFn sha256 / 200 bytes 2.3460 us/op 1.9510 us/op 1.20
fastMsgIdFn h32 xxhash / 200 bytes 279.00 ns/op 397.00 ns/op 0.70
fastMsgIdFn h64 xxhash / 200 bytes 270.00 ns/op 437.00 ns/op 0.62
fastMsgIdFn sha256 / 1000 bytes 7.2700 us/op 5.6870 us/op 1.28
fastMsgIdFn h32 xxhash / 1000 bytes 369.00 ns/op 569.00 ns/op 0.65
fastMsgIdFn h64 xxhash / 1000 bytes 353.00 ns/op 563.00 ns/op 0.63
fastMsgIdFn sha256 / 10000 bytes 65.241 us/op 47.149 us/op 1.38
fastMsgIdFn h32 xxhash / 10000 bytes 1.9420 us/op 1.9320 us/op 1.01
fastMsgIdFn h64 xxhash / 10000 bytes 1.2800 us/op 1.3560 us/op 0.94
send data - 1000 256B messages 13.043 ms/op 10.216 ms/op 1.28
send data - 1000 512B messages 18.825 ms/op 13.910 ms/op 1.35
send data - 1000 1024B messages 30.053 ms/op 21.078 ms/op 1.43
send data - 1000 1200B messages 23.747 ms/op 22.076 ms/op 1.08
send data - 1000 2048B messages 35.125 ms/op 30.762 ms/op 1.14
send data - 1000 4096B messages 36.370 ms/op 27.743 ms/op 1.31
send data - 1000 16384B messages 87.863 ms/op 63.125 ms/op 1.39
send data - 1000 65536B messages 253.30 ms/op 235.85 ms/op 1.07
enrSubnets - fastDeserialize 64 bits 1.3580 us/op 1.1670 us/op 1.16
enrSubnets - ssz BitVector 64 bits 408.00 ns/op 524.00 ns/op 0.78
enrSubnets - fastDeserialize 4 bits 162.00 ns/op 332.00 ns/op 0.49
enrSubnets - ssz BitVector 4 bits 416.00 ns/op 513.00 ns/op 0.81
prioritizePeers score -10:0 att 32-0.1 sync 2-0 196.65 us/op 124.02 us/op 1.59
prioritizePeers score 0:0 att 32-0.25 sync 2-0.25 216.62 us/op 155.85 us/op 1.39
prioritizePeers score 0:0 att 32-0.5 sync 2-0.5 330.26 us/op 274.98 us/op 1.20
prioritizePeers score 0:0 att 64-0.75 sync 4-0.75 497.09 us/op 424.34 us/op 1.17
prioritizePeers score 0:0 att 64-1 sync 4-1 974.13 us/op 549.54 us/op 1.77
array of 16000 items push then shift 1.7395 us/op 1.3904 us/op 1.25
LinkedList of 16000 items push then shift 7.8560 ns/op 6.5810 ns/op 1.19
array of 16000 items push then pop 146.44 ns/op 98.578 ns/op 1.49
LinkedList of 16000 items push then pop 7.5480 ns/op 6.2500 ns/op 1.21
array of 24000 items push then shift 2.4658 us/op 1.8311 us/op 1.35
LinkedList of 24000 items push then shift 7.9330 ns/op 7.0260 ns/op 1.13
array of 24000 items push then pop 176.56 ns/op 129.74 ns/op 1.36
LinkedList of 24000 items push then pop 7.7290 ns/op 6.0400 ns/op 1.28
intersect bitArray bitLen 8 6.5490 ns/op 5.2430 ns/op 1.25
intersect array and set length 8 61.917 ns/op 38.226 ns/op 1.62
intersect bitArray bitLen 128 31.152 ns/op 26.689 ns/op 1.17
intersect array and set length 128 817.74 ns/op 573.04 ns/op 1.43
bitArray.getTrueBitIndexes() bitLen 128 2.4320 us/op 2.2160 us/op 1.10
bitArray.getTrueBitIndexes() bitLen 248 4.3570 us/op 3.6210 us/op 1.20
bitArray.getTrueBitIndexes() bitLen 512 8.7740 us/op 7.9820 us/op 1.10
Buffer.concat 32 items 1.0960 us/op 964.00 ns/op 1.14
Uint8Array.set 32 items 1.6330 us/op 1.3530 us/op 1.21
Buffer.copy 2.5170 us/op 1.5720 us/op 1.60
Uint8Array.set - with subarray 3.2560 us/op 1.9570 us/op 1.66
Uint8Array.set - without subarray 1.5710 us/op 1.5350 us/op 1.02
getUint32 - dataview 259.00 ns/op 450.00 ns/op 0.58
getUint32 - manual 204.00 ns/op 358.00 ns/op 0.57
Set add up to 64 items then delete first 2.3988 us/op 1.8245 us/op 1.31
OrderedSet add up to 64 items then delete first 3.6022 us/op 2.8003 us/op 1.29
Set add up to 64 items then delete last 3.1424 us/op 2.0301 us/op 1.55
OrderedSet add up to 64 items then delete last 4.6254 us/op 3.1031 us/op 1.49
Set add up to 64 items then delete middle 2.6758 us/op 2.0396 us/op 1.31
OrderedSet add up to 64 items then delete middle 6.3094 us/op 4.4775 us/op 1.41
Set add up to 128 items then delete first 5.7838 us/op 4.0060 us/op 1.44
OrderedSet add up to 128 items then delete first 9.2642 us/op 6.2874 us/op 1.47
Set add up to 128 items then delete last 6.4216 us/op 3.8592 us/op 1.66
OrderedSet add up to 128 items then delete last 10.389 us/op 6.0305 us/op 1.72
Set add up to 128 items then delete middle 6.4830 us/op 3.8805 us/op 1.67
OrderedSet add up to 128 items then delete middle 16.475 us/op 11.534 us/op 1.43
Set add up to 256 items then delete first 13.822 us/op 8.0104 us/op 1.73
OrderedSet add up to 256 items then delete first 21.363 us/op 12.505 us/op 1.71
Set add up to 256 items then delete last 12.380 us/op 8.5727 us/op 1.44
OrderedSet add up to 256 items then delete last 19.048 us/op 11.648 us/op 1.64
Set add up to 256 items then delete middle 11.888 us/op 7.6783 us/op 1.55
OrderedSet add up to 256 items then delete middle 46.845 us/op 34.725 us/op 1.35
transfer serialized Status (84 B) 1.3910 us/op 1.5190 us/op 0.92
copy serialized Status (84 B) 1.2840 us/op 1.4350 us/op 0.89
transfer serialized SignedVoluntaryExit (112 B) 1.5250 us/op 1.6000 us/op 0.95
copy serialized SignedVoluntaryExit (112 B) 1.2610 us/op 1.3290 us/op 0.95
transfer serialized ProposerSlashing (416 B) 1.9240 us/op 2.0600 us/op 0.93
copy serialized ProposerSlashing (416 B) 2.1550 us/op 2.2270 us/op 0.97
transfer serialized Attestation (485 B) 1.7640 us/op 2.1620 us/op 0.82
copy serialized Attestation (485 B) 1.7810 us/op 2.0100 us/op 0.89
transfer serialized AttesterSlashing (33232 B) 1.9350 us/op 2.2100 us/op 0.88
copy serialized AttesterSlashing (33232 B) 6.4610 us/op 4.5100 us/op 1.43
transfer serialized Small SignedBeaconBlock (128000 B) 2.7770 us/op 2.9600 us/op 0.94
copy serialized Small SignedBeaconBlock (128000 B) 19.014 us/op 14.949 us/op 1.27
transfer serialized Avg SignedBeaconBlock (200000 B) 3.6370 us/op 2.6950 us/op 1.35
copy serialized Avg SignedBeaconBlock (200000 B) 33.026 us/op 13.482 us/op 2.45
transfer serialized BlobsSidecar (524380 B) 3.5350 us/op 2.6850 us/op 1.32
copy serialized BlobsSidecar (524380 B) 253.59 us/op 129.67 us/op 1.96
transfer serialized Big SignedBeaconBlock (1000000 B) 4.1680 us/op 3.1780 us/op 1.31
copy serialized Big SignedBeaconBlock (1000000 B) 223.49 us/op 149.69 us/op 1.49
pass gossip attestations to forkchoice per slot 2.8481 ms/op 2.4587 ms/op 1.16
forkChoice updateHead vc 100000 bc 64 eq 0 505.19 us/op 518.44 us/op 0.97
forkChoice updateHead vc 600000 bc 64 eq 0 3.2881 ms/op 2.2432 ms/op 1.47
forkChoice updateHead vc 1000000 bc 64 eq 0 5.8908 ms/op 3.8635 ms/op 1.52
forkChoice updateHead vc 600000 bc 320 eq 0 3.2779 ms/op 2.3178 ms/op 1.41
forkChoice updateHead vc 600000 bc 1200 eq 0 3.2385 ms/op 2.3608 ms/op 1.37
forkChoice updateHead vc 600000 bc 7200 eq 0 3.6147 ms/op 2.7528 ms/op 1.31
forkChoice updateHead vc 600000 bc 64 eq 1000 10.782 ms/op 9.4366 ms/op 1.14
forkChoice updateHead vc 600000 bc 64 eq 10000 10.520 ms/op 9.2592 ms/op 1.14
forkChoice updateHead vc 600000 bc 64 eq 300000 16.086 ms/op 11.551 ms/op 1.39
computeDeltas 500000 validators 300 proto nodes 5.4880 ms/op 3.3517 ms/op 1.64
computeDeltas 500000 validators 1200 proto nodes 5.3624 ms/op 3.3651 ms/op 1.59
computeDeltas 500000 validators 7200 proto nodes 5.0734 ms/op 3.3389 ms/op 1.52
computeDeltas 750000 validators 300 proto nodes 7.5661 ms/op 5.2220 ms/op 1.45
computeDeltas 750000 validators 1200 proto nodes 7.4815 ms/op 5.1024 ms/op 1.47
computeDeltas 750000 validators 7200 proto nodes 7.6366 ms/op 4.9943 ms/op 1.53
computeDeltas 1400000 validators 300 proto nodes 14.007 ms/op 9.5915 ms/op 1.46
computeDeltas 1400000 validators 1200 proto nodes 13.737 ms/op 9.6614 ms/op 1.42
computeDeltas 1400000 validators 7200 proto nodes 13.830 ms/op 9.5961 ms/op 1.44
computeDeltas 2100000 validators 300 proto nodes 19.979 ms/op 14.242 ms/op 1.40
computeDeltas 2100000 validators 1200 proto nodes 20.531 ms/op 14.796 ms/op 1.39
computeDeltas 2100000 validators 7200 proto nodes 19.806 ms/op 14.877 ms/op 1.33
altair processAttestation - 250000 vs - 7PWei normalcase 3.1106 ms/op 1.8411 ms/op 1.69
altair processAttestation - 250000 vs - 7PWei worstcase 3.7882 ms/op 2.1901 ms/op 1.73
altair processAttestation - setStatus - 1/6 committees join 132.54 us/op 67.230 us/op 1.97
altair processAttestation - setStatus - 1/3 committees join 247.58 us/op 157.84 us/op 1.57
altair processAttestation - setStatus - 1/2 committees join 352.48 us/op 204.17 us/op 1.73
altair processAttestation - setStatus - 2/3 committees join 433.94 us/op 288.70 us/op 1.50
altair processAttestation - setStatus - 4/5 committees join 603.50 us/op 423.14 us/op 1.43
altair processAttestation - setStatus - 100% committees join 729.88 us/op 506.92 us/op 1.44
altair processBlock - 250000 vs - 7PWei normalcase 4.6601 ms/op 5.0832 ms/op 0.92
altair processBlock - 250000 vs - 7PWei normalcase hashState 27.805 ms/op 26.437 ms/op 1.05
altair processBlock - 250000 vs - 7PWei worstcase 36.832 ms/op 37.118 ms/op 0.99
altair processBlock - 250000 vs - 7PWei worstcase hashState 89.936 ms/op 62.806 ms/op 1.43
phase0 processBlock - 250000 vs - 7PWei normalcase 2.2915 ms/op 1.9635 ms/op 1.17
phase0 processBlock - 250000 vs - 7PWei worstcase 25.962 ms/op 27.800 ms/op 0.93
altair processEth1Data - 250000 vs - 7PWei normalcase 351.90 us/op 462.41 us/op 0.76
getExpectedWithdrawals 250000 eb:1,eth1:1,we:0,wn:0,smpl:15 7.4280 us/op 6.1870 us/op 1.20
getExpectedWithdrawals 250000 eb:0.95,eth1:0.1,we:0.05,wn:0,smpl:219 38.086 us/op 36.872 us/op 1.03
getExpectedWithdrawals 250000 eb:0.95,eth1:0.3,we:0.05,wn:0,smpl:42 10.785 us/op 9.4070 us/op 1.15
getExpectedWithdrawals 250000 eb:0.95,eth1:0.7,we:0.05,wn:0,smpl:18 6.4790 us/op 6.7300 us/op 0.96
getExpectedWithdrawals 250000 eb:0.1,eth1:0.1,we:0,wn:0,smpl:1020 156.07 us/op 129.39 us/op 1.21
getExpectedWithdrawals 250000 eb:0.03,eth1:0.03,we:0,wn:0,smpl:11777 1.3192 ms/op 808.11 us/op 1.63
getExpectedWithdrawals 250000 eb:0.01,eth1:0.01,we:0,wn:0,smpl:16384 1.8609 ms/op 1.2812 ms/op 1.45
getExpectedWithdrawals 250000 eb:0,eth1:0,we:0,wn:0,smpl:16384 1.5152 ms/op 1.2599 ms/op 1.20
getExpectedWithdrawals 250000 eb:0,eth1:0,we:0,wn:0,nocache,smpl:16384 3.5015 ms/op 2.9031 ms/op 1.21
getExpectedWithdrawals 250000 eb:0,eth1:1,we:0,wn:0,smpl:16384 2.2512 ms/op 1.1961 ms/op 1.88
getExpectedWithdrawals 250000 eb:0,eth1:1,we:0,wn:0,nocache,smpl:16384 3.9694 ms/op 3.3097 ms/op 1.20
Tree 40 250000 create 238.70 ms/op 239.82 ms/op 1.00
Tree 40 250000 get(125000) 152.51 ns/op 119.59 ns/op 1.28
Tree 40 250000 set(125000) 679.49 ns/op 533.30 ns/op 1.27
Tree 40 250000 toArray() 20.630 ms/op 19.577 ms/op 1.05
Tree 40 250000 iterate all - toArray() + loop 18.964 ms/op 18.418 ms/op 1.03
Tree 40 250000 iterate all - get(i) 54.144 ms/op 50.839 ms/op 1.07
Array 250000 create 3.5011 ms/op 3.1098 ms/op 1.13
Array 250000 clone - spread 1.4708 ms/op 1.5000 ms/op 0.98
Array 250000 get(125000) 0.42200 ns/op 0.65300 ns/op 0.65
Array 250000 set(125000) 0.45200 ns/op 0.60700 ns/op 0.74
Array 250000 iterate all - loop 97.024 us/op 78.603 us/op 1.23
phase0 afterProcessEpoch - 250000 vs - 7PWei 53.095 ms/op 44.404 ms/op 1.20
Array.fill - length 1000000 3.7525 ms/op 2.5870 ms/op 1.45
Array push - length 1000000 17.481 ms/op 17.249 ms/op 1.01
Array.get 0.27893 ns/op 0.26988 ns/op 1.03
Uint8Array.get 0.43958 ns/op 0.35595 ns/op 1.23
phase0 beforeProcessEpoch - 250000 vs - 7PWei 18.301 ms/op 20.321 ms/op 0.90
altair processEpoch - mainnet_e81889 289.93 ms/op 274.53 ms/op 1.06
mainnet_e81889 - altair beforeProcessEpoch 22.229 ms/op 16.793 ms/op 1.32
mainnet_e81889 - altair processJustificationAndFinalization 13.677 us/op 12.407 us/op 1.10
mainnet_e81889 - altair processInactivityUpdates 6.2148 ms/op 4.1056 ms/op 1.51
mainnet_e81889 - altair processRewardsAndPenalties 46.617 ms/op 48.959 ms/op 0.95
mainnet_e81889 - altair processRegistryUpdates 1.8260 us/op 3.3690 us/op 0.54
mainnet_e81889 - altair processSlashings 618.00 ns/op 805.00 ns/op 0.77
mainnet_e81889 - altair processEth1DataReset 435.00 ns/op 720.00 ns/op 0.60
mainnet_e81889 - altair processEffectiveBalanceUpdates 1.9387 ms/op 1.0525 ms/op 1.84
mainnet_e81889 - altair processSlashingsReset 4.8650 us/op 2.2660 us/op 2.15
mainnet_e81889 - altair processRandaoMixesReset 6.4430 us/op 3.3610 us/op 1.92
mainnet_e81889 - altair processHistoricalRootsUpdate 575.00 ns/op 824.00 ns/op 0.70
mainnet_e81889 - altair processParticipationFlagUpdates 2.2060 us/op 2.0040 us/op 1.10
mainnet_e81889 - altair processSyncCommitteeUpdates 514.00 ns/op 807.00 ns/op 0.64
mainnet_e81889 - altair afterProcessEpoch 52.138 ms/op 44.114 ms/op 1.18
capella processEpoch - mainnet_e217614 1.1186 s/op 857.44 ms/op 1.30
mainnet_e217614 - capella beforeProcessEpoch 73.758 ms/op 69.073 ms/op 1.07
mainnet_e217614 - capella processJustificationAndFinalization 17.835 us/op 14.894 us/op 1.20
mainnet_e217614 - capella processInactivityUpdates 18.469 ms/op 15.669 ms/op 1.18
mainnet_e217614 - capella processRewardsAndPenalties 244.99 ms/op 241.16 ms/op 1.02
mainnet_e217614 - capella processRegistryUpdates 14.720 us/op 12.026 us/op 1.22
mainnet_e217614 - capella processSlashings 471.00 ns/op 885.00 ns/op 0.53
mainnet_e217614 - capella processEth1DataReset 318.00 ns/op 838.00 ns/op 0.38
mainnet_e217614 - capella processEffectiveBalanceUpdates 15.220 ms/op 17.048 ms/op 0.89
mainnet_e217614 - capella processSlashingsReset 3.6680 us/op 3.4970 us/op 1.05
mainnet_e217614 - capella processRandaoMixesReset 4.7640 us/op 3.2770 us/op 1.45
mainnet_e217614 - capella processHistoricalRootsUpdate 688.00 ns/op 781.00 ns/op 0.88
mainnet_e217614 - capella processParticipationFlagUpdates 1.8580 us/op 3.2320 us/op 0.57
mainnet_e217614 - capella afterProcessEpoch 126.99 ms/op 107.33 ms/op 1.18
phase0 processEpoch - mainnet_e58758 399.26 ms/op 336.53 ms/op 1.19
mainnet_e58758 - phase0 beforeProcessEpoch 105.71 ms/op 84.862 ms/op 1.25
mainnet_e58758 - phase0 processJustificationAndFinalization 17.711 us/op 14.617 us/op 1.21
mainnet_e58758 - phase0 processRewardsAndPenalties 41.274 ms/op 29.164 ms/op 1.42
mainnet_e58758 - phase0 processRegistryUpdates 13.322 us/op 7.9410 us/op 1.68
mainnet_e58758 - phase0 processSlashings 592.00 ns/op 864.00 ns/op 0.69
mainnet_e58758 - phase0 processEth1DataReset 514.00 ns/op 733.00 ns/op 0.70
mainnet_e58758 - phase0 processEffectiveBalanceUpdates 2.2547 ms/op 885.61 us/op 2.55
mainnet_e58758 - phase0 processSlashingsReset 4.4090 us/op 5.1440 us/op 0.86
mainnet_e58758 - phase0 processRandaoMixesReset 7.0040 us/op 6.6790 us/op 1.05
mainnet_e58758 - phase0 processHistoricalRootsUpdate 542.00 ns/op 837.00 ns/op 0.65
mainnet_e58758 - phase0 processParticipationRecordUpdates 3.7120 us/op 5.0730 us/op 0.73
mainnet_e58758 - phase0 afterProcessEpoch 44.554 ms/op 36.951 ms/op 1.21
phase0 processEffectiveBalanceUpdates - 250000 normalcase 1.8709 ms/op 1.0552 ms/op 1.77
phase0 processEffectiveBalanceUpdates - 250000 worstcase 0.5 2.9771 ms/op 1.7294 ms/op 1.72
altair processInactivityUpdates - 250000 normalcase 21.267 ms/op 19.652 ms/op 1.08
altair processInactivityUpdates - 250000 worstcase 21.427 ms/op 16.325 ms/op 1.31
phase0 processRegistryUpdates - 250000 normalcase 17.261 us/op 8.7310 us/op 1.98
phase0 processRegistryUpdates - 250000 badcase_full_deposits 492.29 us/op 330.40 us/op 1.49
phase0 processRegistryUpdates - 250000 worstcase 0.5 156.89 ms/op 128.63 ms/op 1.22
altair processRewardsAndPenalties - 250000 normalcase 54.559 ms/op 42.273 ms/op 1.29
altair processRewardsAndPenalties - 250000 worstcase 57.379 ms/op 43.271 ms/op 1.33
phase0 getAttestationDeltas - 250000 normalcase 11.675 ms/op 10.615 ms/op 1.10
phase0 getAttestationDeltas - 250000 worstcase 8.3791 ms/op 7.3619 ms/op 1.14
phase0 processSlashings - 250000 worstcase 142.63 us/op 100.31 us/op 1.42
altair processSyncCommitteeUpdates - 250000 145.02 ms/op 95.554 ms/op 1.52
BeaconState.hashTreeRoot - No change 240.00 ns/op 451.00 ns/op 0.53
BeaconState.hashTreeRoot - 1 full validator 166.96 us/op 77.757 us/op 2.15
BeaconState.hashTreeRoot - 32 full validator 1.4912 ms/op 752.97 us/op 1.98
BeaconState.hashTreeRoot - 512 full validator 14.489 ms/op 7.9461 ms/op 1.82
BeaconState.hashTreeRoot - 1 validator.effectiveBalance 202.96 us/op 93.834 us/op 2.16
BeaconState.hashTreeRoot - 32 validator.effectiveBalance 2.4157 ms/op 1.3775 ms/op 1.75
BeaconState.hashTreeRoot - 512 validator.effectiveBalance 32.798 ms/op 17.669 ms/op 1.86
BeaconState.hashTreeRoot - 1 balances 130.49 us/op 71.615 us/op 1.82
BeaconState.hashTreeRoot - 32 balances 1.5774 ms/op 824.58 us/op 1.91
BeaconState.hashTreeRoot - 512 balances 11.037 ms/op 5.9507 ms/op 1.85
BeaconState.hashTreeRoot - 250000 balances 207.26 ms/op 167.62 ms/op 1.24
aggregationBits - 2048 els - zipIndexesInBitList 28.649 us/op 20.996 us/op 1.36
byteArrayEquals 32 54.762 ns/op 48.955 ns/op 1.12
Buffer.compare 32 17.838 ns/op 15.748 ns/op 1.13
byteArrayEquals 1024 1.6648 us/op 1.2795 us/op 1.30
Buffer.compare 1024 25.223 ns/op 32.330 ns/op 0.78
byteArrayEquals 16384 26.157 us/op 20.470 us/op 1.28
Buffer.compare 16384 202.03 ns/op 206.52 ns/op 0.98
byteArrayEquals 123687377 198.09 ms/op 154.50 ms/op 1.28
Buffer.compare 123687377 6.5631 ms/op 4.9327 ms/op 1.33
byteArrayEquals 32 - diff last byte 53.353 ns/op 47.594 ns/op 1.12
Buffer.compare 32 - diff last byte 17.494 ns/op 16.083 ns/op 1.09
byteArrayEquals 1024 - diff last byte 1.5763 us/op 1.2720 us/op 1.24
Buffer.compare 1024 - diff last byte 25.894 ns/op 24.469 ns/op 1.06
byteArrayEquals 16384 - diff last byte 25.121 us/op 20.210 us/op 1.24
Buffer.compare 16384 - diff last byte 194.53 ns/op 210.05 ns/op 0.93
byteArrayEquals 123687377 - diff last byte 187.95 ms/op 151.06 ms/op 1.24
Buffer.compare 123687377 - diff last byte 6.4809 ms/op 6.0088 ms/op 1.08
byteArrayEquals 32 - random bytes 4.9700 ns/op 5.1680 ns/op 0.96
Buffer.compare 32 - random bytes 16.524 ns/op 16.160 ns/op 1.02
byteArrayEquals 1024 - random bytes 4.9540 ns/op 4.9180 ns/op 1.01
Buffer.compare 1024 - random bytes 16.504 ns/op 15.565 ns/op 1.06
byteArrayEquals 16384 - random bytes 4.9490 ns/op 5.0190 ns/op 0.99
Buffer.compare 16384 - random bytes 16.512 ns/op 16.303 ns/op 1.01
byteArrayEquals 123687377 - random bytes 6.3800 ns/op 8.2400 ns/op 0.77
Buffer.compare 123687377 - random bytes 18.220 ns/op 18.870 ns/op 0.97
regular array get 100000 times 41.342 us/op 32.271 us/op 1.28
wrappedArray get 100000 times 31.943 us/op 31.798 us/op 1.00
arrayWithProxy get 100000 times 13.680 ms/op 10.165 ms/op 1.35
ssz.Root.equals 44.874 ns/op 40.224 ns/op 1.12
byteArrayEquals 43.831 ns/op 39.673 ns/op 1.10
Buffer.compare 10.018 ns/op 9.4440 ns/op 1.06
processSlot - 1 slots 18.565 us/op 12.445 us/op 1.49
processSlot - 32 slots 3.4472 ms/op 2.0863 ms/op 1.65
getEffectiveBalanceIncrementsZeroInactive - 250000 vs - 7PWei 40.290 ms/op 36.866 ms/op 1.09
getCommitteeAssignments - req 1 vs - 250000 vc 2.1336 ms/op 1.8504 ms/op 1.15
getCommitteeAssignments - req 100 vs - 250000 vc 4.1606 ms/op 3.6544 ms/op 1.14
getCommitteeAssignments - req 1000 vs - 250000 vc 4.5263 ms/op 3.8666 ms/op 1.17
findModifiedValidators - 10000 modified validators 272.40 ms/op 266.98 ms/op 1.02
findModifiedValidators - 1000 modified validators 176.65 ms/op 160.04 ms/op 1.10
findModifiedValidators - 100 modified validators 176.54 ms/op 168.06 ms/op 1.05
findModifiedValidators - 10 modified validators 193.71 ms/op 179.50 ms/op 1.08
findModifiedValidators - 1 modified validators 173.50 ms/op 144.64 ms/op 1.20
findModifiedValidators - no difference 183.82 ms/op 178.82 ms/op 1.03
compare ViewDUs 3.3581 s/op 3.1810 s/op 1.06
compare each validator Uint8Array 1.5757 s/op 1.5973 s/op 0.99
compare ViewDU to Uint8Array 1.2675 s/op 1.0046 s/op 1.26
migrate state 1000000 validators, 24 modified, 0 new 772.67 ms/op 692.54 ms/op 1.12
migrate state 1000000 validators, 1700 modified, 1000 new 1.2388 s/op 1.0279 s/op 1.21
migrate state 1000000 validators, 3400 modified, 2000 new 1.6515 s/op 1.0738 s/op 1.54
migrate state 1500000 validators, 24 modified, 0 new 970.26 ms/op 642.40 ms/op 1.51
migrate state 1500000 validators, 1700 modified, 1000 new 1.0801 s/op 971.10 ms/op 1.11
migrate state 1500000 validators, 3400 modified, 2000 new 1.3027 s/op 1.0123 s/op 1.29
RootCache.getBlockRootAtSlot - 250000 vs - 7PWei 4.6900 ns/op 6.1400 ns/op 0.76
state getBlockRootAtSlot - 250000 vs - 7PWei 997.00 ns/op 865.08 ns/op 1.15
computeProposers - vc 250000 8.8535 ms/op 7.1492 ms/op 1.24
computeEpochShuffling - vc 250000 42.929 ms/op 35.602 ms/op 1.21
getNextSyncCommittee - vc 250000 160.65 ms/op 108.38 ms/op 1.48
computeSigningRoot for AttestationData 23.930 us/op 18.244 us/op 1.31
hash AttestationData serialized data then Buffer.toString(base64) 1.6263 us/op 1.1824 us/op 1.38
toHexString serialized data 896.43 ns/op 762.56 ns/op 1.18
Buffer.toString(base64) 184.97 ns/op 149.81 ns/op 1.23
nodejs block root to RootHex using toHex 152.03 ns/op 116.07 ns/op 1.31
nodejs block root to RootHex using toRootHex 97.655 ns/op 76.338 ns/op 1.28
browser block root to RootHex using the deprecated toHexString 228.72 ns/op 206.19 ns/op 1.11
browser block root to RootHex using toHex 184.44 ns/op 161.97 ns/op 1.14
browser block root to RootHex using toRootHex 164.35 ns/op 150.17 ns/op 1.09

by benchmarkbot/action

@nflaig
Copy link
Member Author

nflaig commented Dec 19, 2024

This requires more changes, CI is still failing https://github.com/ChainSafe/lodestar/actions/runs/12416331817/job/34664977579?pr=7318#step:6:64

@lodestar/params: Vitest caught 1 unhandled error during the test run.
@lodestar/params: This might cause false positive tests. Resolve unhandled errors to make sure your tests are not affected.
@lodestar/params: ⎯⎯⎯⎯⎯⎯ Unhandled Error ⎯⎯⎯⎯⎯⎯⎯
@lodestar/params: Error: Couldn't find a matching firefox browser for tag "nightly_135.0a1" on platform "linux"
@lodestar/params:  ❯ setupPuppeteerBrowser ../../node_modules/@wdio/utils/build/node/utils.js:202:15
@lodestar/params:  ❯ process.processTicksAndRejections node:internal/process/task_queues:95:5
@lodestar/params:  ❯ startWebDriver ../../node_modules/@wdio/utils/build/node/startWebDriver.js:80:36
@lodestar/params:  ❯ WebDriver.newSession ../../node_modules/webdriver/build/index.js:18:31

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

Fix installing firefox in browser tests
1 participant
@nflaig