Syncing at execution layer is too slow

[farhan-systango]

This should only be used in very rare cases e.g. if you are not 100% sure if something is a bug or asking a question that leads to improving the documentation. For general questions please use Erigon's discord.

Hi Team,

I have started the node using snapshots & it syncs really slow only 7-8 blk/sec. Here are the hardware details for more information:
Machine SKU: Standard_L16
vCPU: 16
RAM: 128GB

I am running the service with the following command:
exec erigon --chain bsc --snapshots=true --db.pagesize=16k --datadir=/bnb-backup/data --txpool.disable --rpc.batch.concurrency=1500 --rpc.batch.limit=1500 --torrent.upload.rate=512mb --torrent.download.rate=512mb --http.addr=0.0.0.0 --http.port=8545 --rpc.returndata.limit=1024000 --p2p.protocol=66

that way it takes infinite time to sync with the bsc mainnet.

[seonggwonyoon]

Same on AWS (is4gen.4xlarge - us-west-2 region)

Logs

May 12 04:42:43 ip-10-0-18-61 start.sh[386361]: [INFO] [05-12|04:42:43.700] [6/15 Senders] Recovery                  block_number=28130508 ch=5671/10000
May 12 04:42:59 ip-10-0-18-61 start.sh[386361]: [INFO] [05-12|04:42:59.163] [7/15 Execution] Blocks execution        from=28119509 to=28136191
May 12 04:43:20 ip-10-0-18-61 start.sh[386361]: [INFO] [05-12|04:43:20.300] [7/15 Execution] Executed blocks         number=28119539 blk/s=1.4 tx/s=315.0 Mgas/s=45.8 gasState=0.00 batch=1.3MB alloc=4.0GB sys=5.7GB
May 12 04:43:39 ip-10-0-18-61 start.sh[386361]: [INFO] [05-12|04:43:39.748] [7/15 Execution] Executed blocks         number=28119587 blk/s=2.5 tx/s=531.8 Mgas/s=62.3 gasState=0.00 batch=3.6MB alloc=4.5GB sys=5.7GB
May 12 04:43:39 ip-10-0-18-61 start.sh[386361]: [INFO] [05-12|04:43:39.795] [p2p] GoodPeers                          eth66=99
May 12 04:43:40 ip-10-0-18-61 start.sh[386361]: [INFO] [05-12|04:43:40.329] [txpool] stat                            pending=5747 baseFee=0 queued=11325 alloc=4.5GB sys=5.7GB
May 12 04:43:59 ip-10-0-18-61 start.sh[386361]: [INFO] [05-12|04:43:59.236] [7/15 Execution] Executed blocks         number=28119639 blk/s=2.7 tx/s=581.1 Mgas/s=65.9 gasState=0.01 batch=6.3MB alloc=5.1GB sys=5.7GB
May 12 04:44:19 ip-10-0-18-61 start.sh[386361]: [INFO] [05-12|04:44:19.422] [7/15 Execution] Executed blocks         number=28119704 blk/s=3.2 tx/s=645.4 Mgas/s=72.8 gasState=0.01 batch=9.3MB alloc=5.7GB sys=6.1GB
May 12 04:44:39 ip-10-0-18-61 start.sh[386361]: [INFO] [05-12|04:44:39.232] [7/15 Execution] Executed blocks         number=28119765 blk/s=3.1 tx/s=648.2 Mgas/s=80.4 gasState=0.01 batch=12.7MB alloc=3.1GB sys=6.1GB
May 12 04:44:40 ip-10-0-18-61 start.sh[386361]: [INFO] [05-12|04:44:40.325] [txpool] stat                            pending=6484 baseFee=0 queued=12637 alloc=3.1GB sys=6.1GB
May 12 04:44:59 ip-10-0-18-61 start.sh[386361]: [INFO] [05-12|04:44:59.183] [7/15 Execution] Executed blocks         number=28119829 blk/s=3.2 tx/s=686.6 Mgas/s=87.6 gasState=0.02 batch=16.1MB alloc=3.6GB sys=6.1GB
May 12 04:45:19 ip-10-0-18-61 start.sh[386361]: [INFO] [05-12|04:45:19.168] [7/15 Execution] Executed blocks         number=28119899 blk/s=3.5 tx/s=735.1 Mgas/s=97.2 gasState=0.02 batch=20.4MB alloc=4.3GB sys=6.1GB
May 12 04:45:39 ip-10-0-18-61 start.sh[386361]: [INFO] [05-12|04:45:39.180] [7/15 Execution] Executed blocks         number=28119961 blk/s=3.1 tx/s=713.1 Mgas/s=88.2 gasState=0.02 batch=24.2MB alloc=2.6GB sys=6.1GB
May 12 04:45:39 ip-10-0-18-61 start.sh[386361]: [INFO] [05-12|04:45:39.795] [p2p] GoodPeers                          eth66=100
May 12 04:45:40 ip-10-0-18-61 start.sh[386361]: [INFO] [05-12|04:45:40.330] [txpool] stat                            pending=7253 baseFee=0 queued=13988 alloc=2.6GB sys=6.1GB
May 12 04:45:59 ip-10-0-18-61 start.sh[386361]: [INFO] [05-12|04:45:59.214] [7/15 Execution] Executed blocks         number=28120036 blk/s=3.7 tx/s=824.6 Mgas/s=98.1 gasState=0.03 batch=28.3MB alloc=3.3GB sys=6.1GB
May 12 04:46:19 ip-10-0-18-61 start.sh[386361]: [INFO] [05-12|04:46:19.262] [7/15 Execution] Executed blocks         number=28120114 blk/s=3.9 tx/s=825.7 Mgas/s=98.0 gasState=0.03 batch=32.4MB alloc=3.9GB sys=6.1GB

[zhy827827]

[qinglin89]

Ref: #8

[setunapo]

I am afraid it is a known performance issue of Erigon, currently ~10 blk/sec sounds is not that bad.
We will keep the performance improve task in our long term support plan, close this issue right now.