Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Erigon v2.58.0 sync issue #9464

Closed
0x19dG87 opened this issue Feb 19, 2024 · 5 comments
Closed

Erigon v2.58.0 sync issue #9464

0x19dG87 opened this issue Feb 19, 2024 · 5 comments

Comments

@0x19dG87
Copy link

0x19dG87 commented Feb 19, 2024 •
edited
Loading

System information

Erigon version: 2.58.0
OS & Version: Ubuntu 22.04
Erigon Command (with flags/config):

docker image thorax/erigon:v2.58.0
--chain=mainnet
--internalcl
--nat=stun
--http.addr=0.0.0.0
--http.port=8545
--http.api=eth,web3,net,debug,trace,txpool
--http.vhosts=*
--http.corsdomain=*
--ws
--ws.port=8546
--metrics
--metrics.addr=0.0.0.0
--pprof
--pprof.addr=0.0.0.0
--pprof.port=6070
--authrpc.addr=0.0.0.0
--authrpc.jwtsecret=/home/erigon/.local/share/erigon/jwt.hex
--authrpc.vhosts=*
--torrent.download.rate=100mb
--torrent.upload.rate=16mb
--datadir=/home/erigon/.local/share/erigon

Consensus Layer: Caplin (internal)
Chain/Network: mainnet

Expected behaviour

Match head

Actual behaviour

Always x blocks behind the head

Description

After moving to v2.58.0 I saw that the node could not catch up with the head, so I had to downgrade to v2.57.3. Below are parts of the logs that show the difference between 2.58.0 and 2.57.3

2.58.0

[INFO] [02-19|08:10:55.645] head updated                             hash=0xe80a6998ee38b371d0bb7849da73b3737cccd25d55affb29ecffd75099e5d06d number=19260508
[INFO] [02-19|08:10:55.918] [snapshots] Prune Blocks                 to=19170000 limit=100
[INFO] [02-19|08:11:52.788] P2P                                      app=caplin peers=15
[INFO] [02-19|08:12:52.788] P2P                                      app=caplin peers=28
[INFO] [02-19|08:13:21.763] [p2p] GoodPeers                          eth68=100 eth67=94 eth66=6
[INFO] [02-19|08:13:22.877] [txpool] stat                            pending=1471 baseFee=3948 queued=2314 alloc=11.4GB sys=17.2GB
[INFO] [02-19|08:13:52.788] P2P                                      app=caplin peers=23
[INFO] [02-19|08:14:52.787] P2P                                      app=caplin peers=20
[INFO] [02-19|08:15:52.788] P2P                                      app=caplin peers=17
[INFO] [02-19|08:16:21.762] [p2p] GoodPeers                          eth68=100 eth67=93 eth66=6
[INFO] [02-19|08:16:22.869] [txpool] stat                            pending=2893 baseFee=4278 queued=2449 alloc=8.5GB sys=17.2GB
[INFO] [02-19|08:16:52.788] P2P                                      app=caplin peers=17
[INFO] [02-19|08:17:08.484] [3/12 Senders] Started                   from=19260508 to=19260540
[INFO] [02-19|08:17:08.562] [4/12 Execution] Blocks execution        from=19260508 to=19260540
[INFO] [02-19|08:17:11.096] [4/12 Execution] Completed on            block=19260540
[INFO] [02-19|08:17:11.096] [5/12 HashState] Promoting plain state   from=19260508 to=19260540
[INFO] [02-19|08:17:11.096] [5/12 HashState] Incremental promotion   from=19260508 to=19260540 codes=true csbucket=AccountChangeSet
[INFO] [02-19|08:17:11.336] [5/12 HashState] Incremental promotion   from=19260508 to=19260540 codes=false csbucket=AccountChangeSet
[INFO] [02-19|08:17:11.919] [5/12 HashState] Incremental promotion   from=19260508 to=19260540 codes=false csbucket=StorageChangeSet
[INFO] [02-19|08:17:12.526] [6/12 IntermediateHashes] Generating intermediate hashes from=19260508 to=19260540
[INFO] [02-19|08:17:14.605] [7/12 CallTraces] Pruned call trace intermediate table from=19170508 to=19170539
[INFO] [02-19|08:17:29.236] RPC Daemon notified of new headers       from=19260508 to=19260540 hash=0xa97be7ef1d97a14f82ded4ea8b875d5aa82841b266f2d3145ea83edd3b4cff72 header sending=60.454µs log sending=219ns
[INFO] [02-19|08:17:29.236] head updated                             hash=0xa97be7ef1d97a14f82ded4ea8b875d5aa82841b266f2d3145ea83edd3b4cff72 number=19260540
[INFO] [02-19|08:17:29.464] [snapshots] Prune Blocks                 to=19170000 limit=100
[INFO] [02-19|08:17:32.898] [4/12 Execution] Completed on            block=19260542
[INFO] [02-19|08:17:34.417] RPC Daemon notified of new headers       from=19260540 to=19260542 hash=0x0aba423885eb0cd4f0efaa84f0ca631cf580995acfad85ad5a653ff96a690128 header sending=22.156µs log sending=232ns
[INFO] [02-19|08:17:34.417] head updated                             hash=0x0aba423885eb0cd4f0efaa84f0ca631cf580995acfad85ad5a653ff96a690128 number=19260542
[INFO] [02-19|08:17:34.730] [snapshots] Prune Blocks                 to=19170000 limit=100
[INFO] [02-19|08:17:52.788] P2P                                      app=caplin peers=17
[INFO] [02-19|08:17:58.505] [4/12 Execution] Completed on            block=19260544
[INFO] [02-19|08:18:00.061] RPC Daemon notified of new headers       from=19260542 to=19260544 hash=0x79c736469ceeb1c8b31354beb4ee2814caa0d3b18a19b87d2b080f74a08a91c7 header sending=15.753µs log sending=265ns
[INFO] [02-19|08:18:00.061] head updated                             hash=0x79c736469ceeb1c8b31354beb4ee2814caa0d3b18a19b87d2b080f74a08a91c7 number=19260544
[INFO] [02-19|08:18:00.287] [snapshots] Prune Blocks                 to=19170000 limit=100
[INFO] [02-19|08:18:52.788] P2P                                      app=caplin peers=19
[INFO] [02-19|08:19:21.762] [p2p] GoodPeers                          eth68=100 eth67=94 eth66=6
[INFO] [02-19|08:19:22.869] [txpool] stat                            pending=992 baseFee=4349 queued=2278 alloc=9.8GB sys=17.2GB
[INFO] [02-19|08:19:52.788] P2P                                      app=caplin peers=20
[INFO] [02-19|08:20:52.788] P2P                                      app=caplin peers=26
[INFO] [02-19|08:21:52.788] P2P                                      app=caplin peers=18
[INFO] [02-19|08:22:21.762] [p2p] GoodPeers                          eth68=100 eth67=94 eth66=6
[INFO] [02-19|08:22:22.870] [txpool] stat                            pending=2745 baseFee=4603 queued=2397 alloc=8.0GB sys=17.2GB
[INFO] [02-19|08:22:52.788] P2P                                      app=caplin peers=17
[INFO] [02-19|08:23:52.787] P2P                                      app=caplin peers=14
[INFO] [02-19|08:24:52.788] P2P                                      app=caplin peers=18
[INFO] [02-19|08:25:21.763] [p2p] GoodPeers                          eth68=100 eth67=94 eth66=6
[INFO] [02-19|08:25:22.869] [txpool] stat                            pending=4097 baseFee=4695 queued=2512 alloc=12.7GB sys=17.2GB
[INFO] [02-19|08:25:52.787] P2P                                      app=caplin peers=13
[INFO] [02-19|08:26:10.758] [3/12 Senders] Started                   from=19260544 to=19260584
[INFO] [02-19|08:26:10.856] [4/12 Execution] Blocks execution        from=19260544 to=19260584
[INFO] [02-19|08:26:15.400] [4/12 Execution] Completed on            block=19260584
[INFO] [02-19|08:26:15.400] [5/12 HashState] Promoting plain state   from=19260544 to=19260584
[INFO] [02-19|08:26:15.400] [5/12 HashState] Incremental promotion   from=19260544 to=19260584 codes=true csbucket=AccountChangeSet
[INFO] [02-19|08:26:15.782] [5/12 HashState] Incremental promotion   from=19260544 to=19260584 codes=false csbucket=AccountChangeSet
[INFO] [02-19|08:26:16.594] [5/12 HashState] Incremental promotion   from=19260544 to=19260584 codes=false csbucket=StorageChangeSet
[INFO] [02-19|08:26:18.094] [6/12 IntermediateHashes] Generating intermediate hashes from=19260544 to=19260584
[INFO] [02-19|08:26:22.452] [7/12 CallTraces] Pruned call trace intermediate table from=19170544 to=19170583
[INFO] [02-19|08:26:42.606] RPC Daemon notified of new headers       from=19260544 to=19260584 hash=0xab4eed54fa556e0ef9cf9721cb54f680b57c754959e106cd118f1bbee8d75440 header sending=256.961µs log sending=271ns
[INFO] [02-19|08:26:42.606] head updated                             hash=0xab4eed54fa556e0ef9cf9721cb54f680b57c754959e106cd118f1bbee8d75440 number=19260584
[INFO] [02-19|08:26:42.870] [snapshots] Prune Blocks                 to=19170000 limit=100
[INFO] [02-19|08:26:52.789] P2P                                      app=caplin peers=15
[INFO] [02-19|08:27:09.093] [4/12 Execution] Completed on            block=19260589
[INFO] [02-19|08:27:12.887] RPC Daemon notified of new headers       from=19260584 to=19260589 hash=0x858b0b3ba722715b9b5993692a0b13e6e3ab4aff2a5561366b61859b718929ff header sending=25.851µs log sending=291ns
[INFO] [02-19|08:27:12.887] head updated                             hash=0x858b0b3ba722715b9b5993692a0b13e6e3ab4aff2a5561366b61859b718929ff number=19260589
[INFO] [02-19|08:27:13.149] [snapshots] Prune Blocks                 to=19170000 limit=100
[INFO] [02-19|08:27:28.920] [4/12 Execution] Completed on            block=19260591
[INFO] [02-19|08:27:30.535] RPC Daemon notified of new headers       from=19260589 to=19260591 hash=0xf7e0fc7970d2c35f49271b44ca2e05d34c7d2aeaa645feb6b21c2d91590d5244 header sending=22.17µs log sending=281ns
[INFO] [02-19|08:27:30.535] head updated                             hash=0xf7e0fc7970d2c35f49271b44ca2e05d34c7d2aeaa645feb6b21c2d91590d5244 number=19260591
[INFO] [02-19|08:27:30.949] [snapshots] Prune Blocks                 to=19170000 limit=100
[INFO] [02-19|08:27:52.788] P2P                                      app=caplin peers=10
[INFO] [02-19|08:27:54.979] [4/12 Execution] Completed on            block=19260593
[INFO] [02-19|08:27:56.408] RPC Daemon notified of new headers       from=19260591 to=19260593 hash=0x0feb573eaf76834684dbdf3bcdef78a45b16a325bce05266d0330f72a2182202 header sending=21.648µs log sending=529ns
[INFO] [02-19|08:27:56.408] head updated                             hash=0x0feb573eaf76834684dbdf3bcdef78a45b16a325bce05266d0330f72a2182202 number=19260593
[INFO] [02-19|08:27:56.795] [snapshots] Prune Blocks                 to=19170000 limit=100
[INFO] [02-19|08:28:17.368] [4/12 Execution] Completed on            block=19260595
[INFO] [02-19|08:28:18.728] RPC Daemon notified of new headers       from=19260593 to=19260595 hash=0xaa690b3831f9c4126fe8f303498b4572d9d3bb08e7a4b0184096eeeba98fdc9c header sending=21.728µs log sending=218ns
[INFO] [02-19|08:28:18.728] head updated                             hash=0xaa690b3831f9c4126fe8f303498b4572d9d3bb08e7a4b0184096eeeba98fdc9c number=19260595
[INFO] [02-19|08:28:19.008] [snapshots] Prune Blocks                 to=19170000 limit=100
[INFO] [02-19|08:28:21.763] [p2p] GoodPeers                          eth66=6 eth68=100 eth67=94
[INFO] [02-19|08:28:22.869] [txpool] stat                            pending=140 baseFee=4472 queued=2261 alloc=7.1GB sys=17.2GB
[INFO] [02-19|08:28:52.788] P2P                                      app=caplin peers=18
[INFO] [02-19|08:29:52.788] P2P                                      app=caplin peers=10
[INFO] [02-19|08:30:52.788] P2P                                      app=caplin peers=17
[INFO] [02-19|08:31:21.763] [p2p] GoodPeers                          eth67=94 eth66=6 eth68=100
[INFO] [02-19|08:31:22.868] [txpool] stat                            pending=2009 baseFee=4692 queued=2342 alloc=7.3GB sys=17.2GB
[INFO] [02-19|08:31:45.405] [3/12 Senders] Started                   from=19260595 to=19260612
[INFO] [02-19|08:31:45.451] [4/12 Execution] Blocks execution        from=19260595 to=19260612
[INFO] [02-19|08:31:46.878] [4/12 Execution] Completed on            block=19260612
[INFO] [02-19|08:31:46.878] [5/12 HashState] Promoting plain state   from=19260595 to=19260612
[INFO] [02-19|08:31:46.878] [5/12 HashState] Incremental promotion   from=19260595 to=19260612 codes=true csbucket=AccountChangeSet
[INFO] [02-19|08:31:47.018] [5/12 HashState] Incremental promotion   from=19260595 to=19260612 codes=false csbucket=AccountChangeSet
[INFO] [02-19|08:31:47.258] [5/12 HashState] Incremental promotion   from=19260595 to=19260612 codes=false csbucket=StorageChangeSet
[INFO] [02-19|08:31:47.968] [6/12 IntermediateHashes] Generating intermediate hashes from=19260595 to=19260612
[INFO] [02-19|08:31:52.787] P2P                                      app=caplin peers=21
[INFO] [02-19|08:32:00.995] RPC Daemon notified of new headers       from=19260595 to=19260612 hash=0xd5ca6a676adcef1c7ab4871d11ffb60d558f8c1acffbbefd63a1680247a652fa header sending=43.927µs log sending=272ns
[INFO] [02-19|08:32:00.995] head updated                             hash=0xd5ca6a676adcef1c7ab4871d11ffb60d558f8c1acffbbefd63a1680247a652fa number=19260612
[INFO] [02-19|08:32:01.318] [snapshots] Prune Blocks                 to=19170000 limit=100
[INFO] [02-19|08:32:52.788] P2P                                      app=caplin peers=24

2.57.3

[INFO] [02-19|08:38:28.858] [txpool] stat                            pending=0 baseFee=0 queued=1989 alloc=8.2GB sys=10.7GB
[INFO] [02-19|08:38:35.265] [3/12 Senders] Started                   from=19260612 to=19260646
[INFO] [02-19|08:38:35.337] [4/12 Execution] Blocks execution        from=19260612 to=19260646
[INFO] [02-19|08:38:40.720] [4/12 Execution] Completed on            block=19260646
[INFO] [02-19|08:38:40.720] [5/12 HashState] Promoting plain state   from=19260612 to=19260646
[INFO] [02-19|08:38:40.720] [5/12 HashState] Incremental promotion   from=19260612 to=19260646 codes=true csbucket=AccountChangeSet
[INFO] [02-19|08:38:41.213] [5/12 HashState] Incremental promotion   from=19260612 to=19260646 codes=false csbucket=AccountChangeSet
[INFO] [02-19|08:38:42.526] [5/12 HashState] Incremental promotion   from=19260612 to=19260646 codes=false csbucket=StorageChangeSet
[INFO] [02-19|08:38:44.445] [6/12 IntermediateHashes] Generating intermediate hashes from=19260612 to=19260646
[INFO] [02-19|08:38:52.038] [7/12 CallTraces] Pruned call trace intermediate table from=19170612 to=19170645
[INFO] [02-19|08:38:58.985] P2P                                      app=caplin peers=10
[INFO] [02-19|08:39:12.832] RPC Daemon notified of new headers       from=19260612 to=19260646 hash=0x85ced7eca432b9011a65f48f11403bdbb23d250da7b4627b658fc9a5b2753f7f header sending=348.286µs log sending=276ns
[INFO] [02-19|08:39:12.835] head updated                             hash=0x85ced7eca432b9011a65f48f11403bdbb23d250da7b4627b658fc9a5b2753f7f number=19260646
[INFO] [02-19|08:39:13.190] [snapshots] Prune Blocks                 to=19170000 limit=100
[INFO] [02-19|08:39:41.911] [4/12 Execution] Completed on            block=19260652
[INFO] [02-19|08:39:47.690] RPC Daemon notified of new headers       from=19260646 to=19260652 hash=0xb77ca44b974166ecf68bb34478385440c62fdda7fdd511b0827a1f9ed0c15006 header sending=22.345µs log sending=461ns
[INFO] [02-19|08:39:47.690] head updated                             hash=0xb77ca44b974166ecf68bb34478385440c62fdda7fdd511b0827a1f9ed0c15006 number=19260652
[INFO] [02-19|08:39:48.005] [snapshots] Prune Blocks                 to=19170000 limit=100
[INFO] [02-19|08:39:54.266] [updateForkchoice] Fork choice update: flushing in-memory state (built by previous newPayload)
[INFO] [02-19|08:39:55.333] RPC Daemon notified of new headers       from=19260652 to=19260653 hash=0x980f87eb22f8fef37ad203e85fcdf43e8ef1c7bd4c29081eaa2906cf21f9dd6e header sending=17.96µs log sending=486ns
[INFO] [02-19|08:39:55.333] head updated                             hash=0x980f87eb22f8fef37ad203e85fcdf43e8ef1c7bd4c29081eaa2906cf21f9dd6e number=19260653
[INFO] [02-19|08:39:56.102] [snapshots] Prune Blocks                 to=19170000 limit=100
[INFO] [02-19|08:39:58.984] P2P                                      app=caplin peers=9
[INFO] [02-19|08:40:04.022] [updateForkchoice] Fork choice update: flushing in-memory state (built by previous newPayload)
[INFO] [02-19|08:40:04.843] RPC Daemon notified of new headers       from=19260653 to=19260654 hash=0xb008f90d32b3855dce89bc241648d5616df5094d4bb6017ea6dec3b2f7031a44 header sending=18.649µs log sending=429ns
[INFO] [02-19|08:40:04.843] head updated                             hash=0xb008f90d32b3855dce89bc241648d5616df5094d4bb6017ea6dec3b2f7031a44 number=19260654
[INFO] [02-19|08:40:05.178] [snapshots] Prune Blocks                 to=19170000 limit=100
[INFO] [02-19|08:40:16.056] [updateForkchoice] Fork choice update: flushing in-memory state (built by previous newPayload)
[INFO] [02-19|08:40:17.032] RPC Daemon notified of new headers       from=19260654 to=19260655 hash=0x01014333dd3653b6c23c189bb852b7dccb330301838b49029a8775294c431b36 header sending=17.979µs log sending=441ns
[INFO] [02-19|08:40:17.032] head updated                             hash=0x01014333dd3653b6c23c189bb852b7dccb330301838b49029a8775294c431b36 number=19260655
[INFO] [02-19|08:40:17.366] [snapshots] Prune Blocks                 to=19170000 limit=100
[INFO] [02-19|08:40:28.047] [updateForkchoice] Fork choice update: flushing in-memory state (built by previous newPayload)
[INFO] [02-19|08:40:28.964] RPC Daemon notified of new headers       from=19260655 to=19260656 hash=0x1c87758b1e57b225a83c62dc52c097bd4897fadf9cbfd50c0d4999942ee20ac9 header sending=13.795µs log sending=330ns
[INFO] [02-19|08:40:28.964] head updated                             hash=0x1c87758b1e57b225a83c62dc52c097bd4897fadf9cbfd50c0d4999942ee20ac9 number=19260656
[INFO] [02-19|08:40:29.580] [snapshots] Prune Blocks                 to=19170000 limit=100
[INFO] [02-19|08:40:41.696] [updateForkchoice] Fork choice update: flushing in-memory state (built by previous newPayload)
[INFO] [02-19|08:40:42.436] RPC Daemon notified of new headers       from=19260656 to=19260657 hash=0x76abf68a5a15f0ef8fdbeae14e9cfdd1a093a661d81486fbc38a738ec47ed727 header sending=16.951µs log sending=310ns
[INFO] [02-19|08:40:42.436] head updated                             hash=0x76abf68a5a15f0ef8fdbeae14e9cfdd1a093a661d81486fbc38a738ec47ed727 number=19260657
[INFO] [02-19|08:40:42.742] [snapshots] Prune Blocks                 to=19170000 limit=100
@darklow
Copy link

darklow commented Feb 20, 2024

I have noticed same issue, running two nodes and they used to be in perfect sync. Now we upgraded one of nodes to v2.58.0 and it is periodically running behind the old one, sometimes 10-20 blocks even.

@0x19dG87
Copy link
Author

In my case, I never see it in sync. Always at least 2 blocks behind.

@darklow
Copy link

darklow commented Feb 20, 2024 •
edited
Loading

Here are my logs, node was out of sync from 09:43 - 9:56 and then synced back. Gaps like are very common in this version, sometimes few minutes, sometimes more:

erigon  | [INFO] [02-20|09:38:20.295] head updated                             hash=0xa8e50845025aa59d1e7f3cc079e8dc5682508a171fcecbe60dc6d023e902c05c number=19268078
erigon  | [INFO] [02-20|09:38:20.383] [snapshots] Prune Blocks                 to=19178000 limit=100
erigon  | [INFO] [02-20|09:38:31.455] [p2p] GoodPeers                          eth67=99 eth66=1 eth68=100
erigon  | [INFO] [02-20|09:38:32.721] [txpool] stat                            pending=161 baseFee=30000 queued=30000 alloc=15.5GB sys=29.7GB
erigon  | [INFO] [02-20|09:38:33.104] [updateForkchoice] Fork choice update: flushing in-memory state (built by previous newPayload)
erigon  | [INFO] [02-20|09:38:33.410] RPC Daemon notified of new headers       from=19268078 to=19268079 hash=0xbc0090739ea60e59541fab675cb5234a845dba23b44e02c268c22b64f410c239 header sending=11.841µs log sending=172ns
erigon  | [INFO] [02-20|09:38:33.410] head updated                             hash=0xbc0090739ea60e59541fab675cb5234a845dba23b44e02c268c22b64f410c239 number=19268079
erigon  | [INFO] [02-20|09:38:33.456] [snapshots] Prune Blocks                 to=19178000 limit=100
erigon  | [INFO] [02-20|09:38:46.674] [updateForkchoice] Fork choice update: flushing in-memory state (built by previous newPayload)
erigon  | [INFO] [02-20|09:38:46.862] RPC Daemon notified of new headers       from=19268079 to=19268080 hash=0x22a3322da61856742af54a69249ac358950f7a143bb7cf370402ae9db406bf8b header sending=11.365µs log sending=167ns
erigon  | [INFO] [02-20|09:38:46.862] head updated                             hash=0x22a3322da61856742af54a69249ac358950f7a143bb7cf370402ae9db406bf8b number=19268080
erigon  | [INFO] [02-20|09:38:46.873] [snapshots] Prune Blocks                 to=19178000 limit=100
erigon  | [INFO] [02-20|09:38:57.132] P2P                                      app=caplin peers=20
erigon  | [INFO] [02-20|09:38:58.139] [updateForkchoice] Fork choice update: flushing in-memory state (built by previous newPayload)
erigon  | [INFO] [02-20|09:38:58.403] RPC Daemon notified of new headers       from=19268080 to=19268081 hash=0x948e9babebd96be9ba351149b4382bab9d6d5f60aebb5481e65ba32eb4c8c9bc header sending=33.475µs log sending=203ns
erigon  | [INFO] [02-20|09:38:58.403] head updated                             hash=0x948e9babebd96be9ba351149b4382bab9d6d5f60aebb5481e65ba32eb4c8c9bc number=19268081
erigon  | [INFO] [02-20|09:38:58.511] [snapshots] Prune Blocks                 to=19178000 limit=100
erigon  | [INFO] [02-20|09:39:57.132] P2P                                      app=caplin peers=23
erigon  | [INFO] [02-20|09:40:57.131] P2P                                      app=caplin peers=15
erigon  | [INFO] [02-20|09:41:31.456] [p2p] GoodPeers                          eth68=99 eth67=98 eth66=1
erigon  | [INFO] [02-20|09:41:32.721] [txpool] stat                            pending=1719 baseFee=30000 queued=30000 alloc=16.8GB sys=29.7GB
erigon  | [INFO] [02-20|09:41:57.131] P2P                                      app=caplin peers=17
erigon  | [INFO] [02-20|09:42:57.133] P2P                                      app=caplin peers=18
erigon  | [INFO] [02-20|09:43:46.149] [3/12 Senders] Started                   from=19268081 to=19268105
erigon  | [INFO] [02-20|09:43:46.239] [4/12 Execution] Blocks execution        from=19268081 to=19268105
erigon  | [INFO] [02-20|09:43:47.728] [4/12 Execution] Completed on            block=19268105
erigon  | [INFO] [02-20|09:43:47.729] [5/12 HashState] Promoting plain state   from=19268081 to=19268105
erigon  | [INFO] [02-20|09:43:47.729] [5/12 HashState] Incremental promotion   from=19268081 to=19268105 codes=true csbucket=AccountChangeSet
erigon  | [INFO] [02-20|09:43:47.870] [5/12 HashState] Incremental promotion   from=19268081 to=19268105 codes=false csbucket=AccountChangeSet
erigon  | [INFO] [02-20|09:43:48.095] [5/12 HashState] Incremental promotion   from=19268081 to=19268105 codes=false csbucket=StorageChangeSet
erigon  | [INFO] [02-20|09:43:48.479] [6/12 IntermediateHashes] Generating intermediate hashes from=19268081 to=19268105
erigon  | [INFO] [02-20|09:43:49.408] [7/12 CallTraces] Pruned call trace intermediate table from=19178081 to=19178104
erigon  | [INFO] [02-20|09:43:55.156] RPC Daemon notified of new headers       from=19268081 to=19268105 hash=0x138cd8b77dff0aeddbeca402948f3d129a8f2438e69cfa630bfed3d2153ee31a header sending=54.853µs log sending=386ns
erigon  | [INFO] [02-20|09:43:55.156] head updated                             hash=0x138cd8b77dff0aeddbeca402948f3d129a8f2438e69cfa630bfed3d2153ee31a number=19268105
erigon  | [INFO] [02-20|09:43:56.441] [snapshots] Prune Blocks                 to=19178000 limit=100
erigon  | [INFO] [02-20|09:43:57.132] P2P                                      app=caplin peers=19
erigon  | [INFO] [02-20|09:44:31.455] [p2p] GoodPeers                          eth68=100 eth67=98 eth66=1
erigon  | [INFO] [02-20|09:44:32.749] [txpool] stat                            pending=535 baseFee=30000 queued=30000 alloc=22.5GB sys=29.7GB
erigon  | [INFO] [02-20|09:44:57.132] P2P                                      app=caplin peers=22
erigon  | [INFO] [02-20|09:44:58.628] [4/12 Execution] Completed on            block=19268111
erigon  | [INFO] [02-20|09:45:00.545] RPC Daemon notified of new headers       from=19268105 to=19268111 hash=0x42e1714e840ad09e26d957c38adfa34a1ff394c117a89cb5c964c8f5fdafc902 header sending=17.188µs log sending=191ns
erigon  | [INFO] [02-20|09:45:00.545] head updated                             hash=0x42e1714e840ad09e26d957c38adfa34a1ff394c117a89cb5c964c8f5fdafc902 number=19268111
erigon  | [INFO] [02-20|09:45:01.256] [snapshots] Prune Blocks                 to=19178000 limit=100
erigon  | [INFO] [02-20|09:45:57.132] P2P                                      app=caplin peers=25
erigon  | [INFO] [02-20|09:46:57.132] P2P                                      app=caplin peers=19
erigon  | [INFO] [02-20|09:47:31.456] [p2p] GoodPeers                          eth68=99 eth67=98 eth66=1
erigon  | [INFO] [02-20|09:47:32.763] [txpool] stat                            pending=1524 baseFee=30000 queued=30000 alloc=14.9GB sys=29.7GB
erigon  | [INFO] [02-20|09:47:57.131] P2P                                      app=caplin peers=21
erigon  | [INFO] [02-20|09:48:57.131] P2P                                      app=caplin peers=11
erigon  | [INFO] [02-20|09:49:57.132] P2P                                      app=caplin peers=13
erigon  | [INFO] [02-20|09:50:31.456] [p2p] GoodPeers                          eth68=98 eth67=98 eth66=1
erigon  | [INFO] [02-20|09:50:32.720] [txpool] stat                            pending=2864 baseFee=30000 queued=30000 alloc=18.0GB sys=29.7GB
erigon  | [INFO] [02-20|09:50:57.132] P2P                                      app=caplin peers=12
erigon  | [INFO] [02-20|09:51:57.132] P2P                                      app=caplin peers=13
erigon  | [INFO] [02-20|09:52:57.132] P2P                                      app=caplin peers=17
erigon  | [INFO] [02-20|09:53:31.455] [p2p] GoodPeers                          eth66=1 eth68=99 eth67=99
erigon  | [INFO] [02-20|09:53:32.720] [txpool] stat                            pending=4211 baseFee=30000 queued=30000 alloc=19.9GB sys=29.7GB
erigon  | [INFO] [02-20|09:53:57.132] P2P                                      app=caplin peers=22
erigon  | [INFO] [02-20|09:54:57.132] P2P                                      app=caplin peers=16
erigon  | [INFO] [02-20|09:55:57.132] P2P                                      app=caplin peers=22
erigon  | [INFO] [02-20|09:56:31.456] [p2p] GoodPeers                          eth68=100 eth67=99 eth66=1
erigon  | [INFO] [02-20|09:56:32.720] [txpool] stat                            pending=5496 baseFee=30000 queued=30000 alloc=12.2GB sys=29.7GB
erigon  | [INFO] [02-20|09:56:34.580] [3/12 Senders] Started                   from=19268111 to=19268168
erigon  | [INFO] [02-20|09:56:34.770] [4/12 Execution] Blocks execution        from=19268111 to=19268168
erigon  | [INFO] [02-20|09:56:39.394] [4/12 Execution] Completed on            block=19268168
erigon  | [INFO] [02-20|09:56:39.394] [5/12 HashState] Promoting plain state   from=19268111 to=19268168
erigon  | [INFO] [02-20|09:56:39.394] [5/12 HashState] Incremental promotion   from=19268111 to=19268168 codes=true csbucket=AccountChangeSet
erigon  | [INFO] [02-20|09:56:39.642] [5/12 HashState] Incremental promotion   from=19268111 to=19268168 codes=false csbucket=AccountChangeSet
erigon  | [INFO] [02-20|09:56:40.291] [5/12 HashState] Incremental promotion   from=19268111 to=19268168 codes=false csbucket=StorageChangeSet
erigon  | [INFO] [02-20|09:56:41.229] [6/12 IntermediateHashes] Generating intermediate hashes from=19268111 to=19268168
erigon  | [INFO] [02-20|09:56:46.315] [7/12 CallTraces] Pruned call trace intermediate table from=19178111 to=19178167
erigon  | [INFO] [02-20|09:56:57.131] P2P                                      app=caplin peers=28
erigon  | [INFO] [02-20|09:56:57.532] RPC Daemon notified of new headers       from=19268111 to=19268168 hash=0x8414e732a294ac3b2a46eb4ec52dc85147ee58fda7d8216aa8face4a95a3bdae header sending=64.766µs log sending=192ns
erigon  | [INFO] [02-20|09:56:57.532] head updated                             hash=0x8414e732a294ac3b2a46eb4ec52dc85147ee58fda7d8216aa8face4a95a3bdae number=19268168
erigon  | [INFO] [02-20|09:56:59.883] [snapshots] Prune Blocks                 to=19178000 limit=100

@Giulio2002
Copy link
Collaborator

Hey, Could you guys see if switching to devel helps with that?

@0x19dG87
Copy link
Author

@Giulio2002 can confirm. Devel branch fixed this issue. I am in sync with the head now. Feel free to close this ticket.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@darklow @Giulio2002 @0x19dG87