Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

v1.3.7 (pebbledb + PBSS): Peering issues - unable to connect or maintain peers #2145

Closed
kaladinlight opened this issue Jan 9, 2024 · 14 comments
Closed

v1.3.7 (pebbledb + PBSS): Peering issues - unable to connect or maintain peers #2145

kaladinlight opened this issue Jan 9, 2024 · 14 comments
Assignees
@weiihann

Comments

@kaladinlight
Copy link

kaladinlight commented Jan 9, 2024 •
edited
Loading

System information

Geth version: v1.3.7
OS & Version: Linux

Expected behaviour

Establish and maintain a suitable pool of peer connections

Actual behaviour

Initial peering takes a significant amount of time resulting in the inability to sync on node start for up to 30 mins. Once a stable peer connection is established and the node finally starts syncing, there are never more than a handful (<5) peers ever connected. This results in any peers being dropped causing the node to stop syncing again and the inability to keep a node synced.

Steps to reproduce the behaviour

geth --config config.toml --datadir /data --syncmode full --db.engine pebble --http --http.addr 0.0.0.0 --http.port 8545 --http.api eth,net,web3,debug,txpool --http.vhosts '*' --http.corsdomain '*' --ws --ws.addr 0.0.0.0 --ws.port 8546 --ws.api eth,net,web3,debug,txpool --ws.origins '*' --state.scheme path --maxpeers 200 --rpc.allow-unprotected-txs --history.transactions 0 --snapshot='false' --nat none
[Eth]
StateScheme = "path"
NetworkId = 56
LightPeers = 100
TrieTimeout = 150000000000

[Eth.Miner]
GasCeil = 140000000
GasPrice = 3000000000
Recommit = 10000000000

[Eth.TxPool]
Locals = []
NoLocals = true
Journal = "transactions.rlp"
Rejournal = 3600000000000
PriceLimit = 3000000000
PriceBump = 10
AccountSlots = 200
GlobalSlots = 8000
AccountQueue = 200
GlobalQueue = 4000

[Eth.GPO]
Blocks = 20
Percentile = 60
OracleThreshold = 1000

[Node]
IPCPath = "geth.ipc"
InsecureUnlockAllowed = false
HTTPPort = 8545
HTTPVirtualHosts = ["localhost"]
HTTPModules = ["eth", "net", "web3", "txpool", "parlia"]
WSPort = 8546
WSModules = ["net", "web3", "eth"]

[Node.P2P]
MaxPeers = 200
NoDiscovery = false
StaticNodes = []
ListenAddr = ":30311"
EnableMsgEvents = false

Backtrace

INFO [01-08|21:55:44.770] Starting Geth on BSC mainnet... 
INFO [01-08|21:55:44.771] Bumping default cache on mainnet         provided=1024 updated=4096
INFO [01-08|21:55:44.772] Maximum peer count                       ETH=300 LES=0 total=300
INFO [01-08|21:55:44.773] Smartcard socket not found, disabling    err="stat /run/pcscd/pcscd.comm: no such file or directory"
INFO [01-08|21:55:44.774] Using pebble as db engine 
INFO [01-08|21:55:44.961] Using pebble as the backing database 
INFO [01-08|21:55:44.961] Allocated cache and file handles         database=/data/geth/chaindata cache=1.60GiB handles=524,288 "memory table"=409.50MiB
INFO [01-08|21:55:45.447] Opened ancient database                  database=/data/geth/chaindata/ancient/chain readonly=true frozen=34,984,017
INFO [01-08|21:55:45.479] All are provided, state scheme set to already existing scheme=path
INFO [01-08|21:55:45.481] Set global gas cap                       cap=50,000,000
INFO [01-08|21:55:45.481] Initializing the KZG library             backend=gokzg
INFO [01-08|21:55:45.504] Capped dirty cache size                  provided=1024.00MiB adjusted=256.00MiB
INFO [01-08|21:55:45.504] Clean cache size                         provided=1.40GiB
INFO [01-08|21:55:45.504] Allocated trie memory caches             clean=1.40GiB dirty=256.00MiB
INFO [01-08|21:55:45.524] Using pebble as the backing database 
INFO [01-08|21:55:45.524] Allocated cache and file handles         database=/data/geth/chaindata               cache=1.60GiB handles=524,288 "memory table"=409.50MiB
INFO [01-08|21:55:45.793] Opened ancient database                  database=/data/geth/chaindata/ancient/chain readonly=false frozen=34,984,017
INFO [01-08|21:55:45.837] Unprotected transactions allowed 
INFO [01-08|21:55:45.837] Parlia                                   chainConfig="{ChainID: 56 Homestead: 0 DAO: <nil> DAOSupport: false EIP150: 0 EIP155: 0 EIP158: 0 Byzantium: 0 Constantinople: 0 Petersburg: 0 Istanbul: 0, Muir Glacier: 0, Ramanujan: 0, Niels: 0, MirrorSync: 5184000, Bruno: 13082000, Berlin: 31302048, YOLO v3: <nil>, CatalystBlock: <nil>, London: 31302048, ArrowGlacier: <nil>, MergeFork:<nil>, Euler: 18907621, Gibbs: 23846001, Nano: 21962149, Moran: 22107423, Planck: 27281024,Luban: 29020050, Plato: 30720096, Hertz: 31302048, Hertzfix: 34140700, ShanghaiTime: 1705996800, KeplerTime: 1705996800, Engine: parlia}"
INFO [01-08|21:55:45.842] Initialising Ethereum protocol           network=56 dbversion=8
INFO [01-08|21:55:51.066] new async node buffer                    limit=256.00MiB layers=230
INFO [01-08|21:55:52.664] Opened ancient database                  database=/data/geth/chaindata/ancient/state readonly=false frozen=35,065,314
WARN [01-08|21:55:52.664] Path-based state scheme is an experimental feature sync=false
INFO [01-08|21:55:52.681] Initialised chain configuration          config="{ChainID: 56 Homestead: 0 DAO: <nil> DAOSupport: false EIP150: 0 EIP155: 0 EIP158: 0 Byzantium: 0 Constantinople: 0 Petersburg: 0 Istanbul: 0, Muir Glacier: 0, Ramanujan: 0, Niels: 0, MirrorSync: 5184000, Bruno: 13082000, Berlin: 31302048, YOLO v3: <nil>, CatalystBlock: <nil>, London: 31302048, ArrowGlacier: <nil>, MergeFork:<nil>, Euler: 18907621, Gibbs: 23846001, Nano: 21962149, Moran: 22107423, Planck: 27281024,Luban: 29020050, Plato: 30720096, Hertz: 31302048, Hertzfix: 34140700, ShanghaiTime: 1705996800, KeplerTime: 1705996800, Engine: parlia}"
INFO [01-08|21:55:53.009] Loaded most recent local block           number=35,074,016 hash=3a53d6..daf386 root=288726..03b361 td=69,682,054 age=1h46m32s
INFO [01-08|21:55:53.020] Loaded most recent local finalized block number=35,074,014 hash=3a1bf4..7148bf root=6b1e15..e6170e td=69,682,050 age=1h46m38s
INFO [01-08|21:55:53.084] Loaded last snap-sync pivot marker       number=6,920,578
INFO [01-08|21:55:53.166] Initialized transaction indexer          limit=0
WARN [01-08|21:55:53.166] Sanitizing invalid txpool lifetime       provided=0s         updated=3h0m0s
WARN [01-08|21:55:53.166] Sanitizing invalid txpool reannounce time provided=0s         updated=1m0s
INFO [01-08|21:55:53.166] Create votePool successfully 
WARN [01-08|21:55:53.166] Sanitizing invalid gasprice oracle price cap provided=<nil>      updated=100,000,000,000
WARN [01-08|21:55:53.166] Sanitizing invalid gasprice oracle ignore price provided=<nil>      updated=4
WARN [01-08|21:55:53.166] Sanitizing invalid gasprice oracle max header history provided=0          updated=1
WARN [01-08|21:55:53.166] Sanitizing invalid gasprice oracle max block history provided=0          updated=1
WARN [01-08|21:55:53.303] Old unclean shutdowns found              count=7
WARN [01-08|21:55:53.304] Unclean shutdown detected                booted=2021-05-13T03:19:20+0000 age=2y8mo1w
WARN [01-08|21:55:53.304] Unclean shutdown detected                booted=2021-05-13T03:19:50+0000 age=2y8mo1w
WARN [01-08|21:55:53.304] Unclean shutdown detected                booted=2021-05-13T03:20:21+0000 age=2y8mo1w
WARN [01-08|21:55:53.304] Unclean shutdown detected                booted=2021-05-13T03:20:58+0000 age=2y8mo1w
WARN [01-08|21:55:53.304] Unclean shutdown detected                booted=2021-05-13T03:21:41+0000 age=2y8mo1w
WARN [01-08|21:55:53.304] Unclean shutdown detected                booted=2021-05-13T03:22:26+0000 age=2y8mo1w
WARN [01-08|21:55:53.304] Unclean shutdown detected                booted=2021-05-13T03:23:12+0000 age=2y8mo1w
WARN [01-08|21:55:53.304] Unclean shutdown detected                booted=2021-05-13T03:24:03+0000 age=2y8mo1w
WARN [01-08|21:55:53.304] Unclean shutdown detected                booted=2021-11-17T07:15:13+0000 age=2y2mo2d
WARN [01-08|21:55:53.304] Unclean shutdown detected                booted=2023-11-21T08:10:29+0000 age=1mo2w4d
INFO [01-08|21:55:53.304] Starting peer-to-peer node               instance=Geth/v1.3.7-f28b98a9-20231219/linux-amd64/go1.20.12
INFO [01-08|21:55:54.501] New local node record                    seq=1,701,418,474,182 id=faf443f4d00ef9a6 ip=127.0.0.1 udp=30311 tcp=30311
INFO [01-08|21:55:54.503] IPC endpoint opened                      url=/data/geth.ipc
INFO [01-08|21:55:54.503] Started P2P networking                   self=enode://ffb179e966fb90cd7f9886e45e97db6d0899c5405fa9008d619da7cdafcce68e6fbb979cbd8416ed5b7f3f865da80e9218c666df79f6c2607ee48feb41a92709@127.0.0.1:30311
INFO [01-08|21:55:54.504] HTTP server started                      endpoint=[::]:8545 auth=false prefix= cors=* vhosts=*
INFO [01-08|21:55:54.504] WebSocket enabled                        url=ws://[::]:8546
INFO [01-08|21:56:05.809] Looking for peers                        peercount=0 tried=257 static=0
INFO [01-08|21:56:16.443] Looking for peers                        peercount=0 tried=100 static=0
INFO [01-08|21:56:26.451] Looking for peers                        peercount=0 tried=184 static=0
INFO [01-08|21:56:36.549] Looking for peers                        peercount=0 tried=184 static=0
INFO [01-08|21:56:46.568] Looking for peers                        peercount=0 tried=89  static=0
INFO [01-08|21:56:54.502] Current status                           table_size=85 pending_size=3 db_size=10,092,157
INFO [01-08|21:56:56.608] Looking for peers                        peercount=0 tried=155 static=0
INFO [01-08|21:57:07.027] Looking for peers                        peercount=0 tried=110 static=0
INFO [01-08|21:57:17.313] Looking for peers                        peercount=0 tried=181 static=0
INFO [01-08|21:57:27.551] Looking for peers                        peercount=0 tried=105 static=0
INFO [01-08|21:57:37.596] Looking for peers                        peercount=2 tried=159 static=0
ERROR[01-08|21:57:41.197] Bsc extension Handshake failed           peer=52f21476 err="read timeout"
ERROR[01-08|21:57:41.271] Bsc extension Handshake failed           peer=f8754c46 err="read timeout"
INFO [01-08|21:57:47.598] Looking for peers                        peercount=0 tried=103 static=0
INFO [01-08|21:57:54.502] Current status                           table_size=97 pending_size=25 db_size=10,092,157
INFO [01-08|21:57:57.827] Looking for peers                        peercount=0 tried=187 static=0
INFO [01-08|21:58:07.934] Looking for peers                        peercount=0 tried=179 static=0
ERROR[01-08|21:58:12.383] Bsc extension Handshake failed           peer=9d3101d1 err=EOF
INFO [01-08|21:58:18.052] Looking for peers                        peercount=0 tried=131 static=0
INFO [01-08|21:58:28.841] Looking for peers                        peercount=0 tried=147 static=0
INFO [01-08|21:58:39.089] Looking for peers                        peercount=0 tried=152 static=0
INFO [01-08|21:58:49.421] Looking for peers                        peercount=0 tried=156 static=0
INFO [01-08|21:58:54.501] Current status                           table_size=97 pending_size=36 db_size=10,092,157
INFO [01-08|21:58:59.430] Looking for peers                        peercount=0 tried=214 static=0
ERROR[01-08|21:59:08.845] Bsc extension Handshake failed           peer=99f8f7c4 err="read timeout"
INFO [01-08|21:59:09.480] Looking for peers                        peercount=0 tried=129 static=0
INFO [01-08|21:59:19.492] Looking for peers                        peercount=2 tried=175 static=0
INFO [01-08|21:59:29.585] Looking for peers                        peercount=0 tried=193 static=0
INFO [01-08|21:59:39.593] Looking for peers                        peercount=0 tried=215 static=0
INFO [01-08|21:59:49.647] Looking for peers                        peercount=0 tried=89  static=0
INFO [01-08|21:59:54.502] Current status                           table_size=97 pending_size=36 db_size=10,092,157
INFO [01-08|22:00:00.045] Looking for peers                        peercount=0 tried=134 static=0
INFO [01-08|22:00:10.078] Looking for peers                        peercount=0 tried=227 static=0
INFO [01-08|22:00:20.161] Looking for peers                        peercount=0 tried=248 static=0
INFO [01-08|22:00:30.328] Looking for peers                        peercount=0 tried=138 static=0
INFO [01-08|22:00:40.342] Looking for peers                        peercount=0 tried=70  static=0
INFO [01-08|22:00:50.364] Looking for peers                        peercount=0 tried=144 static=0
INFO [01-08|22:00:54.502] Current status                           table_size=98 pending_size=19 db_size=10,092,157
INFO [01-08|22:01:00.422] Looking for peers                        peercount=0 tried=259 static=0
INFO [01-08|22:01:11.429] Looking for peers                        peercount=0 tried=55  static=0
INFO [01-08|22:01:21.438] Looking for peers                        peercount=0 tried=144 static=0
INFO [01-08|22:01:31.444] Looking for peers                        peercount=1 tried=141 static=0
INFO [01-08|22:01:41.657] Looking for peers                        peercount=0 tried=169 static=0
ERROR[01-08|22:01:51.910] Bsc extension Handshake failed           peer=e950bf32 err="read timeout"
ERROR[01-08|22:01:52.411] Bsc extension Handshake failed           peer=a4f46290 err="read timeout"
ERROR[01-08|22:01:52.486] Bsc extension Handshake failed           peer=f8754c46 err="read timeout"
INFO [01-08|22:01:54.502] Current status                           table_size=112 pending_size=33 db_size=10,092,157
ERROR[01-08|22:01:57.843] Bsc extension Handshake failed           peer=622d24b9 err="read timeout"
INFO [01-08|22:02:02.084] Looking for peers                        peercount=0 tried=208 static=0
INFO [01-08|22:02:12.310] Looking for peers                        peercount=0 tried=148 static=0
INFO [01-08|22:02:22.364] Looking for peers                        peercount=0 tried=113 static=0
INFO [01-08|22:02:32.841] Looking for peers                        peercount=0 tried=141 static=0
ERROR[01-08|22:02:41.842] Bsc extension Handshake failed           peer=622d24b9 err="read timeout"
INFO [01-08|22:02:42.842] Looking for peers                        peercount=2 tried=272 static=0
INFO [01-08|22:02:53.773] Looking for peers                        peercount=0 tried=79  static=0
INFO [01-08|22:02:54.502] Current status                           table_size=112 pending_size=31 db_size=10,092,157
INFO [01-08|22:03:03.867] Looking for peers                        peercount=0 tried=274 static=0
INFO [01-08|22:03:13.893] Looking for peers                        peercount=0 tried=150 static=0
INFO [01-08|22:03:25.061] Looking for peers                        peercount=0 tried=122 static=0
INFO [01-08|22:03:35.474] Looking for peers                        peercount=0 tried=200 static=0
INFO [01-08|22:03:45.549] Looking for peers                        peercount=1 tried=160 static=0
INFO [01-08|22:03:54.503] Current status                           table_size=112 pending_size=10 db_size=10,092,157
INFO [01-08|22:03:55.816] Looking for peers                        peercount=1 tried=213 static=0
INFO [01-08|22:04:06.300] Looking for peers                        peercount=1 tried=75  static=0
INFO [01-08|22:04:16.313] Looking for peers                        peercount=1 tried=93  static=0
INFO [01-08|22:04:26.541] Looking for peers                        peercount=1 tried=220 static=0
INFO [01-08|22:04:36.579] Looking for peers                        peercount=1 tried=29  static=0
INFO [01-08|22:04:46.866] Looking for peers                        peercount=1 tried=154 static=0
INFO [01-08|22:04:54.501] Current status                           table_size=111 pending_size=11 db_size=10,092,157
INFO [01-08|22:04:57.008] Looking for peers                        peercount=1 tried=127 static=0
INFO [01-08|22:05:07.210] Looking for peers                        peercount=1 tried=171 static=0
INFO [01-08|22:05:17.405] Looking for peers                        peercount=1 tried=99  static=0
INFO [01-08|22:05:27.523] Looking for peers                        peercount=1 tried=141 static=0
INFO [01-08|22:05:38.390] Looking for peers                        peercount=1 tried=169 static=0
INFO [01-08|22:05:48.407] Looking for peers                        peercount=1 tried=129 static=0
INFO [01-08|22:05:54.503] Current status                           table_size=109 pending_size=4  db_size=10,102,512
INFO [01-08|22:05:58.507] Looking for peers                        peercount=1 tried=76  static=0
INFO [01-08|22:06:08.664] Looking for peers                        peercount=1 tried=161 static=0
INFO [01-08|22:06:18.766] Looking for peers                        peercount=0 tried=81  static=0
INFO [01-08|22:06:30.989] Looking for peers                        peercount=0 tried=144 static=0
INFO [01-08|22:06:41.099] Looking for peers                        peercount=0 tried=89  static=0
INFO [01-08|22:06:51.110] Looking for peers                        peercount=0 tried=154 static=0
INFO [01-08|22:06:54.502] Current status                           table_size=106 pending_size=6  db_size=10,102,512
INFO [01-08|22:07:01.230] Looking for peers                        peercount=0 tried=90  static=0
INFO [01-08|22:07:11.231] Looking for peers                        peercount=0 tried=128 static=0
INFO [01-08|22:07:21.401] Looking for peers                        peercount=0 tried=115 static=0
INFO [01-08|22:07:41.701] Looking for peers                        peercount=0 tried=134 static=0
ERROR[01-08|22:07:49.347] Bsc extension Handshake failed           peer=52f89ab8 err="read timeout"
ERROR[01-08|22:07:49.553] Bsc extension Handshake failed           peer=3dff2759 err="read timeout"
ERROR[01-08|22:07:49.553] Bsc extension Handshake failed           peer=44514bb3 err="read timeout"
ERROR[01-08|22:07:49.618] Bsc extension Handshake failed           peer=d25cab84 err="read timeout"
INFO [01-08|22:07:51.723] Looking for peers                        peercount=0 tried=143 static=0
INFO [01-08|22:07:54.502] Current status                           table_size=140 pending_size=19 db_size=10,102,512
INFO [01-08|22:08:01.728] Looking for peers                        peercount=1 tried=124 static=0
INFO [01-08|22:08:11.836] Looking for peers                        peercount=0 tried=68  static=0
INFO [01-08|22:08:22.088] Looking for peers                        peercount=0 tried=92  static=0
ERROR[01-08|22:08:27.382] Bsc extension Handshake failed           peer=ded01101 err="read timeout"
INFO [01-08|22:08:32.854] Looking for peers                        peercount=0 tried=144 static=0
INFO [01-08|22:08:42.883] Looking for peers                        peercount=0 tried=160 static=0
INFO [01-08|22:08:52.900] Looking for peers                        peercount=0 tried=201 static=0
INFO [01-08|22:08:54.501] Current status                           table_size=136 pending_size=49 db_size=10,102,512
INFO [01-08|22:09:04.500] Looking for peers                        peercount=0 tried=153 static=0
INFO [01-08|22:09:14.739] Looking for peers                        peercount=0 tried=46  static=0
INFO [01-08|22:09:24.756] Looking for peers                        peercount=1 tried=212 static=0
INFO [01-08|22:09:34.831] Looking for peers                        peercount=1 tried=214 static=0
ERROR[01-08|22:09:38.209] Bsc extension Handshake failed           peer=3dff2759 err="read timeout"
INFO [01-08|22:09:44.832] Looking for peers                        peercount=2 tried=135 static=0
ERROR[01-08|22:09:48.928] Bsc extension Handshake failed           peer=5951b078 err=EOF
INFO [01-08|22:09:54.503] Current status                           table_size=131 pending_size=149 db_size=10,102,512
INFO [01-08|22:09:54.841] Looking for peers                        peercount=0 tried=161 static=0
INFO [01-08|22:10:04.846] Looking for peers                        peercount=1 tried=178 static=0
INFO [01-08|22:10:14.936] Looking for peers                        peercount=0 tried=61  static=0
INFO [01-08|22:10:25.015] Looking for peers                        peercount=0 tried=198 static=0
INFO [01-08|22:10:35.431] Looking for peers                        peercount=0 tried=165 static=0
ERROR[01-08|22:10:42.860] Bsc extension Handshake failed           peer=c15d5415 err=EOF
INFO [01-08|22:10:45.452] Looking for peers                        peercount=0 tried=158 static=0
INFO [01-08|22:10:54.502] Current status                           table_size=129 pending_size=42  db_size=10,105,350
INFO [01-08|22:10:55.942] Looking for peers                        peercount=0 tried=204 static=0
INFO [01-08|22:11:06.207] Looking for peers                        peercount=1 tried=215 static=0
INFO [01-08|22:11:16.217] Looking for peers                        peercount=1 tried=150 static=0
INFO [01-08|22:11:26.257] Looking for peers                        peercount=1 tried=112 static=0
INFO [01-08|22:11:36.424] Looking for peers                        peercount=0 tried=225 static=0
INFO [01-08|22:11:46.597] Looking for peers                        peercount=0 tried=169 static=0
INFO [01-08|22:11:54.501] Current status                           table_size=128 pending_size=61  db_size=10,105,350
INFO [01-08|22:11:56.773] Looking for peers                        peercount=0 tried=205 static=0
INFO [01-08|22:12:06.998] Looking for peers                        peercount=0 tried=135 static=0
INFO [01-08|22:12:17.588] Looking for peers                        peercount=0 tried=157 static=0
INFO [01-08|22:12:27.623] Looking for peers                        peercount=0 tried=93  static=0
INFO [01-08|22:12:37.792] Looking for peers                        peercount=0 tried=182 static=0
ERROR[01-08|22:12:52.157] Bsc extension Handshake failed           peer=d25cab84 err="read timeout"
ERROR[01-08|22:12:52.181] Bsc extension Handshake failed           peer=99f8f7c4 err="read timeout"
INFO [01-08|22:12:54.503] Current status                           table_size=128 pending_size=8   db_size=10,105,350
INFO [01-08|22:12:58.053] Looking for peers                        peercount=0 tried=75  static=0
INFO [01-08|22:13:08.081] Looking for peers                        peercount=0 tried=141 static=0
INFO [01-08|22:13:18.158] Looking for peers                        peercount=0 tried=83  static=0
INFO [01-08|22:13:28.245] Looking for peers                        peercount=1 tried=180 static=0
ERROR[01-08|22:13:31.683] Bsc extension Handshake failed           peer=2efd5859 err="read timeout"
INFO [01-08|22:13:38.256] Looking for peers                        peercount=1 tried=106 static=0
INFO [01-08|22:13:48.393] Looking for peers                        peercount=0 tried=170 static=0
INFO [01-08|22:13:54.502] Current status                           table_size=127 pending_size=25  db_size=10,105,350
INFO [01-08|22:13:55.570] Block synchronisation started 
INFO [01-08|22:13:58.560] Looking for peers                        peercount=1 tried=174 static=0
INFO [01-08|22:13:59.077] Imported new chain segment               number=35,074,017 hash=7bee4e..5af1be miner=0x70F657164e5b75689b64B7fd1fA275F334f28e18 blocks=1 txs=101 mgas=10.178 elapsed=839.687ms mgasps=12.121 age=2h4m35s  triediffs=149.90MiB triedirty=89.39MiB trieimutabledirty=0.00B
INFO [01-08|22:14:07.116] Imported new chain segment               number=35,074,031 hash=c41a93..22ca00 miner=0xEF0274E31810C9Df02F98FAFDe0f841F4E66a1Cd blocks=14 txs=1695 mgas=151.640 elapsed=8.038s    mgasps=18.865 age=2h4m1s   triediffs=148.43MiB triedirty=94.18MiB trieimutabledirty=0.00B
INFO [01-08|22:14:08.777] Looking for peers                        peercount=1 tried=155 static=0
INFO [01-08|22:14:15.444] Imported new chain segment               number=35,074,052 hash=709ef4..a0af63 miner=0xEF0274E31810C9Df02F98FAFDe0f841F4E66a1Cd blocks=21 txs=2500 mgas=227.001 elapsed=8.327s    mgasps=27.258 age=2h3m6s   triediffs=150.50MiB triedirty=98.67MiB trieimutabledirty=0.00B
INFO [01-08|22:14:18.782] Looking for peers                        peercount=1 tried=95  static=0
INFO [01-08|22:14:23.629] Imported new chain segment               number=35,074,073 hash=b16a4d..d4be93 miner=0xEF0274E31810C9Df02F98FAFDe0f841F4E66a1Cd blocks=21 txs=2389 mgas=222.709 elapsed=8.184s    mgasps=27.210 age=2h2m11s  triediffs=152.39MiB triedirty=102.95MiB trieimutabledirty=0.00B
INFO [01-08|22:14:28.800] Looking for peers                        peercount=1 tried=172 static=0
@zzzckck
Copy link
Collaborator

zzzckck commented Jan 10, 2024

Is it a new node just set up based on the bsc-snapshot?

@weiihann
Copy link
Contributor

weiihann commented Jan 10, 2024 •
edited
Loading

Let me investigate this. Meanwhile, here's what you can do:

  1. Delete your geth/nodes folder. This will clear off existing node records and start from scratch.

  2. Try putting "DialRatio = 2" in your config file, here's how it would look like:

...
[Node.P2P]
MaxPeers = 200
NoDiscovery = false
StaticNodes = []
ListenAddr = ":30311"
EnableMsgEvents = false
DialRatio = 2

What this does is that it will enable 1/2 connections to be dialed (the default is 1/3), and it might help to connect to more peers.

  1. If both still don't work, please change the log level to "debug" and send over the debugging logs here, it'll be super helpful to us.

Thanks!

@weiihann weiihann mentioned this issue Jan 10, 2024
Closed
@weiihann
Copy link
Contributor

@FerdyCai @kaladinlight do you guys mind sharing which region your nodes are running in?

@kaladinlight
Copy link
Author

Is it a new node just set up based on the bsc-snapshot?

Node is bootstrapped from the bsc-snapshot.

@kaladinlight
Copy link
Author

kaladinlight commented Jan 10, 2024 •
edited
Loading

Let me investigate this. Meanwhile, here's what you can do:

  1. Delete your geth/nodes folder. This will clear off existing node records and start from scratch.
  2. Try putting "DialRatio = 2" in your config file, here's how it would look like:
...
[Node.P2P]
MaxPeers = 200
NoDiscovery = false
StaticNodes = []
ListenAddr = ":30311"
EnableMsgEvents = false
DialRatio = 2

What this does is that it will enable 1/2 connections to be dialed (the default is 1/3), and it might help to connect to more peers.

  1. If both still don't work, please change the log level to "debug" and send over the debugging logs here, it'll be super helpful to us.

Thanks!

I will start with steps 1 and 2 and report back with debug if there is no improvement. Thanks for the suggestions!

Also while talking about the nodes directory, what are nodes_0815 and nodes_0818 for?

@kaladinlight
Copy link
Author

@FerdyCai @kaladinlight do you guys mind sharing which region your nodes are running in?

I am running in us-east-2 (ohio)

@FerdyCai
Copy link

@FerdyCai @kaladinlight你们介意分享一下您的节点在哪个区域运行吗？

I am running in Singapore.

@zzzckck
Copy link
Collaborator

zzzckck commented Jan 11, 2024

Let me investigate this. Meanwhile, here's what you can do:

  1. Delete your geth/nodes folder. This will clear off existing node records and start from scratch.
  2. Try putting "DialRatio = 2" in your config file, here's how it would look like:
...
[Node.P2P]
MaxPeers = 200
NoDiscovery = false
StaticNodes = []
ListenAddr = ":30311"
EnableMsgEvents = false
DialRatio = 2

What this does is that it will enable 1/2 connections to be dialed (the default is 1/3), and it might help to connect to more peers.

  1. If both still don't work, please change the log level to "debug" and send over the debugging logs here, it'll be super helpful to us.

Thanks!

I will start with steps 1 and 2 and report back with debug if there is no improvement. Thanks for the suggestions!

Also while talking about the nodes directory, what are nodes_0815 and nodes_0818 for?

nodes_0815 and nodes_0818 are useless, you can just deleter it, we will remove the 2 folders next time.

@nyacat nyacat mentioned this issue Jan 11, 2024
Closed
@flywukong
Copy link
Contributor

flywukong commented Jan 11, 2024 •
edited
Loading

You can also try the following method：

  1. start synchronization from genesis block
  2. stop the node after successful synchronization, this will be completed quickly and generate the nodes directory
  3. replace the chaindata directory and triecache directory of bsc-snapshot
  4. restart fullnode

You can refer to in the README of snapshot of chapter Step 3: Replace Data

@kaladinlight
Copy link
Author

Let me investigate this. Meanwhile, here's what you can do:

  1. Delete your geth/nodes folder. This will clear off existing node records and start from scratch.
  2. Try putting "DialRatio = 2" in your config file, here's how it would look like:
...
[Node.P2P]
MaxPeers = 200
NoDiscovery = false
StaticNodes = []
ListenAddr = ":30311"
EnableMsgEvents = false
DialRatio = 2

What this does is that it will enable 1/2 connections to be dialed (the default is 1/3), and it might help to connect to more peers.

  1. If both still don't work, please change the log level to "debug" and send over the debugging logs here, it'll be super helpful to us.

Thanks!

I will start with steps 1 and 2 and report back with debug if there is no improvement. Thanks for the suggestions!
Also while talking about the nodes directory, what are nodes_0815 and nodes_0818 for?

nodes_0815 and nodes_0818 are useless, you can just deleter it, we will remove the 2 folders next time.

Removed. And I don't know where the comment about deleting the nodekey went, but this made all of the difference! Instantly started connecting to peers and syncing. Looks like the trick and something that should be removed from the next snapshot. Thanks!

@zzzckck
Copy link
Collaborator

zzzckck commented Jan 12, 2024 •
edited
Loading

tri

Well, I thought the snapshot should have removed the "<datadir>/nodekey", so I removed the previous reply. But it turns out this PBSS+PebbleDB snapshot forget to remove the nodekey... So you do need to remove the nodekey this time, we will remove nodekey from snapshot in the future

@zzzckck zzzckck mentioned this issue Jan 12, 2024
Closed
@zzzckck
Copy link
Collaborator

zzzckck commented Jan 12, 2024

updated to #1947
image

@zzzckck zzzckck closed this as completed Jan 12, 2024
@kaladinlight
Copy link
Author

tri

Well, I thought the snapshot should have removed the "/nodekey", so I removed the previous reply. But it turns out this PBSS+PebbleDB snapshot forget to remove the nodekey... So you do need to remove the nodekey this time, we will remove nodekey from snapshot in the future

Ha, well glad I caught it in my email. Thanks for the help sorting this issue!

@HarshitJoshi HarshitJoshi mentioned this issue Jan 19, 2024
Closed
@supamongkonR supamongkonR mentioned this issue Mar 8, 2024
Closed
@wtdcode
Copy link

wtdcode commented Apr 22, 2024

updated to #1947 image

This really helps! Thanks.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@weiihann weiihann

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
6 participants
@flywukong @wtdcode @kaladinlight @weiihann @FerdyCai @zzzckck