Skip to content
This repository has been archived by the owner on Nov 6, 2020. It is now read-only.

Stage 4 block verification failed on startup #10665

Closed
APshenkin opened this issue May 15, 2019 · 20 comments · Fixed by #10669
Closed

Stage 4 block verification failed on startup #10665

APshenkin opened this issue May 15, 2019 · 20 comments · Fixed by #10669
Labels
Z1-question 🙋‍♀️ Issue is a question. Closer should answer.
Milestone

Comments

@APshenkin
Copy link

  • Parity Ethereum version: 2.4.6
  • Operating system: Linux
  • Installation: docker
  • Fully synchronized: yes
  • Network: kovan
  • Restarted: yes

Your issue description goes here below. Try to include actual vs. expected behavior and steps to reproduce the issue.

After docker restarting parity fails to start sync

2019-05-15 12:55:39 UTC Starting Parity-Ethereum/v2.4.6-stable-94164e1-20190514/x86_64-linux-gnu/rustc1.34.1
2019-05-15 12:55:39 UTC Keys path /home/parity/.local/share/io.parity.ethereum//keys/kovan
2019-05-15 12:55:39 UTC DB path /home/parity/.local/share/io.parity.ethereum//chains/kovan/db/9bf388941c25ea98
2019-05-15 12:55:39 UTC State DB configuration: archive +Fat +Trace
2019-05-15 12:55:39 UTC Operating mode: active
2019-05-15 12:55:39 UTC Warning: Warp Sync is disabled because Fat DB is turned on.
2019-05-15 12:55:39 UTC Configured for Kovan Testnet using AuthorityRound engine
2019-05-15 12:55:39 UTC Listening for new connections on 0.0.0.0:8546.
2019-05-15 12:55:39 UTC Accepted a new tcp connection from 10.136.10.94:57239.
2019-05-15 12:55:40 UTC Stage 4 block verification failed for #10960441 (0xc204…f245)
Error: Error(Engine(NotProposer(Mismatch { expected: 0x00e6d2b931f55a3f1701c7389d592a7778897879, found: 0x00d6cc1ba9cf89bd2e58009741f4f7325badc0ed })), State { next_error: None, backtrace: InternalBacktrace { backtrace: Some(stack backtrace:
   0:     0x56194353f19d - <no info>
   1:     0x56194353e562 - <no info>
   2:     0x561943297ec8 - <no info>
   3:     0x5619432981f5 - <no info>
   4:     0x561942d5ff63 - <no info>
   5:     0x561942d695b7 - <no info>
   6:     0x561942b6e2ed - <no info>
   7:     0x561942d38ee9 - <no info>
   8:     0x5619425c82c0 - <no info>
   9:     0x561942bf97b9 - <no info>
  10:     0x561942bc3e88 - <no info>
  11:     0x561942bc610c - <no info>
  12:     0x561942bf3f9a - <no info>
  13:     0x561942ce2ddd - <no info>
  14:     0x5619435b7ed9 - <no info>
  15:     0x561942c45b4e - <no info>
  16:     0x5619435b721d - <no info>
  17:     0x7fe720cb76b9 - <no info>
  18:     0x7fe7207d741c - <no info>
  19:                0x0 - <no info>) } })
2019-05-15 12:55:40 UTC
Bad block detected: Error(Engine(NotProposer(Mismatch { expected: 0x00e6d2b931f55a3f1701c7389d592a7778897879, found: 0x00d6cc1ba9cf89bd2e58009741f4f7325badc0ed })), State { next_error: None, backtrace: InternalBacktrace { backtrace: Some(stack backtrace:
   0:     0x56194353f19d - <no info>
   1:     0x56194353e562 - <no info>
   2:     0x561943297ec8 - <no info>
   3:     0x5619432981f5 - <no info>
   4:     0x561942d5ff63 - <no info>
   5:     0x561942d695b7 - <no info>
   6:     0x561942b6e2ed - <no info>
   7:     0x561942d38ee9 - <no info>
   8:     0x5619425c82c0 - <no info>
   9:     0x561942bf97b9 - <no info>
  10:     0x561942bc3e88 - <no info>
  11:     0x561942bc610c - <no info>
  12:     0x561942bf3f9a - <no info>
  13:     0x561942ce2ddd - <no info>
  14:     0x5619435b7ed9 - <no info>
  15:     0x561942c45b4e - <no info>
  16:     0x5619435b721d - <no info>
  17:     0x7fe720cb76b9 - <no info>
  18:     0x7fe7207d741c - <no info>
  19:                0x0 - <no info>) } })
RLP: f902f6f90246a0159c1fecf41d5356618ec2286d92dbb5b3b53c5aec7902509566b14a89903752a01dcc4de8dec75d7aab85b567b6ccd41ad312451b948a7413f0a142fd40d493479400d6cc1ba9cf89bd2e58009741f4f7325badc0eda0380bc8466f8add1fc935f865f1dd3d5c5e61a81e12c4a24e9d063ec6a692c08ba0d7e3c695873522c7497e60b38f74a132a89fa3a24e4c2a0536ba453412a1587ca0dc7f95c926a4a85e02a1a05490518ef4ef1088f69018e3509f2fc21d8195a887b901000000000000000000000000000400000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000020000000000000000000000000000000000000001000000000000000000000000000000000000000000000000000080000000000000000000040000000000000000000000000040000000000800000000000000000000000000000000000000000000002000000000000000000000000000000000000800000000000000000000000000000000000000000000000000000000000000001000000000000000000000000001020000000000000000000000000000000000000000000000000000000000090fffffffffffffffffffffffffffffffd83a73e39837a120082b12b845cdbfa009fde830204068f5061726974792d457468657265756d86312e33342e31827769841736fe80b8419d047d9284b516c58e1afd154d77d9830475963b9eafcd12c16fb1edc026664d248dd24e7bd0e7c98d89ec086b0efdbcbcaa93f3e3fece06f669bc19a7dfe8bc01f8aaf8a8228471489bb382e651945a7353e9ad230dc2ac685f4dab091fd2b2d2a77e80b844095ea7b300000000000000000000000083096801cfb66db85024520ca5b3af136311a34600000000000000000000000000000000000000000000000000000000000003e81ca0619bece788d97020b1566ecedf358bf2af26c001ed20616de5015ab5f26cf87fa020de68e31bf592e742122330e617b896d7b82c95401afe1d15df8fc81cdb7ad0c0
Header: Header { parent_hash: 0x159c1fecf41d5356618ec2286d92dbb5b3b53c5aec7902509566b14a89903752, timestamp: 1557920256, number: 10960441, author: 0x00d6cc1ba9cf89bd2e58009741f4f7325badc0ed, transactions_root: 0xd7e3c695873522c7497e60b38f74a132a89fa3a24e4c2a0536ba453412a1587c, uncles_hash: 0x1dcc4de8dec75d7aab85b567b6ccd41ad312451b948a7413f0a142fd40d49347, extra_data: [222, 131, 2, 4, 6, 143, 80, 97, 114, 105, 116, 121, 45, 69, 116, 104, 101, 114, 101, 117, 109, 134, 49, 46, 51, 52, 46, 49, 130, 119, 105], state_root: 0x380bc8466f8add1fc935f865f1dd3d5c5e61a81e12c4a24e9d063ec6a692c08b, receipts_root: 0xdc7f95c926a4a85e02a1a05490518ef4ef1088f69018e3509f2fc21d8195a887, log_bloom: 0x00000000000000000000000004000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000200000000000000000000000000000000000000010000000000000000000000000000000000000000000000000000800000000000000000000400000000000000000000000000400000000008000000000000000000000000000000000000000000000020000000000000000000000000000000000008000000000000000000000000000000000000000000000000000000000000000010000000000000000000000000010200000000000000000000000000000000000000000000000000000000000, gas_used: 45355, gas_limit: 8000000, difficulty: 340282366920938463463374607431768211453, seal: [[132, 23, 54, 254, 128], [184, 65, 157, 4, 125, 146, 132, 181, 22, 197, 142, 26, 253, 21, 77, 119, 217, 131, 4, 117, 150, 59, 158, 175, 205, 18, 193, 111, 177, 237, 192, 38, 102, 77, 36, 141, 210, 78, 123, 208, 231, 201, 141, 137, 236, 8, 107, 14, 253, 188, 188, 170, 147, 243, 227, 254, 206, 6, 246, 105, 188, 25, 167, 223, 232, 188, 1]], hash: Some(0xc204c637aaeae7fd2fa9034dacaf35d5f290bf5ba35fb8adcf49a7748e7ef245) }
Uncles:
Transactions:[Tx 0] UnverifiedTransaction { unsigned: Transaction { nonce: 34, gas_price: 1900583859, gas: 58961, action: Call(0x5a7353e9ad230dc2ac685f4dab091fd2b2d2a77e), value: 0, data: [9, 94, 167, 179, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 131, 9, 104, 1, 207, 182, 109, 184, 80, 36, 82, 12, 165, 179, 175, 19, 99, 17, 163, 70, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 3, 232] }, v: 28, r: 44149842661914932399584453173009786420610147425525440546403923820432287660159, s: 14866975107517740504714974888260480849283556163795478444115221606568434563792, hash: 0x19b18ab00b67672f28314f4de43fc43a8bc8cf9d1fcc298ecaf48fb9532091c1 }
2019-05-15 12:55:44 UTC Public node URL: enode://1d3357c77f61f782d98a3d52daca8e6588df427ad898b56c597b1adbdcfae19c1275b3672e4af88e5c56a05bab68783fe4e8b5b000f3f1e6437661221d136920@172.18.0.2:30303
2019-05-15 12:56:14 UTC    3/25 peers    270 KiB chain   14 KiB db  0 bytes queue  260 KiB sync  RPC:  1 conn,    1 req/s,  250 µs

Is there any option to fix it without full resync?

@jam10o-new
Copy link
Contributor

jam10o-new commented May 15, 2019

Afaict that shouldn't have been an actual crash, you're just getting bad blocks on the network which your node should be ignoring? Kovan has just gone through a hardfork and you are on the right version of parity to continue syncing with the correct side of the chain.

How exactly are you running your node? Are you using --chain kovan or manual chainspec to connect to kovan?

@jam10o-new jam10o-new added the Z1-question 🙋‍♀️ Issue is a question. Closer should answer. label May 15, 2019
@jam10o-new jam10o-new modified the milestones: 2.7, 2.6 May 15, 2019
@jam10o-new
Copy link
Contributor

Here are the details of the fork #10628 (comment) and if you still are having trouble, you can always manually use the chainspec you can find in this repo at ethcore/res/ethereum/kovan.json

It appears you are somehow still using the old version of the chain specification (you are expecting an old validator).

@varasev
Copy link
Contributor

varasev commented May 15, 2019

Seems the reason is that a new bootnode is not fully synchronized yet: https://kovan-netstat.poa.network/

image

The old bootnodes have no new chain spec, so they are not working at the moment: https://kovan-stats.parity.io/

image

@APshenkin
Copy link
Author

@joshua-mir
I use this params on docker startup

--mode active
      --chain kovan
      --jsonrpc-interface all
      --jsonrpc-hosts all
      --jsonrpc-cors all
      --ws-interface all
      --ws-origins all
      --ws-hosts all
      --ws-apis web3,eth,net,parity,pubsub,traces
      --base-path /home/parity/.local/share/io.parity.ethereum/
      --fat-db on
      --tracing on
      --no-periodic-snapshot
      --pruning archive
      --logging INFO
      --cache-size 4096
      --db-compaction ssd

Currently I tried to delete nodes.json and there is no error message more, but syncing is not continiued

2019-05-15 13:21:04 UTC Starting Parity-Ethereum/v2.4.6-stable-94164e1-20190514/x86_64-linux-gnu/rustc1.34.1
2019-05-15 13:21:04 UTC Keys path /home/parity/.local/share/io.parity.ethereum//keys/kovan
2019-05-15 13:21:04 UTC DB path /home/parity/.local/share/io.parity.ethereum//chains/kovan/db/9bf388941c25ea98
2019-05-15 13:21:04 UTC State DB configuration: archive +Fat +Trace
2019-05-15 13:21:04 UTC Operating mode: active
2019-05-15 13:21:04 UTC Warning: Warp Sync is disabled because Fat DB is turned on.
2019-05-15 13:21:04 UTC Configured for Kovan Testnet using AuthorityRound engine
2019-05-15 13:21:04 UTC Listening for new connections on 0.0.0.0:8546.
2019-05-15 13:21:04 UTC Accepted a new tcp connection from 10.136.10.94:39601.
2019-05-15 13:21:09 UTC Public node URL: enode://1d3357c77f61f782d98a3d52daca8e6588df427ad898b56c597b1adbdcfae19c1275b3672e4af88e5c56a05bab68783fe4e8b5b000f3f1e6437661221d136920@172.18.0.2:30303
2019-05-15 13:21:34 UTC    3/25 peers    270 KiB chain   14 KiB db  0 bytes queue   15 KiB sync  RPC:  1 conn,    1 req/s, 9219 µs
2019-05-15 13:22:04 UTC    3/25 peers    270 KiB chain   14 KiB db  0 bytes queue   15 KiB sync  RPC:  1 conn,    1 req/s, 14494 µs
2019-05-15 13:22:34 UTC    4/25 peers    270 KiB chain   14 KiB db  0 bytes queue   15 KiB sync  RPC:  1 conn,    0 req/s, 14713 µs
2019-05-15 13:23:04 UTC    4/25 peers    270 KiB chain   14 KiB db  0 bytes queue   15 KiB sync  RPC:  1 conn,    0 req/s, 14929 µs
2019-05-15 13:23:39 UTC    5/25 peers    270 KiB chain   14 KiB db  0 bytes queue   15 KiB sync  RPC:  1 conn,    1 req/s, 15065 µs
2019-05-15 13:24:09 UTC    5/25 peers    270 KiB chain   14 KiB db  0 bytes queue   15 KiB sync  RPC:  1 conn,    0 req/s, 14976 µs
2019-05-15 13:24:39 UTC    6/25 peers    270 KiB chain   14 KiB db  0 bytes queue   15 KiB sync  RPC:  1 conn,    3 req/s, 14942 µs
2019-05-15 13:25:09 UTC    6/25 peers    270 KiB chain   14 KiB db  0 bytes queue   15 KiB sync  RPC:  1 conn,    0 req/s, 15065 µs
2019-05-15 13:25:39 UTC    7/25 peers    270 KiB chain   14 KiB db  0 bytes queue   15 KiB sync  RPC:  1 conn,    1 req/s, 15024 µs
2019-05-15 13:26:09 UTC    7/25 peers    270 KiB chain   14 KiB db  0 bytes queue   15 KiB sync  RPC:  1 conn,    0 req/s, 15024 µs
2019-05-15 13:26:39 UTC    7/25 peers    270 KiB chain   14 KiB db  0 bytes queue   15 KiB sync  RPC:  1 conn,    2 req/s, 15110 µs
2019-05-15 13:27:09 UTC    7/25 peers    270 KiB chain   14 KiB db  0 bytes queue   15 KiB sync  RPC:  1 conn,    2 req/s, 15161 µs
2019-05-15 13:27:39 UTC    8/25 peers    270 KiB chain   14 KiB db  0 bytes queue   15 KiB sync  RPC:  1 conn,    1 req/s, 15170 µs

@jam10o-new
Copy link
Contributor

@APshenkin it looks like you'll have to wait for more peers or bootnodes running up to date versions to come online.

@varasev I've passed on that our bootnodes appear to still be running the old chainspec. That's probably a mistake. (cc @gabreal?)

@varasev
Copy link
Contributor

varasev commented May 15, 2019

I've passed on that our bootnodes appear to still be running the old chainspec. That's probably a mistake.

Yes, they should have been updated as well, but seems they have an old spec.

Also, we had to restart our bootnode right after the fork, for that reason it's still in sync.

@varasev
Copy link
Contributor

varasev commented May 15, 2019

@APshenkin could you repeat once more? Now, our node is fully synchronized.

@APshenkin
Copy link
Author

@varasev currently no luck(

2019-05-15 14:02:20 UTC Stage 4 block verification failed for #10960441 (0xc204…f245)
Error: Error(Engine(NotProposer(Mismatch { expected: 0x00e6d2b931f55a3f1701c7389d592a7778897879, found: 0x00d6cc1ba9cf89bd2e58009741f4f7325badc0ed })), State { next_error: None, backtrace: InternalBacktrace { backtrace: Some(stack backtrace:
   0:     0x55967d56b19d - <no info>
   1:     0x55967d56a562 - <no info>
   2:     0x55967d2c3ec8 - <no info>
   3:     0x55967d2c41f5 - <no info>
   4:     0x55967cd8bf63 - <no info>
   5:     0x55967cd955b7 - <no info>
   6:     0x55967cb9a2ed - <no info>
   7:     0x55967cd64ee9 - <no info>
   8:     0x55967c5f42c0 - <no info>
   9:     0x55967cc257b9 - <no info>
  10:     0x55967cbefe88 - <no info>
  11:     0x55967cbf210c - <no info>
  12:     0x55967cc1ff9a - <no info>
  13:     0x55967cd0eddd - <no info>
  14:     0x55967d5e3ed9 - <no info>
  15:     0x55967cc71b4e - <no info>
  16:     0x55967d5e321d - <no info>
  17:     0x7f11cccd46b9 - <no info>
  18:     0x7f11cc7f441c - <no info>
  19:                0x0 - <no info>) } })
2019-05-15 14:02:20 UTC
Bad block detected: Error(Engine(NotProposer(Mismatch { expected: 0x00e6d2b931f55a3f1701c7389d592a7778897879, found: 0x00d6cc1ba9cf89bd2e58009741f4f7325badc0ed })), State { next_error: None, backtrace: InternalBacktrace { backtrace: Some(stack backtrace:
   0:     0x55967d56b19d - <no info>
   1:     0x55967d56a562 - <no info>
   2:     0x55967d2c3ec8 - <no info>
   3:     0x55967d2c41f5 - <no info>
   4:     0x55967cd8bf63 - <no info>
   5:     0x55967cd955b7 - <no info>
   6:     0x55967cb9a2ed - <no info>
   7:     0x55967cd64ee9 - <no info>
   8:     0x55967c5f42c0 - <no info>
   9:     0x55967cc257b9 - <no info>
  10:     0x55967cbefe88 - <no info>
  11:     0x55967cbf210c - <no info>
  12:     0x55967cc1ff9a - <no info>
  13:     0x55967cd0eddd - <no info>
  14:     0x55967d5e3ed9 - <no info>
  15:     0x55967cc71b4e - <no info>
  16:     0x55967d5e321d - <no info>
  17:     0x7f11cccd46b9 - <no info>
  18:     0x7f11cc7f441c - <no info>
  19:                0x0 - <no info>) } })
RLP: f902f6f90246a0159c1fecf41d5356618ec2286d92dbb5b3b53c5aec7902509566b14a89903752a01dcc4de8dec75d7aab85b567b6ccd41ad312451b948a7413f0a142fd40d493479400d6cc1ba9cf89bd2e58009741f4f7325badc0eda0380bc8466f8add1fc935f865f1dd3d5c5e61a81e12c4a24e9d063ec6a692c08ba0d7e3c695873522c7497e60b38f74a132a89fa3a24e4c2a0536ba453412a1587ca0dc7f95c926a4a85e02a1a05490518ef4ef1088f69018e3509f2fc21d8195a887b901000000000000000000000000000400000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000020000000000000000000000000000000000000001000000000000000000000000000000000000000000000000000080000000000000000000040000000000000000000000000040000000000800000000000000000000000000000000000000000000002000000000000000000000000000000000000800000000000000000000000000000000000000000000000000000000000000001000000000000000000000000001020000000000000000000000000000000000000000000000000000000000090fffffffffffffffffffffffffffffffd83a73e39837a120082b12b845cdbfa009fde830204068f5061726974792d457468657265756d86312e33342e31827769841736fe80b8419d047d9284b516c58e1afd154d77d9830475963b9eafcd12c16fb1edc026664d248dd24e7bd0e7c98d89ec086b0efdbcbcaa93f3e3fece06f669bc19a7dfe8bc01f8aaf8a8228471489bb382e651945a7353e9ad230dc2ac685f4dab091fd2b2d2a77e80b844095ea7b300000000000000000000000083096801cfb66db85024520ca5b3af136311a34600000000000000000000000000000000000000000000000000000000000003e81ca0619bece788d97020b1566ecedf358bf2af26c001ed20616de5015ab5f26cf87fa020de68e31bf592e742122330e617b896d7b82c95401afe1d15df8fc81cdb7ad0c0
Header: Header { parent_hash: 0x159c1fecf41d5356618ec2286d92dbb5b3b53c5aec7902509566b14a89903752, timestamp: 1557920256, number: 10960441, author: 0x00d6cc1ba9cf89bd2e58009741f4f7325badc0ed, transactions_root: 0xd7e3c695873522c7497e60b38f74a132a89fa3a24e4c2a0536ba453412a1587c, uncles_hash: 0x1dcc4de8dec75d7aab85b567b6ccd41ad312451b948a7413f0a142fd40d49347, extra_data: [222, 131, 2, 4, 6, 143, 80, 97, 114, 105, 116, 121, 45, 69, 116, 104, 101, 114, 101, 117, 109, 134, 49, 46, 51, 52, 46, 49, 130, 119, 105], state_root: 0x380bc8466f8add1fc935f865f1dd3d5c5e61a81e12c4a24e9d063ec6a692c08b, receipts_root: 0xdc7f95c926a4a85e02a1a05490518ef4ef1088f69018e3509f2fc21d8195a887, log_bloom: 0x00000000000000000000000004000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000200000000000000000000000000000000000000010000000000000000000000000000000000000000000000000000800000000000000000000400000000000000000000000000400000000008000000000000000000000000000000000000000000000020000000000000000000000000000000000008000000000000000000000000000000000000000000000000000000000000000010000000000000000000000000010200000000000000000000000000000000000000000000000000000000000, gas_used: 45355, gas_limit: 8000000, difficulty: 340282366920938463463374607431768211453, seal: [[132, 23, 54, 254, 128], [184, 65, 157, 4, 125, 146, 132, 181, 22, 197, 142, 26, 253, 21, 77, 119, 217, 131, 4, 117, 150, 59, 158, 175, 205, 18, 193, 111, 177, 237, 192, 38, 102, 77, 36, 141, 210, 78, 123, 208, 231, 201, 141, 137, 236, 8, 107, 14, 253, 188, 188, 170, 147, 243, 227, 254, 206, 6, 246, 105, 188, 25, 167, 223, 232, 188, 1]], hash: Some(0xc204c637aaeae7fd2fa9034dacaf35d5f290bf5ba35fb8adcf49a7748e7ef245) }
Uncles:
Transactions:[Tx 0] UnverifiedTransaction { unsigned: Transaction { nonce: 34, gas_price: 1900583859, gas: 58961, action: Call(0x5a7353e9ad230dc2ac685f4dab091fd2b2d2a77e), value: 0, data: [9, 94, 167, 179, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 131, 9, 104, 1, 207, 182, 109, 184, 80, 36, 82, 12, 165, 179, 175, 19, 99, 17, 163, 70, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 3, 232] }, v: 28, r: 44149842661914932399584453173009786420610147425525440546403923820432287660159, s: 14866975107517740504714974888260480849283556163795478444115221606568434563792, hash: 0x19b18ab00b67672f28314f4de43fc43a8bc8cf9d1fcc298ecaf48fb9532091c1 }
2019-05-15 14:02:24 UTC    3/25 peers    270 KiB chain   14 KiB db  0 bytes queue  261 KiB sync  RPC:  1 conn,    1 req/s,   23 µs
2019-05-15 14:02:54 UTC    3/25 peers    270 KiB chain   14 KiB db  0 bytes queue  261 KiB sync  RPC:  1 conn,    2 req/s,  126 µs
2019-05-15 14:03:24 UTC    3/25 peers    270 KiB chain   14 KiB db  0 bytes queue  261 KiB sync  RPC:  1 conn,    1 req/s, 15872 µs

@jam10o-new
Copy link
Contributor

jam10o-new commented May 15, 2019

@APshenkin a resync might be unavoidable unfortunately, I understand that might be frustrating with a fat-db archive node. You might be able to rewind with parity --chain=kovan db reset [number of blocks] in order to remove the bad chain head and try to continue sync.

*edit: you don't need to be in beta to try a reset. It was added in 2.3

@varasev
Copy link
Contributor

varasev commented May 15, 2019

@APshenkin also try with the following CLI-flags: --reserved-only --reserved-peers=./reserved_peers

where the reserved_peers file should contain this line: https://github.com/paritytech/parity-ethereum/blob/e04a2f926acd7ced096eb8a40c01821731ebd777/ethcore/res/ethereum/kovan.json#L5384

@APshenkin
Copy link
Author

APshenkin commented May 15, 2019

@joshua-mir
I tried to reset to block 10960430.

Now I recieve other error

2019-05-15 14:51:05 UTC Starting Parity-Ethereum/v2.4.6-stable-94164e1-20190514/x86_64-linux-gnu/rustc1.34.1
2019-05-15 14:51:05 UTC Keys path /home/parity/.local/share/io.parity.ethereum//keys/kovan
2019-05-15 14:51:05 UTC DB path /home/parity/.local/share/io.parity.ethereum//chains/kovan/db/9bf388941c25ea98
2019-05-15 14:51:05 UTC State DB configuration: archive +Fat +Trace
2019-05-15 14:51:05 UTC Operating mode: active
2019-05-15 14:51:05 UTC Warning: Warp Sync is disabled because Fat DB is turned on.
2019-05-15 14:51:05 UTC Configured for Kovan Testnet using AuthorityRound engine
2019-05-15 14:51:06 UTC Listening for new connections on 0.0.0.0:8546.
2019-05-15 14:51:06 UTC Accepted a new tcp connection from 10.136.10.94:49042.
2019-05-15 14:51:08 UTC Block import failed for #10960441 (0xc204…f245): Parent not found (0x159c…3752)
2019-05-15 14:51:08 UTC
Bad block detected: Error(Msg("Parent not found"), State { next_error: None, backtrace: InternalBacktrace { backtrace: Some(stack backtrace:
   0:     0x55dee283119d - <no info>
   1:     0x55dee2830562 - <no info>
   2:     0x55dee2589ec8 - <no info>
   3:     0x55dee258a1f5 - <no info>
   4:     0x55dee205f753 - <no info>
   5:     0x55dee202a948 - <no info>
   6:     0x55dee18ba2c0 - <no info>
   7:     0x55dee1eeb7b9 - <no info>
   8:     0x55dee1eb5e88 - <no info>
   9:     0x55dee1eb810c - <no info>
  10:     0x55dee1ee5f9a - <no info>
  11:     0x55dee1fd4ddd - <no info>
  12:     0x55dee28a9ed9 - <no info>
  13:     0x55dee1f37b4e - <no info>
  14:     0x55dee28a921d - <no info>
  15:     0x7f0ec7cac6b9 - <no info>
  16:     0x7f0ec77cc41c - <no info>
  17:                0x0 - <no info>) } })
RLP: f902f6f90246a0159c1fecf41d5356618ec2286d92dbb5b3b53c5aec7902509566b14a89903752a01dcc4de8dec75d7aab85b567b6ccd41ad312451b948a7413f0a142fd40d493479400d6cc1ba9cf89bd2e58009741f4f7325badc0eda0380bc8466f8add1fc935f865f1dd3d5c5e61a81e12c4a24e9d063ec6a692c08ba0d7e3c695873522c7497e60b38f74a132a89fa3a24e4c2a0536ba453412a1587ca0dc7f95c926a4a85e02a1a05490518ef4ef1088f69018e3509f2fc21d8195a887b901000000000000000000000000000400000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000020000000000000000000000000000000000000001000000000000000000000000000000000000000000000000000080000000000000000000040000000000000000000000000040000000000800000000000000000000000000000000000000000000002000000000000000000000000000000000000800000000000000000000000000000000000000000000000000000000000000001000000000000000000000000001020000000000000000000000000000000000000000000000000000000000090fffffffffffffffffffffffffffffffd83a73e39837a120082b12b845cdbfa009fde830204068f5061726974792d457468657265756d86312e33342e31827769841736fe80b8419d047d9284b516c58e1afd154d77d9830475963b9eafcd12c16fb1edc026664d248dd24e7bd0e7c98d89ec086b0efdbcbcaa93f3e3fece06f669bc19a7dfe8bc01f8aaf8a8228471489bb382e651945a7353e9ad230dc2ac685f4dab091fd2b2d2a77e80b844095ea7b300000000000000000000000083096801cfb66db85024520ca5b3af136311a34600000000000000000000000000000000000000000000000000000000000003e81ca0619bece788d97020b1566ecedf358bf2af26c001ed20616de5015ab5f26cf87fa020de68e31bf592e742122330e617b896d7b82c95401afe1d15df8fc81cdb7ad0c0
Header: Header { parent_hash: 0x159c1fecf41d5356618ec2286d92dbb5b3b53c5aec7902509566b14a89903752, timestamp: 1557920256, number: 10960441, author: 0x00d6cc1ba9cf89bd2e58009741f4f7325badc0ed, transactions_root: 0xd7e3c695873522c7497e60b38f74a132a89fa3a24e4c2a0536ba453412a1587c, uncles_hash: 0x1dcc4de8dec75d7aab85b567b6ccd41ad312451b948a7413f0a142fd40d49347, extra_data: [222, 131, 2, 4, 6, 143, 80, 97, 114, 105, 116, 121, 45, 69, 116, 104, 101, 114, 101, 117, 109, 134, 49, 46, 51, 52, 46, 49, 130, 119, 105], state_root: 0x380bc8466f8add1fc935f865f1dd3d5c5e61a81e12c4a24e9d063ec6a692c08b, receipts_root: 0xdc7f95c926a4a85e02a1a05490518ef4ef1088f69018e3509f2fc21d8195a887, log_bloom: 0x00000000000000000000000004000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000200000000000000000000000000000000000000010000000000000000000000000000000000000000000000000000800000000000000000000400000000000000000000000000400000000008000000000000000000000000000000000000000000000020000000000000000000000000000000000008000000000000000000000000000000000000000000000000000000000000000010000000000000000000000000010200000000000000000000000000000000000000000000000000000000000, gas_used: 45355, gas_limit: 8000000, difficulty: 340282366920938463463374607431768211453, seal: [[132, 23, 54, 254, 128], [184, 65, 157, 4, 125, 146, 132, 181, 22, 197, 142, 26, 253, 21, 77, 119, 217, 131, 4, 117, 150, 59, 158, 175, 205, 18, 193, 111, 177, 237, 192, 38, 102, 77, 36, 141, 210, 78, 123, 208, 231, 201, 141, 137, 236, 8, 107, 14, 253, 188, 188, 170, 147, 243, 227, 254, 206, 6, 246, 105, 188, 25, 167, 223, 232, 188, 1]], hash: Some(0xc204c637aaeae7fd2fa9034dacaf35d5f290bf5ba35fb8adcf49a7748e7ef245) }
Uncles:
Transactions:[Tx 0] UnverifiedTransaction { unsigned: Transaction { nonce: 34, gas_price: 1900583859, gas: 58961, action: Call(0x5a7353e9ad230dc2ac685f4dab091fd2b2d2a77e), value: 0, data: [9, 94, 167, 179, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 131, 9, 104, 1, 207, 182, 109, 184, 80, 36, 82, 12, 165, 179, 175, 19, 99, 17, 163, 70, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 3, 232] }, v: 28, r: 44149842661914932399584453173009786420610147425525440546403923820432287660159, s: 14866975107517740504714974888260480849283556163795478444115221606568434563792, hash: 0x19b18ab00b67672f28314f4de43fc43a8bc8cf9d1fcc298ecaf48fb9532091c1 }
2019-05-15 14:51:11 UTC Public node URL: enode://1d3357c77f61f782d98a3d52daca8e6588df427ad898b56c597b1adbdcfae19c1275b3672e4af88e5c56a05bab68783fe4e8b5b000f3f1e6437661221d136920@172.18.0.2:30303

@jam10o-new
Copy link
Contributor

Generally speaking you should be able to ignore bad block detections - I would try adding an up to date node to your reserved peers as recommended above..

@APshenkin
Copy link
Author

APshenkin commented May 15, 2019

@joshua-mir

Looks like that after db reset there is other issue (not a problem with bad blocks)

before reset blocknumber was 10960440

The new block after hardfork is 10960441 that alerts on startup.

I run this command: parity --chain=kovan reset db 10

and it successfuly reset to block 10960430

Now when launching (with reserved peers also) parity node takes 10960441 block on startup (I don't know from where, maybe some cache) and try to insert it. But there is no 10960440 block more.

Also when running with reserved peers after some time parity starts prints logs about syncing, but it's stuck on 10960430 block

2019-05-15 15:28:18 UTC Starting Parity-Ethereum/v2.4.6-stable-94164e1-20190514/x86_64-linux-gnu/rustc1.34.1
2019-05-15 15:28:18 UTC Keys path /home/parity/.local/share/io.parity.ethereum//keys/kovan
2019-05-15 15:28:18 UTC DB path /home/parity/.local/share/io.parity.ethereum//chains/kovan/db/9bf388941c25ea98
2019-05-15 15:28:18 UTC State DB configuration: archive +Fat +Trace
2019-05-15 15:28:18 UTC Operating mode: active
2019-05-15 15:28:18 UTC Warning: Warp Sync is disabled because Fat DB is turned on.
2019-05-15 15:28:18 UTC Configured for Kovan Testnet using AuthorityRound engine
2019-05-15 15:28:18 UTC Listening for new connections on 0.0.0.0:8546.
2019-05-15 15:28:19 UTC Accepted a new tcp connection from 10.136.10.94:60979.
2019-05-15 15:28:20 UTC Block import failed for #10960441 (0xc204…f245): Parent not found (0x159c…3752)
2019-05-15 15:28:20 UTC
Bad block detected: Error(Msg("Parent not found"), State { next_error: None, backtrace: InternalBacktrace { backtrace: Some(stack backtrace:
   0:     0x55dcab40919d - <no info>
   1:     0x55dcab408562 - <no info>
   2:     0x55dcab161ec8 - <no info>
   3:     0x55dcab1621f5 - <no info>
   4:     0x55dcaac37753 - <no info>
   5:     0x55dcaac02948 - <no info>
   6:     0x55dcaa4922c0 - <no info>
   7:     0x55dcaaac37b9 - <no info>
   8:     0x55dcaaa8de88 - <no info>
   9:     0x55dcaaa9010c - <no info>
  10:     0x55dcaaabdf9a - <no info>
  11:     0x55dcaabacddd - <no info>
  12:     0x55dcab481ed9 - <no info>
  13:     0x55dcaab0fb4e - <no info>
  14:     0x55dcab48121d - <no info>
  15:     0x7efc6ee866b9 - <no info>
  16:     0x7efc6e9a641c - <no info>
  17:                0x0 - <no info>) } })
RLP: f902f6f90246a0159c1fecf41d5356618ec2286d92dbb5b3b53c5aec7902509566b14a89903752a01dcc4de8dec75d7aab85b567b6ccd41ad312451b948a7413f0a142fd40d493479400d6cc1ba9cf89bd2e58009741f4f7325badc0eda0380bc8466f8add1fc935f865f1dd3d5c5e61a81e12c4a24e9d063ec6a692c08ba0d7e3c695873522c7497e60b38f74a132a89fa3a24e4c2a0536ba453412a1587ca0dc7f95c926a4a85e02a1a05490518ef4ef1088f69018e3509f2fc21d8195a887b901000000000000000000000000000400000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000020000000000000000000000000000000000000001000000000000000000000000000000000000000000000000000080000000000000000000040000000000000000000000000040000000000800000000000000000000000000000000000000000000002000000000000000000000000000000000000800000000000000000000000000000000000000000000000000000000000000001000000000000000000000000001020000000000000000000000000000000000000000000000000000000000090fffffffffffffffffffffffffffffffd83a73e39837a120082b12b845cdbfa009fde830204068f5061726974792d457468657265756d86312e33342e31827769841736fe80b8419d047d9284b516c58e1afd154d77d9830475963b9eafcd12c16fb1edc026664d248dd24e7bd0e7c98d89ec086b0efdbcbcaa93f3e3fece06f669bc19a7dfe8bc01f8aaf8a8228471489bb382e651945a7353e9ad230dc2ac685f4dab091fd2b2d2a77e80b844095ea7b300000000000000000000000083096801cfb66db85024520ca5b3af136311a34600000000000000000000000000000000000000000000000000000000000003e81ca0619bece788d97020b1566ecedf358bf2af26c001ed20616de5015ab5f26cf87fa020de68e31bf592e742122330e617b896d7b82c95401afe1d15df8fc81cdb7ad0c0
Header: Header { parent_hash: 0x159c1fecf41d5356618ec2286d92dbb5b3b53c5aec7902509566b14a89903752, timestamp: 1557920256, number: 10960441, author: 0x00d6cc1ba9cf89bd2e58009741f4f7325badc0ed, transactions_root: 0xd7e3c695873522c7497e60b38f74a132a89fa3a24e4c2a0536ba453412a1587c, uncles_hash: 0x1dcc4de8dec75d7aab85b567b6ccd41ad312451b948a7413f0a142fd40d49347, extra_data: [222, 131, 2, 4, 6, 143, 80, 97, 114, 105, 116, 121, 45, 69, 116, 104, 101, 114, 101, 117, 109, 134, 49, 46, 51, 52, 46, 49, 130, 119, 105], state_root: 0x380bc8466f8add1fc935f865f1dd3d5c5e61a81e12c4a24e9d063ec6a692c08b, receipts_root: 0xdc7f95c926a4a85e02a1a05490518ef4ef1088f69018e3509f2fc21d8195a887, log_bloom: 0x00000000000000000000000004000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000200000000000000000000000000000000000000010000000000000000000000000000000000000000000000000000800000000000000000000400000000000000000000000000400000000008000000000000000000000000000000000000000000000020000000000000000000000000000000000008000000000000000000000000000000000000000000000000000000000000000010000000000000000000000000010200000000000000000000000000000000000000000000000000000000000, gas_used: 45355, gas_limit: 8000000, difficulty: 340282366920938463463374607431768211453, seal: [[132, 23, 54, 254, 128], [184, 65, 157, 4, 125, 146, 132, 181, 22, 197, 142, 26, 253, 21, 77, 119, 217, 131, 4, 117, 150, 59, 158, 175, 205, 18, 193, 111, 177, 237, 192, 38, 102, 77, 36, 141, 210, 78, 123, 208, 231, 201, 141, 137, 236, 8, 107, 14, 253, 188, 188, 170, 147, 243, 227, 254, 206, 6, 246, 105, 188, 25, 167, 223, 232, 188, 1]], hash: Some(0xc204c637aaeae7fd2fa9034dacaf35d5f290bf5ba35fb8adcf49a7748e7ef245) }
Uncles:
Transactions:[Tx 0] UnverifiedTransaction { unsigned: Transaction { nonce: 34, gas_price: 1900583859, gas: 58961, action: Call(0x5a7353e9ad230dc2ac685f4dab091fd2b2d2a77e), value: 0, data: [9, 94, 167, 179, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 131, 9, 104, 1, 207, 182, 109, 184, 80, 36, 82, 12, 165, 179, 175, 19, 99, 17, 163, 70, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 3, 232] }, v: 28, r: 44149842661914932399584453173009786420610147425525440546403923820432287660159, s: 14866975107517740504714974888260480849283556163795478444115221606568434563792, hash: 0x19b18ab00b67672f28314f4de43fc43a8bc8cf9d1fcc298ecaf48fb9532091c1 }
2019-05-15 15:28:23 UTC Public node URL: enode://1d3357c77f61f782d98a3d52daca8e6588df427ad898b56c597b1adbdcfae19c1275b3672e4af88e5c56a05bab68783fe4e8b5b000f3f1e6437661221d136920@172.18.0.2:30303
2019-05-15 15:28:53 UTC    1/25 peers    291 KiB chain    7 KiB db  0 bytes queue  260 KiB sync  RPC:  1 conn,    1 req/s,   20 µs
2019-05-15 15:29:18 UTC Syncing #10960430 0x7a5c…041a     0.00 blk/s    0.0 tx/s    0.0 Mgas/s      0+    0 Qed  #10960541    1/25 peers    291 KiB chain    7 KiB db  0 bytes queue  261 KiB sync  RPC:  1 conn,    1 req/s,   58 µs
2019-05-15 15:29:23 UTC Syncing #10960430 0x7a5c…041a     0.00 blk/s    0.0 tx/s    0.0 Mgas/s      0+    0 Qed  #10960541    1/25 peers    291 KiB chain    7 KiB db  0 bytes queue  261 KiB sync  RPC:  1 conn,    1 req/s,   59 µs
2019-05-15 15:29:38 UTC Syncing #10960430 0x7a5c…041a     0.00 blk/s    0.0 tx/s    0.0 Mgas/s      0+    0 Qed  #10960541    1/25 peers    291 KiB chain    7 KiB db  0 bytes queue  261 KiB sync  RPC:  1 conn,    1 req/s,   62 µs
2019-05-15 15:29:43 UTC Syncing #10960430 0x7a5c…041a     0.00 blk/s    0.0 tx/s    0.0 Mgas/s      0+    0 Qed  #10960541    1/25 peers    291 KiB chain    7 KiB db  0 bytes queue  261 KiB sync  RPC:  1 conn,    1 req/s,   62 µs
2019-05-15 15:29:58 UTC Syncing #10960430 0x7a5c…041a     0.00 blk/s    0.0 tx/s    0.0 Mgas/s      0+    0 Qed  #10960541    1/25 peers    291 KiB chain    7 KiB db  0 bytes queue  261 KiB sync  RPC:  1 conn,    1 req/s,   62 µs
2019-05-15 15:30:03 UTC Syncing #10960430 0x7a5c…041a     0.00 blk/s    0.0 tx/s    0.0 Mgas/s      0+    0 Qed  #10960541    1/25 peers    291 KiB chain    7 KiB db  0 bytes queue  261 KiB sync  RPC:  1 conn,    1 req/s,   62 µs
2019-05-15 15:30:18 UTC Syncing #10960430 0x7a5c…041a     0.00 blk/s    0.0 tx/s    0.0 Mgas/s      0+    0 Qed  #10960541    1/25 peers    291 KiB chain    7 KiB db  0 bytes queue  261 KiB sync  RPC:  1 conn,    1 req/s,   62 µs
2019-05-15 15:30:48 UTC    1/25 peers    291 KiB chain    7 KiB db  0 bytes queue  260 KiB sync  RPC:  1 conn,    0 req/s,   63 µs
2019-05-15 15:31:18 UTC    1/25 peers    291 KiB chain    7 KiB db  0 bytes queue  261 KiB sync  RPC:  1 conn,    1 req/s,   61 µs
2019-05-15 15:31:33 UTC Syncing #10960430 0x7a5c…041a     0.00 blk/s    0.0 tx/s    0.0 Mgas/s      0+    0 Qed  #10960541    1/25 peers    291 KiB chain    7 KiB db  0 bytes queue  261 KiB sync  RPC:  1 conn,    1 req/s,   61 µs
2019-05-15 15:31:38 UTC Syncing #10960430 0x7a5c…041a     0.00 blk/s    0.0 tx/s    0.0 Mgas/s      0+    0 Qed  #10960541    1/25 peers    291 KiB chain    7 KiB db  0 bytes queue  261 KiB sync  RPC:  1 conn,    1 req/s,   61 µs
2019-05-15 15:31:43 UTC Syncing #10960430 0x7a5c…041a     0.00 blk/s    0.0 tx/s    0.0 Mgas/s      0+    0 Qed  #10960541    1/25 peers    291 KiB chain    7 KiB db  0 bytes queue  261 KiB sync  RPC:  1 conn,    1 req/s,   61 µs
2019-05-15 15:31:58 UTC Syncing #10960430 0x7a5c…041a     0.00 blk/s    0.0 tx/s    0.0 Mgas/s      0+    0 Qed  #10960541    1/25 peers    291 KiB chain    7 KiB db  0 bytes queue  261 KiB sync  RPC:  1 conn,    1 req/s,   61 µs
2019-05-15 15:32:03 UTC Syncing #10960430 0x7a5c…041a     0.00 blk/s    0.0 tx/s    0.0 Mgas/s      0+    0 Qed  #10960541    1/25 peers    291 KiB chain    7 KiB db  0 bytes queue  261 KiB sync  RPC:  1 conn,    1 req/s,   61 µs
2019-05-15 15:32:13 UTC Syncing #10960430 0x7a5c…041a     0.00 blk/s    0.0 tx/s    0.0 Mgas/s      0+    0 Qed  #10960541    1/25 peers    291 KiB chain    7 KiB db  0 bytes queue  261 KiB sync  RPC:  1 conn,    1 req/s,   61 µs
2019-05-15 15:32:18 UTC Syncing #10960430 0x7a5c…041a     0.00 blk/s    0.0 tx/s    0.0 Mgas/s      0+    0 Qed  #10960541    1/25 peers    291 KiB chain    7 KiB db  0 bytes queue  261 KiB sync  RPC:  1 conn,    1 req/s,   61 µs
2019-05-15 15:32:23 UTC Syncing #10960430 0x7a5c…041a     0.00 blk/s    0.0 tx/s    0.0 Mgas/s      0+    0 Qed  #10960541    1/25 peers    291 KiB chain    7 KiB db  0 bytes queue  261 KiB sync  RPC:  1 conn,    1 req/s,   61 µs
2019-05-15 15:32:38 UTC Syncing #10960430 0x7a5c…041a     0.00 blk/s    0.0 tx/s    0.0 Mgas/s      0+    0 Qed  #10960541    1/25 peers    291 KiB chain    7 KiB db  0 bytes queue  261 KiB sync  RPC:  1 conn,    1 req/s,   61 µs
2019-05-15 15:32:43 UTC Syncing #10960430 0x7a5c…041a     0.00 blk/s    0.0 tx/s    0.0 Mgas/s      0+    0 Qed  #10960541    1/25 peers    291 KiB chain    7 KiB db  0 bytes queue  261 KiB sync  RPC:  1 conn,    1 req/s,   61 µs
2019-05-15 15:33:13 UTC    1/25 peers    291 KiB chain    7 KiB db  0 bytes queue  260 KiB sync  RPC:  1 conn,    1 req/s,   60 µs
l2019-05-15 15:33:43 UTC    1/25 peers    291 KiB chain    7 KiB db  0 bytes queue  261 KiB sync  RPC:  1 conn,    1 req/s,   60 µs
2019-05-15 15:33:58 UTC Syncing #10960430 0x7a5c…041a     0.00 blk/s    0.0 tx/s    0.0 Mgas/s      0+    0 Qed  #10960541    1/25 peers    291 KiB chain    7 KiB db  0 bytes queue  261 KiB sync  RPC:  1 conn,    1 req/s,   62 µs
2019-05-15 15:34:03 UTC Syncing #10960430 0x7a5c…041a     0.00 blk/s    0.0 tx/s    0.0 Mgas/s      0+    0 Qed  #10960541    1/25 peers    291 KiB chain    7 KiB db  0 bytes queue  261 KiB sync  RPC:  1 conn,    1 req/s,   62 µs

@jam10o-new
Copy link
Contributor

@seunlanlege any ideas?

@jam10o-new
Copy link
Contributor

@APshenkin it was either a reset or resync, unfortunately.

@APshenkin
Copy link
Author

@joshua-mir

So, after several hours syncing wasn't started after block reset

Looks like block reset feature is not working as expected, or I don't understand why it can't start sync.

Currently I had removed --reserved-only --reserved-peers=./reserved_peers CLI flags and have only 2 peers and no sync blocks info

2019-05-15 16:55:54 UTC    1/25 peers     12 MiB chain   14 KiB db  0 bytes queue  536 KiB sync  RPC:  1 conn,    1 req/s,   19 µs
2019-05-15 16:56:24 UTC    0/25 peers     16 MiB chain   14 KiB db  0 bytes queue  536 KiB sync  RPC:  1 conn,    1 req/s,   18 µs
2019-05-15 16:56:54 UTC    0/25 peers     16 MiB chain   14 KiB db  0 bytes queue  536 KiB sync  RPC:  1 conn,    1 req/s,   18 µs
2019-05-15 16:57:24 UTC    0/25 peers     16 MiB chain   14 KiB db  0 bytes queue  536 KiB sync  RPC:  1 conn,    1 req/s,   19 µs
2019-05-15 16:57:54 UTC    1/25 peers     16 MiB chain   14 KiB db  0 bytes queue  536 KiB sync  RPC:  1 conn,    1 req/s,   19 µs
2019-05-15 16:58:24 UTC    1/25 peers     16 MiB chain   14 KiB db  0 bytes queue  536 KiB sync  RPC:  1 conn,    1 req/s,   19 µs
2019-05-15 16:58:54 UTC    2/25 peers     16 MiB chain   14 KiB db  0 bytes queue  536 KiB sync  RPC:  1 conn,    1 req/s, 10691 µs
2019-05-15 16:59:24 UTC    2/25 peers     16 MiB chain   14 KiB db  0 bytes queue  536 KiB sync  RPC:  1 conn,    1 req/s, 10893 µs
2019-05-15 16:59:54 UTC    2/25 peers     16 MiB chain   14 KiB db  0 bytes queue  536 KiB sync  RPC:  1 conn,    1 req/s, 11777 µs

maybe I can provide any detailed logs to help you to fix it?

It's not a problem to resync arhive node for kovan (it's not so big)

But if somebody will faced similar issues in live network then resync will be painable for them (1-2 month to sync again)

@jam10o-new
Copy link
Contributor

Pinged Seun above, who implemented the feature and might have a better idea about what's going on.

@seunlanlege
Copy link
Member

hey @APshenkin, the error your facing is a known issue #9910 that plagues the way blocks are imported. For now, I would advise a resync.

@stephgosling
Copy link

we saw the same, 2.5.0 instances on kovan panicked in that way, upgrading to 2.5.1 and retaining data they also wouldn't proceed past 10960440. Deleting the chain data and restarting our instances all successfully resynced. This was annoying for us as this appeared to side-step our check for their uptodateness

@rakita
Copy link

rakita commented Jul 27, 2020

Closing the issue due to its stale state

@rakita rakita reopened this Jul 27, 2020
@rakita rakita closed this as completed Jul 27, 2020
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
Z1-question 🙋‍♀️ Issue is a question. Closer should answer.
Projects
None yet
Development

Successfully merging a pull request may close this issue.

6 participants