Unable to retrieve proof-of-stake genesis block data #12497

Fueav · 2023-06-06T12:28:39Z

🐞 Bug Report

Description

I'm building my devnet creation node to block normally, and other nodes have encountered problems when joining.

Has this worked before in a previous version?

Yes, the previous version in which this bug was not present was: ....

🔬 Minimal Reproduction

🔥 Error



[root@1-centos ~]# curl http://localhost:3500/eth/v1/node/syncing | jq
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100   106  100   106    0     0   103k      0 --:--:-- --:--:-- --:--:--  103k
{
  "data": {
    "head_slot": "612",
    "sync_distance": "0",
    "is_syncing": false,
    "is_optimistic": true,
    "el_offline": true
  }
}



connectionErrors":[]}[root@1-centos ~]# curl http://localhost:3500/eth/v1alpha1/node/eth1/connections |jq
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100   258  100   258    0     0  86000      0 --:--:-- --:--:-- --:--:-- 86000
{
  "currentAddress": "http://127.0.0.1:8551",
  "currentConnectionError": "retryExecutionClientConnection: HeaderByHash, hash=0x9c1fb1381fbf30135583b2f618c80cb1076b91ea173acf5f2fbf4e976420a4ef: not found",
  "addresses": [
    "http://127.0.0.1:8551"
  ],
  "connectionErrors": []
}

🌍 Your Environment

Operating System:

  
CentOS Linux release 8.5.2111

What version of Prysm are you running? (Which release)

  
prysm v4.0.5

Anything else relevant (validator index / public key)?

The text was updated successfully, but these errors were encountered:

aaroua5 · 2023-06-06T13:14:52Z

I have the same issue, this happens to me when the timestamp in the genesis file of geth and the timestamp of the genesis state of prysm are not equal.

nisdas · 2023-06-06T23:16:55Z

@Fueav @aaroua5
https://github.com/OffchainLabs/eth-pos-devnet/tree/a293e5c52ec63a4e18fc691ee3013a9fb18e8694

You can try our latest devnet instructions, this should fix this issue

Fueav · 2023-06-07T03:19:19Z

@nisdas I updated the beacon-chain startup command, but the problem was not solved.
my genesis node Normal block production，But after I added the second node

seconde node beacon-chain log:

and his status

seconde node validator log :

This appears to be because the beacon-chain node is not ready, and the beacon-chain thinks there is a problem with its connection to the execution node, making it unable to query for the genesis block.

As for the error logs of the genesis node, it seems to be a network issue that caused a delay in the synchronization of p2p information. However, I am sure that I have synchronized the time according to timedatectl.

nisdas · 2023-06-07T03:22:56Z

@Fueav It means your node is syncing, you will have to wait for it to be fully synced

Fueav · 2023-06-07T03:24:29Z

I don't think so, because I noticed that the sync_distance is 0.

Fueav · 2023-06-07T03:30:13Z

@nisdas

nisdas · 2023-06-07T03:32:46Z

No, the logs in indicate your execution client is still syncing. So wait for that to finish syncing first. If is_Optimistic is false, then the EL has finished syncing

Fueav · 2023-06-07T03:40:20Z

@nisdas In fact, I once maintained this state for more than 12 hours. The situation did not improve and there were not many blocks in the devnet, which quickly caught up with the footsteps of the genesis node.

nisdas · 2023-06-07T03:42:17Z

Maybe you should look at your execution logs in that case @Fueav , it would indicate what the issue is

Fueav · 2023-06-07T03:44:33Z

@nisdas geth seems to be synchronizing blocks through fork choice, the only thing worth noting is this warning log.

nisdas · 2023-06-07T03:55:09Z

Looks like it has no peers @Fueav , it maybe better to do a full sync. --syncmode=full

Fueav · 2023-06-07T03:58:35Z

it's my geth.service

Beacon-chain p2p connection is configured and working properly.

Does that mean geth also needs to configure the boot node?

Fueav · 2023-06-07T03:59:16Z

@nisdas geth is already --syncmode=full

nisdas · 2023-06-07T04:02:53Z

You can give that a try, our devnet instructions are only for 1 node currently. If you need to add multiple nodes, then you will have to configure a geth/execution bootnode.

Fueav · 2023-06-07T05:48:09Z

I tried, but it didn't work.v4.0.3 running normally, and I'm ready to revert back to this version.

icemagno · 2023-08-17T23:45:40Z

Any progress?
I've seen Prysm is having many trouble to work with multinode private blockchain...

Many... many issues mainly involving sync

{
"data": {
    "head_slot": "0",
    "sync_distance": "79",
    "is_syncing": false,
    "is_optimistic": false,
    "el_offline": true
    }
}

and

time="2023-08-17 23:44:21" level=debug msg="aggregated unaggregated attestations" Duration=176.277µs prefix="pool/attestations"
time="2023-08-17 23:44:33" level=debug msg="aggregated unaggregated attestations" Duration=197.33µs prefix="pool/attestations"
time="2023-08-17 23:44:43" level=error msg="Unable to retrieve proof-of-stake genesis block data" error="HeaderByHash, hash=0xb3920fe1b2f6cc9ccbc7c8ab054cde560057d730ad4071251ceb6f903f1db533: not found" prefix=powchain
time="2023-08-17 23:44:45" level=debug msg="aggregated unaggregated attestations" Duration=131.653µs prefix="pool/attestations"
time="2023-08-17 23:44:57" level=debug msg="aggregated unaggregated attestations" Duration=131.279µs prefix="pool/attestations"
time="2023-08-17 23:45:09" level=debug msg="aggregated unaggregated attestations" Duration=175.4µs prefix="pool/attestations"
time="2023-08-17 23:45:12" level=info msg="Peer summary" activePeers=0 inbound=0 outbound=0 prefix=p2p
time="2023-08-17 23:45:15" level=error msg="could not process new slot" error="0x0000000000000000000000000000000000000000000000000000000000000000: unknown finalized root" prefix=blockchain
time="2023-08-17 23:45:21" level=debug msg="aggregated unaggregated attestations" Duration=184.876µs prefix="pool/attestations"
time="2023-08-17 23:45:33" level=debug msg="aggregated unaggregated attestations" Duration=246.964µs prefix="pool/attestations"
time="2023-08-17 23:45:45" level=debug msg="aggregated unaggregated attestations" Duration=207.982µs prefix="pool/attestations"
time="2023-08-17 23:45:57" level=debug msg="aggregated unaggregated attestations" Duration=186.674µs prefix="pool/attestations"
time="2023-08-17 23:46:09" level=debug msg="aggregated unaggregated attestations" Duration=186.577µs prefix="pool/attestations"
time="2023-08-17 23:46:12" level=info msg="Peer summary" activePeers=0 inbound=0 outbound=0 prefix=p2p
time="2023-08-17 23:46:21" level=debug msg="aggregated unaggregated attestations" Duration=246.525µs prefix="pool/attestations"
time="2023-08-17 23:46:27" level=error msg="could not process new slot" error="0x0000000000000000000000000000000000000000000000000000000000000000: unknown finalized root" prefix=blockchain
time="2023-08-17 23:46:33" level=debug msg="aggregated unaggregated attestations" Duration=184.536µs prefix="pool/attestations"
time="2023-08-17 23:46:45" level=debug msg="aggregated unaggregated attestations" Duration=151.021µs prefix="pool/attestations"
time="2023-08-17 23:46:57" level=debug msg="aggregated unaggregated attestations" Duration=191.652µs prefix="pool/attestations"
time="2023-08-17 23:46:58" level=error msg="Unable to retrieve proof-of-stake genesis block data" error="HeaderByHash, hash=0xb3920fe1b2f6cc9ccbc7c8ab054cde560057d730ad4071251ceb6f903f1db533: not found" prefix=powchain
time="2023-08-17 23:47:09" level=debug msg="aggregated unaggregated attestations" Duration=133.121µs prefix="pool/attestations"
time="2023-08-17 23:47:12" level=info msg="Peer summary" activePeers=0 inbound=0 outbound=0 prefix=p2p
time="2023-08-17 23:47:21" level=debug msg="aggregated unaggregated attestations" Duration=317.25µs prefix="pool/attestations"
time="2023-08-17 23:47:33" level=debug msg="aggregated unaggregated attestations" Duration=222.805µs prefix="pool/attestations"
time="2023-08-17 23:47:39" level=error msg="could not process new slot" error="0x0000000000000000000000000000000000000000000000000000000000000000: unknown finalized root" prefix=blockchain
time="2023-08-17 23:47:45" level=debug msg="aggregated unaggregated attestations" Duration=181.368µs prefix="pool/attestations"
time="2023-08-17 23:47:57" level=debug msg="aggregated unaggregated attestations" Duration=137.934µs prefix="pool/attestations"

lyfsn · 2023-11-06T03:32:58Z

@icemagno I encountered the same error. How did you resolve it?

Gopal-Gurram · 2024-02-01T12:03:34Z

@Fueav , @lyfsn , @nisdas
did you resolve the
Forkchoice requested sync to new head number=98 hash=748935..d423c8 finalized=75 issue ?
I am facing that while connecting the second node from the localhost and my first node is in droplet and i used the bootnode from geth and bootstrap-node and peer from the beacon node ?

netoneko · 2024-02-05T15:04:59Z

@Gopal-Gurram same issue, trying to add another node to this proof of stake devnet setup and if fails to sync. Did you resolve your issue?

Gopal-Gurram · 2024-02-06T06:48:55Z

no @netoneko

icemagno · 2024-02-23T00:50:31Z

@lyfsn I've started to use Hyperledger Besu.

You can check my old try anyway...
https://github.com/icemagno/multinode-blockchain

May the force be with you in this path

prestonvanloon · 2024-03-21T16:55:54Z

Closing old issues. This seems like a devnet setup issue rather than a Prysm issue. Please file again with reproduction steps if this is still an issue.

linear bot added the Help Wanted Extra attention is needed label Mar 20, 2024

prestonvanloon closed this as not planned Won't fix, can't repro, duplicate, stale Mar 21, 2024

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Unable to retrieve proof-of-stake genesis block data #12497

Unable to retrieve proof-of-stake genesis block data #12497

Fueav commented Jun 6, 2023

aaroua5 commented Jun 6, 2023 •

edited

Loading

nisdas commented Jun 6, 2023

Fueav commented Jun 7, 2023

nisdas commented Jun 7, 2023

Fueav commented Jun 7, 2023

Fueav commented Jun 7, 2023

nisdas commented Jun 7, 2023 •

edited

Loading

Fueav commented Jun 7, 2023

nisdas commented Jun 7, 2023

Fueav commented Jun 7, 2023

nisdas commented Jun 7, 2023 •

edited

Loading

Fueav commented Jun 7, 2023

Fueav commented Jun 7, 2023

nisdas commented Jun 7, 2023

Fueav commented Jun 7, 2023

icemagno commented Aug 17, 2023 •

edited

Loading

lyfsn commented Nov 6, 2023

Gopal-Gurram commented Feb 1, 2024

netoneko commented Feb 5, 2024

Gopal-Gurram commented Feb 6, 2024

icemagno commented Feb 23, 2024 •

edited

Loading

prestonvanloon commented Mar 21, 2024

Unable to retrieve proof-of-stake genesis block data #12497

Unable to retrieve proof-of-stake genesis block data #12497

Comments

Fueav commented Jun 6, 2023

🐞 Bug Report

Description

Has this worked before in a previous version?

🔬 Minimal Reproduction

🔥 Error

🌍 Your Environment

aaroua5 commented Jun 6, 2023 • edited Loading

nisdas commented Jun 6, 2023

Fueav commented Jun 7, 2023

nisdas commented Jun 7, 2023

Fueav commented Jun 7, 2023

Fueav commented Jun 7, 2023

nisdas commented Jun 7, 2023 • edited Loading

Fueav commented Jun 7, 2023

nisdas commented Jun 7, 2023

Fueav commented Jun 7, 2023

nisdas commented Jun 7, 2023 • edited Loading

Fueav commented Jun 7, 2023

Fueav commented Jun 7, 2023

nisdas commented Jun 7, 2023

Fueav commented Jun 7, 2023

icemagno commented Aug 17, 2023 • edited Loading

lyfsn commented Nov 6, 2023

Gopal-Gurram commented Feb 1, 2024

netoneko commented Feb 5, 2024

Gopal-Gurram commented Feb 6, 2024

icemagno commented Feb 23, 2024 • edited Loading

prestonvanloon commented Mar 21, 2024

aaroua5 commented Jun 6, 2023 •

edited

Loading

nisdas commented Jun 7, 2023 •

edited

Loading

nisdas commented Jun 7, 2023 •

edited

Loading

icemagno commented Aug 17, 2023 •

edited

Loading

icemagno commented Feb 23, 2024 •

edited

Loading