Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Investigate odd lighthouse error during catch up sync #466

Open
dboreham opened this issue Jul 27, 2023 · 3 comments
Open

Investigate odd lighthouse error during catch up sync #466

dboreham opened this issue Jul 27, 2023 · 3 comments
Assignees

Comments

@dboreham
Copy link
Collaborator

We keep seeing this error in the lighthouse logs after a warm restart:

WARN Error whilst processing payload status  error: Api { error: Reqwest(reqwest::Error { kind: Request, url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Domain("mainnet-eth-geth-1")), port: Some(8551), path: "/", query: None, fragment: None }, source: TimedOut }) }, service: exec

Evidence suggests it is not as simple as a timeout on a request to the sibling geth (geth seems perfectly happy).

@dboreham dboreham self-assigned this Jul 27, 2023
@dboreham
Copy link
Collaborator Author

Perhaps relevant that this message seems to only be seen when lighthouse is not synced up to head:

INFO Syncing                                 est_time: --, distance: 58 slots (11 mins), peers: 17, service: slot_notifier

@dboreham
Copy link
Collaborator Author

Actually since the slot backlog count keeps increasing, it may be that sync is totally stalled. Perhaps the stalled sync and the message about whilst etc are related.

@dboreham
Copy link
Collaborator Author

Suspicions supported by the fact that after a stack restart the errors do not reappear.
Theory is that lighthouse put itself in some bad perpetual stuck state.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant