Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

devnet catchup failure fix #8952

Merged
merged 2 commits into from May 28, 2021
Merged

devnet catchup failure fix #8952

merged 2 commits into from May 28, 2021

Conversation

deepthiskumar
Copy link
Member

@deepthiskumar deepthiskumar commented May 27, 2021

Nodes crashed with the dangling merkle mask parent exception when one of them created a fork off of the root of the frontier.
This is an edge case in the catchup code where a cached breadcrumb becomes stale and doesn't get updated before being used. The breadcrumb at the root changes when the root transitions. When a node produces blocks off of the root of the frontier and other nodes try to catchup to the short fork, they’d use the stale breadcrumb which would have a detached mask.

Fixed by not storing any breadcrumbs in the catchup tree

Reproduced it locally and tested the fix

This is a different case from what is reported in #8681 which is the transition frontier and extension desync issue

@deepthiskumar deepthiskumar requested a review from a team as a code owner May 27, 2021 17:10
@deepthiskumar deepthiskumar added the ci-build-me Add this label to trigger a circle+buildkite build for this branch label May 27, 2021
@lk86 lk86 changed the base branch from compatible to release/1.1.6 May 28, 2021 09:05
Copy link
Member

@imeckler imeckler left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

New changes look good!

@lk86 lk86 merged commit 1a0ae8f into release/1.1.6 May 28, 2021
@lk86 lk86 deleted the fix/dangling-parent-catchup branch May 28, 2021 20:23
@aneesharaines aneesharaines added this to the Sprint 5/25 - 6/8 milestone Jun 9, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
ci-build-me Add this label to trigger a circle+buildkite build for this branch Size: S ~ 0.5 wks
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

4 participants