Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Speedup procedure of finding missing block numbers for catchup fetcher #4129

Merged
merged 1 commit into from
Jun 7, 2021

Conversation

vbaranov
Copy link
Member

@vbaranov vbaranov commented May 24, 2021

Motivation

Query to get all chain breaks works ~15 seconds on average.

Changelog

Find min missing block number in the background and save it into DB in last_fetched_counters table. Use this min value for the fetcher in order to narrow down the range of blocks for the query.

Checklist for your Pull Request (PR)

@vbaranov vbaranov changed the title Speedup initial query for catchup fetcher Speedup procedure of finding missing block numbers May 24, 2021
@vbaranov vbaranov changed the title Speedup procedure of finding missing block numbers Speedup procedure of finding missing block numbers for catchup fetcher May 24, 2021
@vbaranov vbaranov force-pushed the vb-speedup-initial-query-for-catchup-fetcher branch 5 times, most recently from ddc7350 to cd007a0 Compare May 25, 2021 08:31
@vbaranov vbaranov force-pushed the vb-speedup-initial-query-for-catchup-fetcher branch 2 times, most recently from a00058f to 4a34c1b Compare June 7, 2021 11:53
@vbaranov vbaranov force-pushed the vb-speedup-initial-query-for-catchup-fetcher branch from 4a34c1b to 32663bc Compare June 7, 2021 12:13
@vbaranov vbaranov merged commit 0a22cf6 into master Jun 7, 2021
@vbaranov vbaranov deleted the vb-speedup-initial-query-for-catchup-fetcher branch June 7, 2021 12:25
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

1 participant