Skip to content
This repository has been archived by the owner on Dec 13, 2022. It is now read-only.

feat(ETH): Loading Ethereum Data #48

Merged
merged 8 commits into from
Apr 26, 2022
Merged

feat(ETH): Loading Ethereum Data #48

merged 8 commits into from
Apr 26, 2022

Conversation

manishrjain
Copy link
Contributor

@manishrjain manishrjain commented Apr 26, 2022

Added code to load Ethereum data. The schema only tracks accounts and transactions for now, but would track more things later.

Ensure that Alpha can correctly pick up read keys when running mutation with NewObjects. We do this by having task.go use the Txn corresponding to the commit Ts. These keys can then correctly detect if a concurrent mutation should be re-run.

After having seen many concurrent mutations re-run, I turned them off for now. Getting a good loader performance (80K blocks per min after 45 mins of ETH data loading) even with single-threaded mutations.

This PR fixes up Zero rejecting tablet updates and brings in changes from Badger, which fix a bottleneck in HandoverSkiplist.


This change is Reviewable

@manishrjain manishrjain merged commit af56e59 into main Apr 26, 2022
@manishrjain manishrjain deleted the mrjn/loading-eth branch April 26, 2022 18:11
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

1 participant