[EPIC] Chain synchronization (single relay)

[KtorZ]

Tasks

Networking

• Implement node-to-node protocols for fetching blocks. (Already done as part of Dolos)

• Integrate the network layer fetching blocks with the storage layer (including marshaling/serialization) (Already done as part of Dolos)

Storage

• Evaluate and soft commit to a database storage solution. #2

Ledger

• Keep track of protocol parameters updates

Tools

• Instrument the Cardano Haskell node to start at a specific point. #3

• Test bench for reproducing synchronization measurements vs a Haskell node #4

Scope/Acceptance Criteria

1. Assuming a single trusted source as a Haskell node relay, fetching data from it using existing node-to-node mini-protocols.
   1. We do not perform any block or transaction validation (we fully trust the data source).
   2. Should be able to synchronize from Mainnet, PreProd and Preview
2. We are only interested in blocks from the current era onward.
3. We must store data in a way that makes it possible to consume and serve through an API.
   1. We must be able to compare with an equivalent Haskell-based indexer
4. Synchronization time should be on-par with the Haskell nodes (without Mithril).
   1. Benchmarks should be run against Mainnet
5. Make sure we test for chain re-organization through rollback.