UTXO-HD: Prepare LMDB implementation for benchmarking

[jasagredo]

• Rebase the UTXO-HD implementation on top of cardano-node 8.9.0 once it lands on master (Release 8.9.0 #5691).
• Allow to choose the ledgerdb backend via flags (currently disabled)
• Finish the rework of range queries (currently disabled) Fixed in V1, tentatively fixed in V2
• Complete the new tracing system traces in the UTXO-HD branch (not implemented due to taking shortcuts)
  • Backing store traces in V1 makes the legacy system output too much (breaking ellision). Maybe not important?
• Expose a flag --ssd-database-dir PATH for LMDB live tables
• Expose a flag --ssd-snapshot-state for deciding to store the serialization of LedgerState blk EmptyMK in the ssd dir.
• Expose a flag --ssd-snapshot-tables for deciding to store the copied LMDB tables in the ssd dir.
• Tests passing in ouroboros-consensus
• Tests passing in cardano-api
• Tests passing in cardano-node
• Redesign the access to the new epoch state for getEpochState in cardano-api
• Make sure that the snapshots work as expected (NumOfDiskSnapshots and them being duplicated in UTXO-HD) (UTXO-HD is missing number of snapshots ouroboros-consensus#1018, Fix snapshot complications in UTXO-HD ouroboros-consensus#1016)
• MIGHT WAIT FOR INITIAL TESTING: Re-enable ouroboros-consensus benchmarks (Reenable benchmarks in CI ouroboros-consensus#1021)

Branches

• WIP: UTXO-HD for node 8.9.0 ouroboros-consensus#977
• WIP: UTXO-HD for node 8.9.1 cardano-api#494
• WIP: UTXO-HD for node 8.9.1 #5726

Known issues

• Consensus: Aarch64-darwin in Hydra fail when building ghc-9.6.4 https://ci.iog.io/build/3537346/nixlog/1
• Cardano-api: Mingw32 compilation in cardano-api crashes: https://ci.iog.io/build/3537497/nixlog/1
• Node: Legacy tracers need a review
• Node: New tracers are stubs. Also because of this, tests are failing in cardano-node-test: Configuration Consistency tests, for example https://github.com/IntersectMBO/cardano-node/actions/runs/8570639554/job/23488999528
• Cardano-api and node: there are some HLint warnings that we should address before merging.
• Consensus mempool benchmarks showed a regression. System level benchmarks will show whether such a regression is real. Bechmarks are disabled at the moment.
• Documentation is outdated.
  • InMemory V2 is not mentioned at all
  • ouroboros-consensus-cardano-legacy-block is still mentioned