Hierarchical Consensus (B1) MVP

[adlrocha]

This is the main entrypoint for the sharding MVP. I'll try to keep here a checklist with TODOs and issues to be implemented for the MVP.

• Shard Actor

  • Add
  • Join
  • Leave #53
  • Shards naming scheme #59
  • Shard Coordinator Actor #61
  • Shard Actor interface and reference implementation #62
  • Fund/Release methods in Subnets #85
  • Cross-net messages handling (Fund/Release methods in Subnets #85, Validate and apply cross messages in subnet consensus #88, Add sync cmd to sync with subnet without adding collateral #93, Implement Release bottom-up cross msg #94, Generalized cross-message types towards arbitrary cross-msgs #118, Routing messages through hierarchy #119. Revert state changes in source subnet if cross-msg can't be applied in destination #92)
  • Subnet checkpointing protocol implementation #80
  • Unit tests

• Eudico

  • Joining shard pubsub again in child chain when constructing shard actor. #27
  • Exclusively join shards a peer is involved in after state change #33
  • Fail to sync when a peer joins existing shard #35
  • Handle genesis block for shards #36
  • Use the right context for sharding processes #25
  • Allow joining of shard topics in PubSub filters #24
  • Remove handlers and stop processes when leaving a shard #38
  • Organize consensus code for shards #26
  • Support for proof of work in shards. #39
  • Support for filecoin consensus in shards #40
  • Verify block proposer belongs to the shard. #31
  • Shard listener manager #32
  • Sharding commands in CLI #50
  • Cross-shard Filecoin transaction (Fund/Release methods in Subnets #85, Validate and apply cross messages in subnet consensus #88, Add sync cmd to sync with subnet without adding collateral #93, Implement Release bottom-up cross msg #94, Generalized cross-message types towards arbitrary cross-msgs #118, Routing messages through hierarchy #119. Revert state changes in source subnet if cross-msg can't be applied in destination #92)
  • Atomic execution protocol (Atomic actor primitives. Sample atomic execution actor. Off-chain execution of locked state #133, SCA logic for atomic execution in parent chain. #137, Commands to manage atomic executions between subnets #138)

• Testing / Benchmarks

  • Subnet integration tests #34
  • Setup itest to work with eudico networks #9
  • Visualization tool for subnets #84

• Post-MVP backlog

  • Instantiate subnet stack when restarting peer #37
  • Remove chain when leaving a shard #54
  • Handling Filecoin storage and miner logic from shards #29
  • Handle orphan chain states from left subnets. #79

• Docs

• Housekeeping

  • Rename shard to subnets throughout the code #78

[adlrocha]

Closing MVP stage. From now on, low-level developments and issue regarding hierarchical consensus can be tracked in this project