Milestone 0.1.0 - Genesis

[marceloboeira]

Let's handle this issue as a discussion forum for the first milestone

IMO, these are the things we should aim for our first MVP.

1. Storage

• Core CommitLog
  • Segments
    • Write to segments
    • Write across segments
    • Read from segment
    • Read across segments
      • Index
      • Better API for reading (Reader API  #5) Thanks @cuichenli
        • Record Struct
          • End-to-end use of records
    • Extract logfile from segment
    • Memory Mapped IO
      • Write
        • Index
        • Segment
        • Refactor segment split to take index into account
      • Read
        • Index
        • Segment
    • Restore state from disk (Restore state from disk  #4)

2. Networking

• Networking/API (Record Transport & Serialisation #6)
  • Decide simple inicial protocol
  • Implement Basic Socket Communication
  • Implement TCP/HTTP?
  • Write to streams over the network
  • zero-cost copy (OS sendfile)

3. Operational

• Operational
  • Configuration
    • CLI Basics

We'll leave replication out of the first Milestone.

---

Extra

• CI/Tooling
  • Setup Travis
    • Build with Linux/macOS
  • Docker
    • Alpine
• Consistency Testing (Consistency Integration Test #8)
• Benchmarks (Automated Benchmarks #10)

[cuichenli]

I’m glad to have helped 😄 . I will also have a look at other issues. Also thanks for the good opportunity to let me contribute and learn.

[alis93]

Hi,

Really interesting project you've got here and would really be interested in contributing. Been looking at some issues and wondering if you had anything you'd like me to work on.

Both restoring state from disk #4 and Consistency integration test #8 seemed to catch my eye.

Let me know if I can work on either of these and I'll get to work on them.