Golog

Golog is a distributed commit log built using Go

Key Concepts and Learning Points

• Serialization and deserialization using Protocol Buffers
• Build a Log of binary Records, stored and indexed as Segments
• Exposing a library as a Service with gRPC
• Securing Services using mutual TLS and access control lists
• Adding Observability to Services: Metrics, Structured Logs and Traces
• Server-to-Server Service Discovery and Membership using Serf
  • a tool for cluster membership, failure detection, and orchestration
  • decentralized, fault-tolerant and highly available
  • uses an efficient gossip protocol
• Replicate records whenever a new Server is discovered in the cluster
• Implementing Serf allows multiple service instances to be run where they can discover and then replicate each other's data
• Coordinated Services with Consensus - using Raft for leader election and replication
• Client-side Server Discovery and Load-Balancing via custom gRPC resolver and picker

References

• Distributed Services with Go by Travis Jeffery