PaxosStore has been deployed in WeChat production for more than two years, providing storage services for the core businesses of WeChat backend. Now PaxosStore is running on thousands of machines, and is able to afford billions of peak TPS.
Switch branches/tags
Nothing to show
Clone or download
Latest commit e07ebf4 Oct 24, 2017
Permalink
Failed to load latest commit information.
certain Update README.md Oct 24, 2017
images - readme; Aug 26, 2017
paxoskv fixup! update .travis.yml for paxoskv. Sep 17, 2017
.gitmodules Update certain Oct 14, 2017
.travis.yml build static_lib only for travis Oct 15, 2017
LICENSE.txt init add; Aug 25, 2017
README.md Update README.md Sep 14, 2017

README.md

PaxosStore

Build Status

PaxosStore is a distributed-database initially inspired by Google MegaStore. It's the second generation of storage system developed to support current WeChat sevice and applications. PaxosStore has been deployed in WeChat production for more than two years, providing storage services for the core businesses of WeChat backend including user account management, user relationship management (i.e., contacts), instant messaging, social networking (i.e., Moments), and online payment (i.e., WeChat Pay).

Now PaxosStore is running on thousands of machines, and is able to afford billions of peak TPS.

Prior to PaxosStore, we have been using a QuorumKV storage system to support various WeChat services with strongly consistent read/write since 2011. As the number of storage servers rises to tens of thousand, the operational mantenance and development of a NWR-based system in such a large scale become painful. That's why we come up with PaxosStore: a new generation of distributed database, built on top of the leaseless Paxos consensus layer, providing

  • Two paxos consensue libraries (the key algorithms described in our paper published at the VLDB 2017 are now open source):

    • Certain for the general PaxosLog + DB design;
    • PaxosKV optimized for key-value storage (PaxosLog-as-value);

    In addition, the following items are planned for open source by October 2017.

  • A high performance key-value system

  • A system that supports rich data structures such as queues, list, set and collections

  • A high performance storage engine backed by LSM-tree

  • A New SQL-like Table system

The PaxosStore Architecture

image

Please refer to the following publications for the technical details of PaxosStore.

Build

License

PaxosStore is under the BSD 3-Clause License. See the LICENSE.txt file for details.