BitcaskC++

BitcaskC++ is a c++ implementation of the bistcask storage format. You can find the reference paper at Basho Tehcnology. This is a high performance key/value store with a very high write throughput. it includes a library for embeding inside your application and a compatible server (wip).

Features

• Embeddedable library bitcaskcpp
• Builtin server (bitcaskcpp-server)
• Predictable read/write performance
• Low latency
• High throughput

Is Bitcask right for me?

Bitcask is great for storing hundreds of thousands to millions of key/value pairs. It can be used when you need very high write throughput while maintaining predictable read throughput. I you are thinking of LevelDb, RocksDB or any other key value store, then bitcask should be a great option to consider. It's important to note that bistcask keeps all its keys in memory. if your expected keyspace does not fit in RAM, Bitcask might not be the right storage engine for you. Note that this only concerns the keys not the values.

Development

You can develop inside a docker container using GCC9 and connan.

BUIDKIT=1 docker build -t cppimage .
docker run -it -v "$PWD":"/home/connan/project" cppimage bash
./entrypoint.sh install
./entrypoint.sh build
./entrypoint.sh test

BUIDKIT=1 docker build -t cppimage .
docker run -it -v "$PWD":"/home/connan/project" cppimage
conan install ..  -s build_type=Release --build
cmake .. -G "Unix Makefiles" -DCMAKE_BUILD_TYPE=Release
cmake --build .

Depends on:

• Adaptive Radix Tree
• CRC32
• Cxx-Opts
• Crow
• Picobench
• Plog

TODO:

• benchmark
• test concurency
• add crc & compaction trigger option

===============================================================================
   Name (baseline is *)   |   Dim   |  Total ms |  ns/op  |Baseline| Ops/second
===============================================================================
           bistcask_put * |       8 |     0.030 |    3811 |      - |   262381.1
             bistcask_get |       8 |     0.043 |    5373 |  1.410 |   186085.5
           bistcask_put * |      64 |     0.178 |    2788 |      - |   358593.6
             bistcask_get |      64 |     0.323 |    5046 |  1.810 |   198147.9
           bistcask_put * |     512 |     1.404 |    2742 |      - |   364658.6
             bistcask_get |     512 |     2.299 |    4491 |  1.638 |   222661.0
           bistcask_put * |    4096 |     8.861 |    2163 |      - |   462255.8
             bistcask_get |    4096 |    13.229 |    3229 |  1.493 |   309629.5
           bistcask_put * |    8192 |    15.843 |    1934 |      - |   517059.5
             bistcask_get |    8192 |    24.587 |    3001 |  1.552 |   333177.9
===============================================================================