Comparison of Indexes for PMem

Build Essentials

1. Install Build Essentials

   sudo apt-get install build-essential

Install PMDK on Ubuntu 18.04

1. Install NDCTL - https://docs.pmem.io/persistent-memory/getting-started-guide/installing-ndctl#installing-ndctl-packages-on-linux sudo apt-get install libndctl-dev libndctl6 ndctl

2. Install PMDK - https://docs.pmem.io/persistent-memory/getting-started-guide/installing-pmdk/installing-pmdk-using-linux-packages#installing-pmdk-using-the-linux-distro-package-repository

   • All Runtime: sudo apt-get install libpmem1 librpmem1 libpmemblk1 libpmemlog1 libpmemobj1 libpmempool1

   • All Development: sudo apt-get install libpmem-dev librpmem-dev libpmemblk-dev libpmemlog-dev libpmemobj-dev libpmempool-dev libpmempool-dev

   • All Debug: sudo apt-get install libpmem1-debug librpmem1-debug libpmemblk1-debug libpmemlog1-debug libpmemobj1-debug libpmempool1-debug

3. sudo apt-get install libnuma-dev

Setup PMem

https://docs.pmem.io/persistent-memory/getting-started-guide/creating-development-environments/linux-environments/linux-memmap

Build BzTree

1. Install latest CMake

wget https://github.com/Kitware/CMake/releases/download/v3.18.4/cmake-3.18.4-Linux-x86_64.sh
chmod +x cmake-3.18.4-Linux-x86_64.sh
./cmake-3.18.4-Linux-x86_64.sh --skip-license --include-subdir --prefix=/usr/local
export PATH=$PATH:/usr/local/cmake-3.18.4-Linux-x86_64/bin

2. Build BzTree

git clone https://github.com/sfu-dis/bztree.git
cd bztree

    In CMakeLists.txt:

    Line 73 - Change to GIT_REPOSITORY https://github.com/sfu-dis/pmwcas.git

    Line 86 - Change to GIT_REPOSITORY https://github.com/sfu-dis/pibench.git

    Line 172 - Change to set(PMDK_LIB_PATH "/usr/lib/x86_64-linux-gnu" CACHE STRING "PMDK lib install path")

mkdir build && cd build
cmake -DCMAKE_BUILD_TYPE=RelWithDebInfo -DPMEM_BACKEND=PMDK -DGOOGLE_FRAMEWORK=0 -DBUILD_TESTS=0 ..
make

    If make fails, open pmwcas/src/PMWCAS/CMakeLists.txt from the build directory:

    Line 270 - Change to set(PMDK_LIB_PATH "/usr/lib/x86_64-linux-gnu" CACHE STRING "PMDK lib install path")

rm -rf pmwcas/src/PMWCAS-build/*
make

Recompile PMwCAS library to properly link dependencies:

cd ~/bztree/build/pmwcas/src/PMWCAS-build
rm -rf libpmwcas.so
/usr/bin/c++ -fPIC  -std=c++11 -O2 -g -DNDEBUG -shared -Wl,-soname,libpmwcas.so -o libpmwcas.so CMakeFiles/pmwcas.dir/src/util/nvram.cc.o CMakeFiles/pmwcas.dir/src/util/status.cc.o CMakeFiles/pmwcas.dir/src/environment/environment.cc.o CMakeFiles/pmwcas.dir/src/common/allocator_internal.cc.o CMakeFiles/pmwcas.dir/src/common/pmwcas_internal.cc.o CMakeFiles/pmwcas.dir/src/common/environment_internal.cc.o CMakeFiles/pmwcas.dir/src/common/epoch.cc.o CMakeFiles/pmwcas.dir/src/mwcas/mwcas.cc.o CMakeFiles/pmwcas.dir/src/environment/environment_linux.cc.o  /usr/lib/x86_64-linux-gnu/libpmemobj.so -lpthread -lnuma -lrt

Run PiBench using the wrapper:

sudo ./_deps/pibench-src/build/src/PiBench --input ./libbztree_pibench_wrapper.so --pool_path=/pmem/pool --pool_size=4294967296

Build lbtree

git clone https://github.com/schencoding/lbtree
cd lbtree
dd if=/dev/zero of=/pmem/lbtree bs=1048576 count=2048

On line 59 of common/nvm-common.h, replace clwb with clflush. clwb instruction is not supported on some older processors.

make

Build and run lbtree pibench wrapper

Run the following commands from lbtree directory:

cd /mnt/sda4/lbtree

# Compile lbtree wrapper (will also compile lbtree if not already done)
make PIBENCH_DIR=/root/bztree/build/_deps/pibench-src/ -j

# Run pibench
rm -rf /pmem/lbtree
LD_LIBRARY_PATH=./ /root/bztree/build/_deps/pibench-src/build/src/PiBench --input ./liblbtree_pibench_wrapper.so --pool_path=/pmem/lbtree --pool_size=1073741824 --scan_size 1 -n 1000000 -p 1000000

Build dash

git clone https://github.com/baotonglu/dash.git
cd dash
mkdir build && cd build
cmake -DCMAKE_BUILD_TYPE=Release -DUSE_PMEM=ON ..
make -j

Build and run dash pibench wrapper

To compile dash wrapper, include dash pibench wrapper files (.cc and .h) in the src directory and make the changes in CMakeLists.txt as shown in dash.diff file.

cmake -DCMAKE_BUILD_TYPE=Release -DUSE_PMEM=ON ..
make -j

To run PiBench using the wrapper:

rm -rf /pmem/dash
LD_LIBRARY_PATH=./ /root/bztree/build/_deps/pibench-src/build/src/PiBench --input ./libdash_wrapper.so --pool_path=/pmem/dash --pool_size=1073741824 --scan_size 1 -n 100 -p 1000000