M3 for Batch Processing
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
cmake Initial commit Mar 31, 2016
examples
include/m3bp
src
test Fix to set default size for output buffer Jun 17, 2016
.gitattributes
.gitmodules
.travis.yml Add configuration file for Travis CI Apr 1, 2016
CMakeLists.txt
Doxyfile
LICENSE
NOTICE
README.md Update README.md Jun 22, 2016

README.md

M3 for Batch Processing

M3 for Batch Processing (M3 for BP) is a data processing engine that fully extracts the performance of multicore/multiprocessor-based single node servers.

M3 for BP is designed for Asakusa Framework, with a focus on small-to-medium volume of data (less than tens of GB). For this volume of data, M3 for BP provides much better performance and much lower TCO for applications built on Asaskusa Framework than do MapReduce and Spark.

Prerequisites

  • CMake (>= 2.8)
  • Boost C++ libraries (>= 1.55)
  • hwloc (>= 1.8)

How to build and install

$ git submodule init
$ git submodule update
$ mkdir build && cd build
$ cmake -DCMAKE_BUILD_TYPE=Release [-DCMAKE_INSTALL_PREFIX=/path/to/install] .. 
$ make
$ make install

License