M2Bench: A Database Benchmark for Multi-Model Analytic Workloads

• M2Bench is a new benchmark program capable of evaluating a multi-model DBMS.
• M2Bench supports several important data models including relational, document-oriented, property graph and array models.
• M2Bench consists of multi-model workloads that are inspired by real-world problems.
• Each task of the workloads mimics a real-world problem that involves at least two different models of data.

Before Getting Started

• If you need a support during reproducing this work, feel free to contact us.
• We highly recommend to use the described versions of software with Ubuntu 18.04 that we used for the publication.

Software Versions

DBMS versions used for the experiment in the paper are as follows.

• Polyglot: MySQL 8.0.25, MongoDB 4.2.6, Neo4j 4.0.3, and SciDB 19.11.5.
• ArangoDB 3.7.12
• AgensGraph 2.1.3 (based on PostgreSQL 10.4)

For SciDB installation, please refer to the description for Polyglot (Impl/Polyglot/README.md).

Each data generator, data scaler, and client program of Polyglot needs different prerequisites to run them. For such dependencies, we will describe those in a description of each part.

How to Run M2Bench

In order to run M2Bench, please follow the below steps.

1. Generate datasets of M2Bench following the instructions in Datasets/README.md.
2. Choose one of Polyglot, AgensGraph, and ArangoDB. Refer to the chosen DBMS as X.
3. Load the datasets into DBMS X and run tasks, following the instructions in Impl/X/README.md.

Directory Overview

• All datasets in M2Bench are explained in the Datasets folder.
• Data loading scripts and query implementations are stored in the Impl directory.
• All tasks in M2Bench are explained in the /Tasks/alltasks.md file.

m2bench
├── Datasets
│   ├── ecommerce           # Generated e-commerce data
│   ├── healthcare          # Generated healthcare data
│   ├── disaster            # Generated disaster & safety data
│   ├── DataScaler          # Data scaler
│   ├── Generator           # Data generator        
│   └── README.md           # How to generate the datasets of M2Bench from the realworld datasets.
├── Tasks                   
|   └── alltasks.md         # Description of all tasks of M2Bench
├── Impl                    # Implementation of tasks of M2Bench on various DBMSs
│   ├── agensgraph  
│   │   ├── load_datasets   # How to load datasets into DBMS
│   │   └── run_tasks       # How to run tasks
│   ├── arangodb
│   │   ├── load_datasets 
│   │   └── run_tasks
│   └── polyglot            # polyglot persistence
│       ├── load_datasets
│       └── run_tasks
├── README.md
└── LICENSE