YABench-One

A benchmark testing SELECT, FILTER, aggregate, and join query capabilities of C-SPARQL and CQELS engines.

Experiments

We described and explained each experiment in a separate document where you find settings, results and discussion sections: Experiment 1, Experiment 2, Experiment 3, Experiment 4.

All the experiments in this benchmark were run with YABench 1.1.0 on Fedora 20.1 (64 bit), Intel Core i7-3667U CPU @ 2.00Ghz x 4, 8Gb RAM, 180 Gb SSD.

Preparing

First, you need to clone this repository and download the latest release of the YABench framework.

Make sure that you have installed all prerequisites and dependencies which are listed on the Installing wiki page.

Now you're ready to run the tests!

Running

Example command to execute a test:

./yabench-runner/runner.py <test folder> -Dexec.oracle=<path to Oracle's .jar> -Dexec.generator=<path to Generator's .jar> -Dexec.engine=<path to Engine's jar>

For example, if you've unpacked the release archive to the cloned repository folder, you should have the following folder structure:

-- .
-- Experiment_1/
-- Experiment_2/
...
-- Experiment_4/
...
-- yabench-<version>/

If you want to run Experiment #1 with CQELS engine, you need to execute the following command:

./yabench-<version>/yabench-runner/runner.py Experiment_1/cqels -Dexec.oracle=yabench-<version>/yabench-oracle.jar -Dexec.engine=yabench-<version>/yabench-cqels.jar
-Dexec.engine=yabench-<version>/yabench-generator.jar

The results can be found in the Experiment_1/cqels/results folder. They can be visualized with the yabench-reports web application, see Visualisation of the results wiki page.