Benchmark Rules

Benchmark Rules (Run and Results Report)

This document describes the rules to evaluate the performance of a set of OBDA systems through the OBDA benchmark.

Rule 1

The mappings, ontology, database schema, and queries that can be used for a specific version of the benchmark are only those shipped with that version of the benchmark.

Rule 2

The data instances allowed for a specific version of the benchmark are only those provided with that specific version of the benchmark, or those scaled by VIG starting from the NPD data instance specific to that version of the benchmark.

Rule 3

To ensure replicability of results, tests are to be ran through the obda-mixer testing platform.

=== Work in Progress ===