Adding a new benchmark and implementation to an existing suite

This page explains how to add a new benchmark and implementation(s) to an existing benchmark suite, such as the Ostrich benchmark suite. It uses the recursive Fibonacci algorithm as a running example to illustrate the process.

Create a directory for the benchmark

Choose a descriptive short name to refer to the benchmark and create a directory with that name under the suite's 'benchmarks' directory :

mkdir benchmarks/fib
cd benchmarks/fib

Create a 'benchmark.json' description file for the benchmark

The 'benchmark.json' description file should follow the benchmark description format. Here is a working example for Fibonacci:

{
   "type": "benchmark",
   "name":"N-th Fibonacci Sequence Number Recursive Computation",
   "short-name":"fib",
   "description":"Computes the N-th number of the Fibonacci sequence using the recursive algorithm.",
   "version":"0.1.0",
   "input-size":{
      "small":8,
      "medium":25,
      "large":30
   }
}