Skip to content
Switch branches/tags
Go to file

Latest commit


Git stats


Failed to load latest commit information.
Latest commit message
Commit time


Yoka is a framework for running performance tests on clusters. Existing clusters as well as dynamic clusters created by PaaS services are supported. Currently, only Google Compute Engine is supported as a PaaS service but Yoka can be extended to support other PaaS providers.

With Yoka, you can define cluster suites which performance test a set of experiments. Experiments depend on systems which can be started along with the experiments. Yoka supports HDFS, YARN, Flink, Storm, and Zookeeper as configurable systems.



Install Python 2.7, Virtualenv for Python, and the Python development files. In Debian/Ubuntu, this command does the trick:

sudo apt-get install python2.7 python-dev python-virtualenv

Then run:

git clone
cd yoka

The installation script will install the dependencies listed in requirements.txt.


Optionally, if you want to generate plots, install:

sudo apt-get install libfreetype6-dev libpng12-dev

Then execute:

./install with_plotting

Google Compute Engine

For using Google Compute Engine, please install the gcloud tool, i.e. using

curl | bash

Then authenticate against the Google Compute Engine

gcloud config set account <ACCOUNTNAME>
gcloud auth login


All standard configs are defined in By overriding values, the configs can be modified for a specific performance test.


To run Yoka, execute

./yoka run <run_name>

Run files are located in the runs directory. You can use any of the supplied run files as a base to write your own.

For example, to run runs/ execute the following:

./yoka run example


The results of each performance test are stored in the results.db database. The "results" table holds the run times. The "logs" table holds the path to the system logs which are available in the /logs directory.


To trigger certain actions on the cluster, you can use Fabric's fab command.

# activate virtual environment
source env/bin/activate
# list all available actions
fab -l
# execute some actions, e.g.
# start flink
fab flink.master
fab flink.slaves
# stop flink
fab flink.slaves:stop
fab flink.master:stop


Run performance tests in the cloud.



No packages published