Quanta Research Cambridge OpenStack Stress Test System

This is a framework for stress testing an OpenStack Nova cluster.

Nova Cluster Installation

This test framework is designed to stress test a Nova cluster. Hence, you must have a working Nova cluster. This particular framework assumes your working Nova cluster understands Nova API 1.1.

Installation

We will first create a subdirectory in your home directory:

cd ~
mkdir install
cd install

Clone a copy of openstack-stress-test:

git clone https://github.com/quanta-research-cambridge/openstack-stress-test.git

Set PYTHONPATH to include the stress module. You may want to edit your .bashrc (or shell configuration) to modify the PYTHONPATH environment variable. For now, simply execute the following statement:

export PYTHONPATH=$HOME/install/openstack-stress-test:$PYTHONPATH

Our code uses some of kong's libraries. To install openstack integration tests, get a copy of tempest from their git repository:

git clone https://github.com/openstack/tempest.git

Switch to the kong version that we developed with:

cd tempest
git checkout 8a84d2efc453c9c1c5210339c4b1724736a48230
cd ..

We need to set PYTHONPATH to include tempest. You may want to edit your .bashrc (or shell configuration) to modify the PYTHONPATH environment variable. For now, simply execute the following statement:

export PYTHONPATH=[ROOT]/tempest:[ROOT]/openstack-stress-test:$PYTHONPATH

There are a few packages that kong depends on:

paramiko

To install it on Ubuntu 11.04:

sudo apt-get -y install python-paramiko

The following environment variables will also need to be defined:

NOVA_API_KEY
NOVA_USERNAME
NOVA_PROJECT_ID
NOVA_URL
NOVA_VERSION

In our setup, we use nova-manage [project name] [zipfile name] on the Nova controller to generate a file (novarc) that contains these settings for these values. The file is then sourced locally before the test is executed.

Finally, you will need to provide the path to the private SSH key that provides public key SSH access to the Nova controller. Set the environment variable NOVA_SSH_KEY_PATH to this value. For example:

export NOVA_SSH_KEY_PATH=/home/tester/.ssh/id_rsa.nova

where /home/tester/.ssh/id_rsa.nova is the private key that corresponds to a public key stored in the /.ssh/authorized_keys file for the root user on the Nova controller.

Running the sample test

To test your installation, do the following:

cd ~/install/openstack-stress-test/stress
python user_script_sample.py

This sample test tries to create a few VMs and kill a few VMs.

Gotchas

Some of the tests require the use of floating IPs. Ensure that your nova cluster has been configured with floating IPs that can be allocated and deallocated with the nova command line tool. Floating IPs are used for various tasks, e.g., to verify that a system is live after reboot.

Additional Tools

Sometimes the tests don't finish, or there are failures. In these cases, you may want to clean out the nova cluster. We have provided some scripts to do this in the tools subdirectory. To use these tools, you will need to install python-novaclient:

cd ~/install
git clone https://github.com/rackspace/python-novaclient.git
cd python-novaclient

Install python-novaclient:

sudo python setup.py install

You can then use the following script to destroy any keypairs, floating ips, and servers:

cd ~/install/openstack-stress-test/tools
./nova_destroy_all.py