Skip to content
This repository

HTTPS clone URL

Subversion checkout URL

You can clone with HTTPS or Subversion.

Download ZIP

Testbot is a test distribution tool that works with Rails, RSpec, RSpec2, Test::Unit and Cucumber

Fetching latest commit…

Cannot retrieve the latest commit at this time

README.markdown

Testbot is a test distribution tool that works with Rails, RSpec, Test::Unit and Cucumber. The basic idea is that you let testbot spread the load of running your tests across multiple machines to make the tests run faster.

Using testbot on 11 machines (25 cores) we got our test suite down to 2 minutes from 30. More examples of how testbot is used.

Installing

gem install testbot

Try it out

testbot --server
testbot --runner --connect localhost
mkdir -p testbotdemo/test; cd testbotdemo
echo 'require "test/unit"' > test/demo_test.rb
echo 'class DemoTest < Test::Unit::TestCase; def test_first; end; end' >> test/demo_test.rb
testbot --test --connect localhost

# Cleanup
testbot --server stop
testbot --runner stop
cd ..; rm -rf testbotdemo
rm -rf /tmp/testbot

The project files from the demo project are synced to /tmp/testbot/$USER (default). The runner syncs the files to /tmp/testbot/project (default). The tests are then run and the results returned through the server and displayed.

How it works

Testbot is:

  • A server to distribute test jobs.
  • One or more runners to run test jobs and return the results (this is the "worker" process).
  • One or more requesters that tells the server which tests to distribute and displays the results (the client you use to run tests, for example: rake testbot:spec).
    Requester -- (files to run) --> Server -- (files to run) --> (many-)Runner(s)
        ^                           |    ^                                  |
        |---------------------------|    |----------------------------------|
                 (results)                            (results)

Example setup

Here I make the assumption that you have a user called testbot on a server at 192.168.0.100 that every computer can log into without a password and that you have installed testbot on each computer.

ssh testbot@192.168.0.100
testbot --server

On every computer that should share CPU resources run:

testbot --runner --connect 192.168.0.100

Running tests:

testbot --test --connect 192.168.0.100
# --test could also be --spec or --features

Using testbot with Rails 2:

ruby script/plugin install git://github.com/joakimk/testbot.git -r 'refs/tags/v0.5.3'
script/generate testbot --connect 192.168.0.100

rake testbot:spec (or :test, :features)

Using testbot with Rails 3:

rails g testbot --connect 192.168.0.100
rake testbot:spec (or :test, :features)

# Gemfile:
gem 'testbot'

You can keep track of the testbots on:

http://192.168.0.100:2288/status

Updating testbot

To simplify updates there is a --auto_update option for the runner. The runner processes that use this option will be automatically updated and restarted when you change the server version.

This requires testbot to be installed without sudo as the update simply runs "gem install testbot -v new_version". I recommend using RVM (it handles paths correctly).

Example: testbot --runner --connect 192.168.0.100 --auto_update

More options

testbot (or testbot --help)

Could this readme be better somehow?

If there is anything missing or unclear you can create an issue (or send me a pull request).

Features

  • You can add and remove computers at any time. Testbot simply gives abandoned jobs to other computers.
  • Testbot will try to balance the testload so that every computer finishes running the tests at the same time to reduce the time it takes to run the entire test suite. It does a good job, but has potential for further improvement.
  • You can access your testbot network through SSH by using the built in SSH tunneling code.
  • You can use the same testbot network with multiple projects.
  • Testbot is continuously tested for compability with Ruby 1.8.7 and 1.9.2.

Contributing to testbot

First, get the tests to run: bundle rake

For development I recommend: grosser/autotest autotest -f -c

Make your change (don't forget to write tests) and send me a pull request.

You can also contribute by adding to the wiki.

How to add support for more test frameworks and/or programming languages

Add a lib/adapters/framework_name_adapter.rb file, update lib/adapters/adapter.rb and this readme.

More

  • Check the wiki for more info.
Something went wrong with that request. Please try again.