Always Be Testing!!!

A test framework that uses IronWorker to run it... constantly.

Read this blog post for background: When Unit Tests Aren't Enough... ABT - Always Be Testing.

Getting Started

First of all, the code to test must be able to check for a special config variable:

if defined? $abt_config
  @config = $abt_config
end

A real world example of using $abt_config is here: https://github.com/iron-io/iron_mq_ruby/blob/master/test/test_base.rb

Upload worker

iron_worker upload https://github.com/iron-io/abt/blob/master/abt.worker

Or (if you want to customize smth)

git clone https://github.com/iron-io/abt.git
iron_worker upload abt

Get it running

Using CLI

iron_worker queue abt -p "{\"git_url\":\"git://github.com/iron-io/iron_mq_ruby.git\",\"test_config\":{}}"

Using code(check queue.rb):

require 'iron_worker_ng'
client = IronWorkerNG::Client.new(:token => 'TOKEN', :project_id => 'PROJECT_ID')
params = {
      "git_url" => 'git://github.com/iron-io/iron_mq_ruby.git',
      "parameters" => ['--name=/test_performance.*/'],
      "test_config" => {}}

client.tasks.create('abt', params)

Add built in notifier (optional):

Using CLI

iron_worker queue abt -p "{\"notifiers\":[{\"class_name\":\"HipChatNotifier\", \"config\":{\"token\":\"HIPCHAT_TOKEN\", \"room_name\":\"AlwaysBeTesting\", \"important_room_name\":\"RoomName\", \"user_name\":\"ABT Worker\"}}], \"git_url\":\"git://github.com/iron-io/iron_worker_ruby.git\", \"test_config\":{}}}"

Using code(check queue.rb):

params.merge! {"notifiers" => [{"class_name"=>"HipChatNotifier",
                           "config"=>{"token"=>"HIPCHAT_TOKEN",
                                      "room_name"=>"AlwaysBeTesting",
                                      "important_room_name"=>"RoomName",
                                      "user_name"=>"ABT",
                                      "git_url"=>"git://github.com/SAMPLE.git"}},
                          ]}

you can add as many notifiers as you need and even make your own (read down for how to build custom notifiers).

Schedule It!

Schedule it to run regularly to ensure you're always being covered.

Using CLI

iron_worker schedule --start-at "2013-01-01T00:00:00-04:00" --run-every 600 --payload  "{\"git_url\":\"git://github.com/iron-io/iron_mq_ruby.git\",\"test_config\":{}}"

Using code

client.schedules.create('abt', params, {:start_at => Time.now,:run_every=>600})

Custom notifiers

Here's how to build your own notifiers.

Implement in your notifier the following methods:

setup configuration:

def initialize(config)
  @url = config["url"]
end

process simple text message

def send_message(message)
  puts message
end

if you want more detailed results, 'result' is an instance of Test::Unit::TestResult

def send_formatted_message(result)
 result.inspect
end

Then to use it:

worker.add_notifier(File.join(File.dirname(__FILE__), 'console_notifier'), :class_name=>'ConsoleNotifier', :config={})

Custom unit-test command line options

filter test methods by pattern:

"parameters" => ['--name=/test_performance.*/']

Webhooks

• git clone https://github.com/iron-io/abt.git
• Change parameters in config.yml
• iron_worker upload abt
• Configure Github (or any other) webhook ie: https://worker-aws-us-east-1.iron.io/2/projects/{PROJECT_ID}/tasks/webhook?oauth={TOKEN}&code_name=abt