Testing Framework
Branch: master
Clone or download
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
bin change name to tf, bump version to 0.3.0 May 28, 2012
lib Update tf for compatibility with new Gems and Rubies (#9) Feb 19, 2019
test Update tf for compatibility with new Gems and Rubies (#9) Feb 19, 2019
.gitignore change name to tf, bump version to 0.3.0 May 28, 2012
.travis.yml Update tf for compatibility with new Gems and Rubies (#9) Feb 19, 2019
CHANGELOG.md Update tf for compatibility with new Gems and Rubies (#9) Feb 19, 2019
Gemfile
LICENSE Update tf for compatibility with new Gems and Rubies (#9) Feb 19, 2019
README.md Update tf for compatibility with new Gems and Rubies (#9) Feb 19, 2019
tf.gemspec

README.md

Testing Framework Code Climate Build Status

TF is a pluggable framework for testing shell scripts (at least now). TF also is an umbrella which incorporates (eventually) multiple gems, each of which provides additional functionality to TF. TF is the skeleton upon which all other tf-* gems build.

Usage

$ gem install tf
$ tf <path/to/file>_comment_test.sh
$ tf --text <path/to/file>_comment_test.sh

Comment tests

Filename has to end with _comment_test.sh

Example test file:

## User comments start with double #
## command can be written in one line with multiple tests:
true # status=0; match=/^$/
## or tests can be placed in following lines:
false
# status=1

Matchers

The test can be negated by replacing = with !=

  • status= - check if command returned given status (0 is success)
  • match=// - regexp match command output both stdout and stderr
  • match[stdout|stderr]=// - regexp match command either stdout or stderr
  • env[<var_name>]=~// - regexp match the given environment variable name
  • env[<var_name>]?=[array|string|nil] - verify type of the given environment variable name
  • env[<var_name>][]= - verify size of the given environment variable name
  • env[<var_name>][]=// - regexp match all of elements of the given environment variable name
  • env[<var_name>][]=// - regexp match given element of the given environment variable name

Selecting shell / runner program

From version 0.3.1 Shebang lines are read and interpreted to select the runner shell. Still only Bash / ZSH like shells are allowed.

Example

$ bin/tf example_tests/comment/*
F..
##### Processed commands 2 of 2, success tests 2 of 3, failure tests 1 of 3.
$ false
# failed: status = 0 # was 1

$ bin/tf example_tests/comment/* --text
##### starting test failure.
$ false
# failed: status = 0 # was 1
##### starting test success.
$ true
# passed: status = 0
# passed: status != 1
##### Processed commands 2 of 2, success tests 2 of 3, failure tests 1 of 3.

Troubleshooting

Use environment variable TF_DEBUG to enable additional logging:

TF_DEBUG=1 tf --text  example_tests/comment/*

Internal architecture

Framework will load plugins from any available gem and local lib/ path, for example:

lib/plugins/tf/text_output.rb
lib/plugins/tf/status_test.rb
lib/plugins/tf/comment_test_input.rb

The search pattern is:

lib/plugins/tf/*.rb

And plugins are selected with:

lib/plugins/tf/*_{input,test,output}.rb

Thanks

  • Deryl R. Doucette