Skip to content

Latest commit

History

History
48 lines (32 loc) 路 1.04 KB

CONFORMANCE_TESTS.md

File metadata and controls

48 lines (32 loc) 路 1.04 KB

Common workflow language conformance test suite

The conformance tests are intended to test feature coverage of a CWL implementation. It uses the module "cwltool.cwltest" from the cwltool reference implementation.

Usage

$ ./run_test.sh
--- Running conformance test draft-3 on cwl-runner ---
Test [49/49]
All tests passed

By default, run_test.sh will test cwl-runner in $PATH against the current stable CWL draft.

Options

RUNNER=other-cwl-runner

The CWL implementation to be tested.

DRAFT=draft-N

The CWL draft to be tested.

-nN

Run a single specific test number N.

For example, to run conformance test 15 of draft-2 against the "cwltool" reference implementation:

$ ./run_test.sh RUNNER=cwltool DRAFT=draft-2 -n15
Test [15/49]
All tests passed

Notes

NOTE: For running on OSX systems, you'll need to install coreutils via brew. This will add to your system some needed GNU-like tools like greadlink.

  1. If you haven't already, install brew package manager in your mac
  2. Run brew install coreutils