The conformance tests are intended to test feature coverage of a CWL implementation. It uses the module "cwltool.cwltest" from the cwltool reference implementation.
$ ./run_test.sh
--- Running conformance test draft-3 on cwl-runner ---
Test [49/49]
All tests passed
By default, run_test.sh
will test cwl-runner
in $PATH against the current
stable CWL draft.
RUNNER=other-cwl-runner
The CWL implementation to be tested.
DRAFT=draft-N
The CWL draft to be tested.
-nN
Run a single specific test number N.
For example, to run conformance test 15 of draft-2 against the "cwltool" reference implementation:
$ ./run_test.sh RUNNER=cwltool DRAFT=draft-2 -n15
Test [15/49]
All tests passed
NOTE: For running on OSX systems, you'll need to install coreutils via brew. This will add to your
system some needed GNU-like tools like greadlink
.
- If you haven't already, install brew package manager in your mac
- Run
brew install coreutils