type=page status=published title=Executing Tests next=debug.html prev=config.html ~~ attributes.conf Executing Tests
5 Executing Tests
The {TechnologyShortName} TCK uses the JavaTest harness to execute the
tests in the test suite. For detailed instructions that explain how to
run and use JavaTest, see the JavaTest User's Guide and Reference in
the documentation bundle.
This chapter includes the following topics:
* link:#GBFUZ[Starting the tests]
* link:#GBFWM[Running a Subset of the Tests]
* link:#GCLRR[Running the TCK Against your selected CI]
* link:#GCLRZ[Running the TCK Against a Vendor's Implementation]
* link:#GBFVK[Test Reports]
[NOTE]
=======================================================================
The instructions in this chapter assume that you have installed and
configured your test environment as described in
link:install.html#GBFTP[Chapter 3, "Installation,"] and
link:config.html#GBFVV[Chapter 4, "Setup and Configuration,"],
respectively.
=======================================================================
[[GBFUZ]][[starting-javatest]]
5.1 Starting the tests
~~~~~~~~~~~~~~~~~~~~~~
Run the {TechnologyShortName} TCK from the command line in your shell environment
[NOTE]
=======================================================================
The `mvn` command referenced in the following
two procedures and elsewhere in this guide is the Apache Maven
build tool, which will need to be downloaded separately.
=======================================================================
[[GBFVW]][[to-start-javatest-in-command-line-mode]]
5.1.1 To Start the tests in Command-Line Mode
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
link:using-examples.inc[role=include]
[[GBFWM]][[running-a-subset-of-the-tests]]
5.2 Running a Subset of the Tests
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Use the following modes to run a subset of the tests:
* link:#GBFWK[Section 5.2.1, "To Run a Subset of Tests in Command-Line Mode"]
[[GBFWK]][[to-run-a-subset-of-tests-in-command-line-mode]]
5.2.1 To Run a Subset of Tests in Command-Line Mode
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
1. Change to the directory containing the tests you want to run.
2. Start the test run by executing the following command: +
+
[source]
----
mvn clean install
----
+
The tests in the directory and its subdirectories are run.
[[GCLRR]][[running-the-tck-against-the-ri]]
5.3 Running the TCK Against another CI
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Some test scenarios are designed to ensure that the configuration and deployment of
all the prebuilt {TechnologyShortName} TCK tests against one Compatible
Implementation are successful operating with other compatible implementations, and that the TCK is ready for
compatibility testing against the Vendor and Compatible Implementations.
1. Verify that you have followed the configuration instructions in
link:config.html#GBFVU[Section 4.1, "Configuring Your Environment to Run
the TCK Against the Compatible Implementation."]
2. If required, verify that you have completed the steps in
link:config.html#GCLIW[Section 4.3.2, "Deploying the Prebuilt Archives."]
3. Run the tests, as described in link:#GBFUZ[Section 5.1, "Starting
the tests,"] and, if desired, link:#GBFWM[Section 5.2, "Running a Subset
of the Tests."]
[[GCLRZ]][[running-the-tck-against-a-vendors-implementation]]
5.4 Running the TCK Against a Vendor's Implementation
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
This test scenario is one of the compatibility test phases that all
Vendors must pass.
1. Verify that you have followed the configuration instructions in
link:config.html#GCLHU[Section 4.2, "Configuring Your Environment to
Repackage and Run the TCK Against the Vendor Implementation."]
2. If required, verify that you have completed the steps in
link:config.html#GCLIL[Section 4.3.3, "Deploying the
Test Applications Against the Vendor Implementation."]
3. Run the tests, as described in link:#GBFUZ[Section 5.1, "Starting
the tests,"] and, if desired, link:#GBFWM[Section 5.2, "Running a Subset
of the Tests."]
link:using.inc[role=include]