Thanks for running the WordPress PHPUnit test suite on your infrastructure. We appreciate you helping to ensure WordPress’ compatibility for your users.
If you haven't already, please first read through the "Getting Started" documentation.
The test suite runner is designed to be used without any file modification. Configuration happens with a series of environment variables (see .env.default for an annotated overview). Use the repository wiki to document implementation details, to avoid README conflicts with the upstream.
At a high level, the test suite runner:
- Prepares the test environment for the test suite.
- Runs the PHPUnit tests in the test environment.
- Reports the PHPUnit test results to WordPress.org
- Cleans up the test suite environment.
The test suite runner can be used in one of two ways:
- With Travis (or Circle or some other CI service) as the controller that connects to the remote test environment.
- With the runner cloned to and run directly within the test environment.
The test runner is configured through environment variables, documented in
.env.default. It shouldn't need any code modifications; in fact, please refrain from editing the scripts entirely, as it will make it easier to stay up to date.
With a direct Git clone, you can:
# Copy the default .env file. cp .env.default .env # Edit the .env file to define your variables. vim .env # Load your variables into scope. source .env
In a CI service, you can set these environment variables through the service's web console. Importantly, the
WPT_SSH_CONNECT environment variable determines whether the test suite is run locally or against a remote environment.
Concurrently run tests in the same environment by appending build ids to the test directory and table prefix:
export WPT_TEST_DIR=wp-test-runner-$TRAVIS_BUILD_NUMBER export WPT_TABLE_PREFIX=wptests_$TRAVIS_BUILD_NUMBER\_
Connect to a remote environment over SSH by having the CI job provision the SSH key:
# 1. Create a SSH key pair for the controller to use ssh-keygen -t rsa -b 4096 -C "email@example.com" # 2. base64 encode the private key for use with the environment variable cat ~/.ssh/id_rsa | base64 --wrap=0 # 3. Append id_rsa.pub to authorized_keys so the CI service can SSH in cat ~/.ssh/id_rsa.pub >> ~/.ssh/authorized_keys
Use a more complex SSH connection process by creating a SSH alias:
# 1. Add the following to ~/.ssh/config to create a 'wpt' alias Host wpt Hostname 18.104.22.168 User wpt Port 1234 # 2. Use 'wpt' wherever you might normally use a SSH connection string ssh wpt
The test suite runner is run in four steps.
Both the prep and test environments must meet some basic requirements.
- PHP 5.6 or greater (to run scripts).
gitversion 1.8.5 or greater,
- Node.js including
- PHP 5.6 or greater with Phar support enabled (for PHPUnit).
- MySQL or MariaDB with access to a writable database.
- Writable filesystem for the entire test directory (see #40910).
- Run with a non-root user, both for security and practical purposes (see #44233/#46577).
- Extracts the base64-encoded SSH private key, if necessary.
- Clones the master branch of the WordPress develop git repo into the preparation directory.
phpunit.pharto the preparation directory.
wp-tests-config.phpand puts it into the preparation directory.
- Delivers the prepared test directory to the test environment.
php phpunit.pharto produce
- Processes PHPUnit XML log into a JSON blob.
- Sends the JSON to WordPress.org.
- Resets the database.
- Deletes all files delivered to the test environment.
See LICENSE for project license.