Setup continuous tests with Jenkins
Jenkins is a CI (continuous integration) and CD (continuous delivery) software that builds software in a concise repeatable way.
The Allure project has created a plugin for Jenkins that simplifies the report handling and enables the trend history generation for the recent builds.
In order to use that plugin you need to install it first. Log into Jenkins as an administrator and navigate to the "Manage Plugins" page.
Click then the "Available" tab, search for the "Allure Jenkins Plugin" and install it. Do the same for the "Xvfb plugin" if you want to run browser based tests on the machine that also hosts Jenkins.
After that you need to configure the new installed plugin(s).
Important: Allure plugin version is not matching the version of Allure Commandline tool that will be used to generate report after test. Beginning from Neodymium v5.0.0 the minimal version of Allure Commandline should be 2.27.0. Please, configure this version in the Manage Jenkins > Tools like on the image below:
NOTE: Since Xvfb is system specific we can not provide an installation guide for that.
by following these instructions.
After that you can add a post build action that will create the report. The plugin will access former builds in order to acquire the data that is necessary to create a trending graph like in the screenshot above.
There are different options to get web driver based tests running with Jenkins.
In order to get web driver based tests running with Jenkins, the build system needs either a (local) web driver and frame buffer setup in order to render a browser or your browser configuration needs to refer a Selenium grid. In that case the browser itself runs on a different host and will be remote controlled with Selenium.
Web driver and browser can be installed on the Jenkins machine locally just like on any other machine that you use e.g. for tests development. Please read more about it here.
Note: if you need your tests to be executed in non-headless mode, you will need the Xvfb plugin mentioned above. In case headless mode is enough for your purposes, this plugin is not required.
Selenium doesn't only work with local browsers it also is able to remote control a browser via web driver interface of the wire. In order to get that running read the Selenium grid
In case your tests only use Chrome as a driver (remote Selenium grid is not taken in account as it doesn't require any driver or browser installed) you can use markhobson/maven-chrome:jdk-17 docker image to execute the tests. Jenkins offers Docker Pipeline plugin that can run all the job steps inside docker container and then map the results back to Jenkins workspace.
If you choose this option to configure your CI/CD with Jenkins, you will need to define the following pipeline:
pipeline {
agent any
stages {
stage('Build & Run Test') {
agent {
docker { image 'markhobson/maven-chrome:jdk-17' }
}
stages {
stage('Checkout project') {
steps {
git branch: 'master',
credentialsId: 'github',
url: 'git@github.com:Xceptance/neodymium-template.git'
}
}
stage('execute tests') {
steps{
script {
try {
sh 'mvn clean test'
stash name: 'allure-results', includes: 'target/allure-results/*'
currentBuild.result = 'SUCCESS'
} catch (e) {
stash name: 'allure-results', includes: 'target/allure-results/*'
currentBuild.result = 'FAILED'
throw e
}
}
}
}
}
}
}
post {
always {
unstash 'allure-results' //extract results
script {
allure([
includeProperties: false,
jdk: '',
properties: [],
reportBuildPolicy: 'ALWAYS',
results: [[path: 'target/allure-results']]
])
}
}
}
}
When Jenkins Jobs are aborted, it sends a TERM signal so each process. Unfortunately, Neodymium cannot properly kill remaining web drivers as well as open browsers. This clean up has to be done manually.
If you have no parallel executions, you may use the following code to kill Firefox and Chrome instances as well as their corresponding web drivers:
#!/bin/bash
function killWebDriversAndBrowser()
{
# Kill Web Drivers
ps --ppid=1 | awk '/(gecko|chrome)driver/ { print $1 }' | xargs kill -9
# Kill Firefox
pkill -9 -f -e firefox
# Kill Chrome
pkill -9 -f -e chrome
}
trap killWebDriversAndBrowser EXITFeel free to adapt the script to your web drivers as well as browsers.