JUnit compatible XML reporter for QUnit
This plugin produces XML reports for all QUnit tests that you run with grunt. The XML reports match those created by JUnit and are perfect for loading into Jenkins.
This plugin only works with grunt 0.4.x. If you are using 0.3.x, then I recommend the grunt-junit plugin.
If you haven't used grunt before, be sure to check out the Getting Started guide.
WARNING: This plugin is only released in beta form! It should work pretty well though, so please give it a go and pass any issues you find back to me. I'd also be interested to hear how you use QUnit in you project and if there are any helpful features I can add to this plugin.
From the same directory as your project's Gruntfile and package.json, install this plugin with the following command:
npm install grunt-qunit-junit --save-dev
Once that's done, add this line to your project's Gruntfile:
grunt.loadNpmTasks('grunt-qunit-junit');
If the plugin has been installed correctly, running grunt --help
at the command line should list the newly-installed plugin's task, qunit_junit
. In addition, the plugin should be listed in package.json as a devDependency
, which ensures that it will be installed whenever the npm install
command is run.
In your project's Gruntfile, add a section named qunit_junit
to the data object passed into grunt.initConfig()
.
grunt.initConfig({
qunit_junit: {
options: {
// Task-specific options go here.
}
},
})
Type: String
Default value: '_build/test-reports'
Specify where the XML reports should be saved to.
Type: Function
Default value: path.basename(url).replace(/\.html$/, '')
Specify a function that converts test URLs into dot-separated classnames. The classname for each test is used to build the report's filename and is placed inside the XML reports themselves.
The resulting values should represent full classpaths as you might see in Java, such as my.example.package.someFile
or com.example.coolthings.Sorter
; the main restriction is that folders or packages must be separated by dots. These enable tools such as Jenkins to group the tests and provide an interface to drill down into the results.
The default implementation takes the final part of the URL and strips .html
from it. If you have nested folder structures then I suggest you override this option.
For example, if you have test URLs of the form http://localhost:8000/test/runner.html?test=example/Adder
, then you could use the following:
qunit_junit: {
options: {
namer: function (url) {
var match = url.match(/test=(.*)$/);
return match[1].replace(/\//g, '.');
}
}
}
To trigger the XML reporting, simply call the qunit_junit
task before you call the qunit
task. A report will be created for all tests run by QUnit.
Typically, you'll use it as part of a list of commands like this:
grunt.registerTask('test', ['connect:server', 'qunit_junit', 'qunit']);
If you call the qunit_junit
task again, then the existing reporter will be detached and the new one will report in its place.
The following report is an example of a test class that was composed of 3 tests, one of which had a failure. The classname
attribute is built from the path and name of the test file, and the QUnit module names are added to the name
attribute.
<?xml version="1.0" encoding="UTF-8"?>
<testsuites>
<testsuite name="example.package.TestClass" errors="1" failures="1" tests="3" time="0.04">
<testcase classname="example.package.TestClass" name="My module: First test" assertions="1" time="0.01">
</testcase>
<testcase classname="example.package.TestClass" name="My module: Second test" assertions="2" time="0.02">
</testcase>
<testcase classname="example.package.TestClass" name="My module: Third test" assertions="2" time="0.01">
<error type="failed" message="Died on test #1: Can't find variable: other">
at http://localhost:8000/vendor/qunit-1.12.0.js:425
at http://localhost:8000/test/example/package/TestClass.test.js:29
</error>
<failure type="failed" message="Expected 2 assertions, but 1 were run">
</failure>
</testcase>
</testsuite>
</testsuites>
Additionally, if a test run fails completely a report of the following form will be generated:
<?xml version="1.0" encoding="UTF-8"?>
<testsuites>
<testsuite name="example.AnotherClass" errors="1" failures="0" tests="1">
<testcase classname="example.AnotherClass" name="main" assertions="1">
<error type="timeout" message="Test timed out, possibly due to a missing QUnit.start() call."></error>
</testcase>
</testsuite>
</testsuites>
In lieu of a formal styleguide, take care to maintain the existing coding style. Add unit tests for any new or changed functionality. Lint and test your code using grunt.
- 0.1.0 is available for general use.
- 0.1.1 added time attribute to output with dummy value, to aid compatibility
- 0.2.0 updated
grunt-contrib-qunit
to 0.5.2 to report actual test durations.