Home
Test Reporty Thing (trt) is a web application for recording automated test executions, viewing reports on the results, and diagnosing failures.
Latest release: https://github.com/thetestpeople/trt/releases/tag/v0.8.0
Installation and Configuration
| Configurations | Tests | Test Case |
|---|---|---|
 |
 |
 |
- Import test results from Jenkins, Hudson or TeamCity, or submit them via a REST API.
- Browse test results over time and view summary reports and charts.
- Full text search over test logs.
- Test failure analysis to minimise impact of intermittent failures.
- Trigger selected test re-execution on Jenkins.
Automated end-to-end tests can often suffer from spurious intermittent failures (caused by brittleness in the tests, bugs in the tools being used, environment instability, and so on). Although ideally all these issues should be eliminated, in practice it is often difficult to do so completely. It can be very time-consuming to investigate test failures to identify any genuine regressions.
trt attempts to mitigate the impact of intermittently failing tests by classifying tests into one of three statuses: Healthy, Broken and Warning. Tests that have only failed once or twice, and only over a short period of time, are classified as a Warning, whereas tests that have failed multiple times, over a longer period of time, are classified as Broken. Broken tests can then be investigated with confidence that they are real, repeatable issues. This is a more nuanced classification than just "pass or fail" that allows less time to be spent distinguishing spurious test failures from genuine issues.