Applying reference test results to your pull request

When you modify ASPECT in a pull request in a way that causes the results of some of our test cases to change, you will sometimes need to update the reference tester results in your repository before a pull request can be merged.

The reference tester will create a filed called changes-test-results.diff which you can download and apply to your local folder to update the results. The procedure is slightly different for the Jenkins CI tester and our Github actions workflow (both are available for you and will equally work).

1. Jenkins: Click on 'Details' next to jenkins.tjhei.info/pr-merge below your pull request. The artifact file can be found in the Artifacts tab of the Jenskins website that opens.
2. Github Actions: Click on 'Details' next to linux / tests (pull_request) below your pull request. The artifact file can be found at the bottom of the Summary tab of the Github actions website that opens.

Download either of those files (unpack the zip file from github actions if you followed 2), and apply them by using git apply changes-test-results.diff in your ASPECT source directory.

For a detailed description of ASPECT's test suite see this section in our manual.