This is Leaptest Integration plugin for TestRail
Leaptest is a mighty automation testing system and now it can be used for running test runs (step case type only) in Testrail from version 4.x. Tested on version 5.4.0.3659 You can easily configure integration directly in TestRail enjoying UI friendly configuration page with easy connection and schedule selection.
- Put files leaptest.php and TestRailsCMD.jar to TestRail root folder - the same folder where you can find index.php
- Administration => Customizations => UI scripts => Add Script => Clear script text area => Copy all the text from Leaptest customization UI script.txt to script text area => Activate script => Save UI Script
- If your TestRail uses Windows IIS, please provide IIS_USERS permissions for executing, creating, writing and reading files in TestRail root folder (where index.php). The same should be done for Unix/Linux systems if required. File "leaptest.php" executes "TestRailsCMD.jar", which creates/modifies log files. Each test run creates/modifies its own log file during execution.
- Prepare a schedule to run in Leaptest, add cases and environments to it.
- Create a TestRail case with STEPS. The TestRail case name MUST match a Leaptest case name in the schedule. Add as many steps for your case as your schedule has environments. Your case MUST have a step per schedule environment (Screenshot 1).
- Create TestRail test run with the same cases as Leaptest schedule has (Screenshot 2).
- Press the button "Select Schedule". Leaptest integration dialog will open (Screenshot 3).
- Enter Leaptest controller URL like http://{hostname}:9000
- Press the button "Get Projects and Schedules". Project select menu will get all projects, and Schedule select menu will get all schedules of the selected project.
- Select the schedule you've prepared.
- Enter the time delay parameter in seconds. When the schedule is running, the plugin waits for this time and then asks Leaptest controller for schedule state. If the schedule is still running, the plugin will wait again. If you run cases that are executed within minutes or hours, it's better to set this parameter value equivalent to some minutes, for example 600 for 10 minutes interval.
- Select how cases with "done" status should be interpreted.
- Enter TestRail URL, you can find it in Administartion => Site Settings => Web Address (Screenshot 4).
- Enter your Login.
- Enter your password.
- TestRail URL, login and password are required for TestRail API to set results.
- Press the button "Run Schedule".
- The schedule is running in the background and the results are automatically posted back to TestRail. To see them simply open/reload page with test run.
- Enjoy.
- Each run has its own log file. You can find it in the folder with TestRailsCMD.jar
Leaptest case keyframes are set in TestRail actual results
If non-step TestRail case is used, you'll get the next message in test comments, and Test status is set to RETEST
If schedule run is cancelled, you'll get the next message in test comments, and Test status is set to RETEST
If schedule could not connect to environment, step status is set to RETEST
If number of environments and steps are not equal, you'll get the next message
