UI tests: POC to execute parallel tests

[noeliaSD]

Description

Investigate and create a proof of concept that allows us to parallelize test execution, locally but with the main goal focused on CI.

[squ1sher]

I would split tasks:

1. setup new 2 QA machines (Linux) to use for automation testing only

• setup screen resolution 1920*1080
• install git, git-lfs
• install python 3.10
• install Squish
• install Squish-tesseract
• setup Squish to use installed python
• setup Jenkins agent

3. Prepare QA Jenkins job:

• select the product branch (master by default)
• build link (field for a link)

4. Link job where product builds with QA job, and run it for just built app
5. Prepare tests in pytest formate for wallet tests:

• example here: https://github.com/status-im/status-desktop/tree/refactor/10093-squish-pytest

6. explore the possibility to run test for download build
7. test Virtual Boxes to run tests in parallel
8. run the test form CI

[anastasiyaig]

additional machines tasks is there https://github.com/status-im/infra-ci/issues/85

[squ1sher]

Stage 6:
For downloaded build tests can be executed:

• linux - any squish versions
• mac:
  Package Name: squish-7.1-20230328-1608-qt515x-mac
  Internal Name: /home/autotest/public_html/binpackages/2023/03/28-1608/bin_package/7.1/qt/Desy-Qt5.15.9binary-TkNone-iOSNone-gcc42uni-e480fdb
  Git Branch: 7.1
  Git Revision: 3c9a3a7ca0410d7e7f8d7e90b1066c733171d313

Python Version: default
Patched: False
Debug Build: False
Debug Symbols: False
Pure Qt4 Build: False
Include IDE: True

Python 2:
Python 3: /Users/autotest/binPackage/universal/Python/3.10.6
Tcl:
Perl: /Users/autotest/binPackage/universal/Perl/5.34.0
Ruby: /Users/autotest/binPackage/x64/ruby/2.5.3

To start tests you need:

1. Add application path in suite AUT settings (Mapped AUTs)
2. Add path to the application in environment variables (AUT_PATH: '/Users/idrusch/Downloads/Status') or add it in configs as a default value /Users/idrusch/Downloads/Status'](https://github.com/status-im/status-desktop/blob/master/test/ui-test/src/configs/path.py#L8)

[squ1sher]

Stage 5:
These tests were adopted to pytest:

• test_one_to_one_chat
• test_search_and_set_language
• test_add_contact_with_chat_key
• test_backup_seed_phrase

For all Wallet suite, I need more time, but I think for the presentation we have enough tests

[squ1sher]

Stage 7 is Done
https://github.com/status-im/status-desktop/tree/refactor/10093-squish-pytest

Screencast.from.16.06.2023.21.04.29.webm