Dividing and running the tests parallel.

[amit-thorat]

Hi Team Marathon, I'm trying to integrate the marathon for our project. We have around 6500 UI tests, our current implementation takes around 2 hours to run all test with 4 devices connected.
We are using composer lib do this job. The tests divides into 4 groups and runs simultaneously. e.g. 1625 tests on each device.
I want to achieve the same thing with marathon. Please help, from documentation I didn't understand much.
Also suggest the ways to run the tests faster.
Thanks!

[austyh]

Hi @amit-thorat !
Are you asking about cloud version or about OSS?

[amit-thorat]

Hi @austyh, I installed CLI tool running tests on local machine

[austyh]

I am not sure about the details, but if we are talking about CLI it is used for Marathon Cloud only. You need to install marathon runner instead.
You can ask questions about setting up marathon runner in our telegram channel - https://t.me/marathontestrunner

[Malinskiy]

At the scale of where you are (around 8 hours of tests for each test run), you have two options:

• hire people to support internal infrastructure and the software to orchestrate the test runs. It is one thing to run tests on a couple of devices it's completely different one to run thousands of devices at scale. Marathon OSS test runner can help you, but it's not a full solution by any means and requires expertise in many different areas outside of mobile (i.e. Linux kernel, virtualization, networking, statistical analysis to name a few) to achieve a stable pipeline for verification
  or
• outsource the problem of executing your test runs by buying external products out of several options on the market (i.e. Amazon's DeviceFarm, Google's Firebase Test Lab, emulator.wtf and of course our solution Marathon Cloud)

[Malinskiy]

As for running in parallel with marathon OSS - you don't need to split your tests in any way. Just provide the apk to marathon, connect all your devices to the same instance and default configuration will automatically rebalance everything between all healthy devices.

[amit-thorat]

Hi @Malinskiy/ @austyh , sorry for initial confusion, I'm using Marathon OSS. I need some help with below queries,

• I see the test name too long for lot of tests, is there any way to disable that check
• Marathon records video of every test run. How to disable it.

Thanks!

[Malinskiy]

Please refer to documentation https://docs.marathonlabs.io/runner/intro/configure#max-file-path and https://docs.marathonlabs.io/runner/intro/configure#screen-recording-policy