Skip to content

Speed Up CI Smoke Tests #4947

@ghost

Description

We have currently some scripts that allows to locally run test in parallels. It is based on diving our tests to run in clusters
https://github.com/quarto-dev/quarto-cli/blob/main/tests/run-parallel-tests.ts

We should be able to leverage this to create buckets of tests to run, and then use some parallel jobs in CI (using matrix of tests to run) with GHA.

Other context based on initial pre work research

Default runners on GHA are 2-cores so limited but concurrent Job is possible, and the limit depends on the Free or paid plan

  • With Free, it is 20 concurrent jobs
  • With Enterprise, it will be up-to 500
  • Pro and Team plans are in between

This will cover jobs in a workflow or across workflows

However, currently in beta for Team or Enterprise plan, there is now an offer of larger runnerswith max being 64 cores - which would allow us to run parellel tests as on local computer.

So I think Github Action can have what we need, but maybe not enough without full Paid plan.

Metadata

Metadata

Assignees

Labels

buildsepicAn issue that contains other issues

Type

No type

Projects

No projects

Milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions