Skip to content

Conversation

@ben-c-at-moz
Copy link
Collaborator

@ben-c-at-moz ben-c-at-moz commented Nov 24, 2025

Relevant Links

Bugzilla: link

Description of Code / Doc Changes

  • Change the CI flow so that "Smoke" is not equivalent to "STARfox" (Linux flow can stay "smoke" for incident testing)
  • Add GHA flow for functional testing
  • Add manifest for functional and "all.yaml" for all tests, remove functional tests from smoke.yaml
  • Update chooser script to avoid running unstable tests when manifest not provided
  • Create unique Plan names for functional executions in TestRail

Process Changes Required

Mark the relevant boxes:

  • Changes CI flow
  • Changes scheduled Beta or DevEdition

Screenshots or Explanations

If you need to explain your code, do it here.

Comments or Future Work

  • Audit the yaml files for correctness
  • Create an automated flow to add tests to the appropriate yaml files when created.

Workflow Checklist

  • Please request reviewers
  • If this is an unblocker, please post in Slack.

Thank you!

Copy link
Collaborator

@Tracy-Walker Tracy-Walker left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm

@ben-c-at-moz ben-c-at-moz changed the title IGNORE Ben/functional ci Functional CI Nov 25, 2025
@ben-c-at-moz ben-c-at-moz merged commit ddd7021 into main Nov 25, 2025
15 checks passed
@ben-c-at-moz ben-c-at-moz deleted the ben/functional-ci branch November 25, 2025 22:21
ben-c-at-moz added a commit that referenced this pull request Dec 2, 2025
* modify workflows to allow non-smoke test sets

* missed some name changes

* missed some name changes

* missed some name changes

* missed some name changes

* missed some name changes

* missed some name changes

* missed some name changes

* pwsh

* debug win flow

* debug win flow

* add manifests for all and functional

* add functional flow

* filter chosen tests by key.yaml

* fix missing extensions
ben-c-at-moz added a commit that referenced this pull request Dec 2, 2025
* lint

* Ben/new manifests (#897)

* read manifests in chooser script

* update CI beta flows to take manifests

* typo

* read manifests in chooser script

* update CI beta flows to take manifests

* typo

* attempt to correctly choose tests for win / linux

* switch conftest version gathering from fixture

* debug manifests not respected in mac/lin ci

* debug manifests not respected in mac/lin ci

* debug manifests not respected in mac/lin ci

* debug manifests not respected in mac/lin ci

* mark certain incident tests unstable

* incident manifest

* remove unnecessary incident test

* add manifest maker, change chooser to manifests / git logic only

* remove unstable mark and rely on manifests

* single source of pass/fail truth

* update manifest key; chooser defaults out to a manifest

* lint

* all -> smoke as default manifest

* update manifest key; return win to explicit gecko

* update manifest key; return win to explicit gecko

* update manifest key; return win to explicit gecko

* update manifest key; return win to explicit gecko

* update manifest key; return win to explicit gecko

* README

* README

* mark test unstable

* Functional CI (#910)

* modify workflows to allow non-smoke test sets

* missed some name changes

* missed some name changes

* missed some name changes

* missed some name changes

* missed some name changes

* missed some name changes

* missed some name changes

* pwsh

* debug win flow

* debug win flow

* add manifests for all and functional

* add functional flow

* filter chosen tests by key.yaml

* fix missing extensions

* Ben/tc and win fix (#914)

* revert to using old version, but check that it's valid

* revert to using old version, but check that it's valid

* fix tc for manifests

* other cleanup

* lint

* fit new system into CI

* githooks + docs
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants