Ben/new manifests

[ben-c-at-moz]

Relevant Links

Bugzilla

Description of Code / Doc Changes

• Modify choose_ci_set to read manifests if set in STARFOX_MANIFEST env var
• Create manifests for CI and incident
• Modify GHA pipeline to run incident manifest on manual execution
• Rider: change the way we gather firefox version
• Lint

Process Changes Required

Mark the relevant boxes:

• Changes CI flow

Screenshots or Explanations

YAML schemas that are valid:

• suite

  • test: status

• suite

  • test
    • os1: status
    • os2: other_status

• suite

  • test
    • subtest: status

• suite

  • test
    • subtest
      • os1: status
      • os2: other_status

Comments or Future Work

• A script to generate new manifests
• Implementing a smoke manifest / functional manifests (rotations)
• Wiring the smoke and functional manifests into the scheduled runs
• Ensuring changes to how we gather version in conftest don't break scheduled runs

Workflow Checklist

• Please request reviewers
• If this is an unblocker, please post in Slack.
• If asked to address comments, please resolve conversations.
• If asked to change code, please re-request review from the person who wanted changes.

Thank you!

[Tracy-Walker]

comment completion and conflict heads up. otherwise looks good.

[Tracy-Walker]

let's go