Add support for release-promotion (new system for releases)

[whimboo]

Bug 1118794 is the tracking bug for the new release promotion system for release builds. Mainly @rail is working on it. Together with him we have to find a way to listen for specific builds (en-US and locale repacks), so we can trigger our functional tests for releases.

Via bug 1253369 we are collecting ideas for possible routing keys of Mozilla Pulse messages. Until this has not been clarified this issue is blocked on it.

[whimboo]

So RelEng turned on Release Promotion for the latest Firefox 46.0b1 candidate builds. As result our automation didn't process any of those builds due to change Mozilla Pulse notifications. Sadly we were not able to run any tests with Release Promotion ahead of time. :(

@KaiRo-at if QA wants to have results of our functional tests, you will have to trigger an ondemand_functional testrun for all the platforms and locales you are interested in.

So what we would need to get this fixed are two different Pulse listeners. One for en-US builds and another one for the locale repacks.

L10n repacks

This could rely on routing keys as send from TC like index.releases.v1.mozilla-beta.latest.firefox.latest.l10n.linux.#. Whereby I'm not sure if the builds would be already uploaded to the candidates folder at this step. @rail can you please clarify? IMHO we might have to wait for the beetmover tasks too which would be this task and produce routing keys like: index.releases.v1.mozilla-beta.latest.firefox.latest.beetmover.3.linux.

en-US builds

This is not that easy given that RelEng does no longer produce those builds. Instead they will be picked up from the last green build on mozilla-beta, and repacked for a release build. What we would need is a message when this build is available under the candidates folder. @rail mentioned beetmover tasks to me yesterday and as it looks like we want routing keys like index.releases.v1.mozilla-beta.latest.firefox.latest.beetmover.en_US.linux from this task.

Sadly all the beetmover tasks do not have any property.json file attached which we could use to identify the locales, branch, platform, version, and revision to test.

@rail can you please tell us more details?

[whimboo]

So RelEng turned on Release Promotion for the latest Firefox 46.0b1 candidate builds. As result our automation didn't process any of those builds due to change Mozilla Pulse notifications. Sadly we were not able to run any tests with Release Promotion ahead of time. :(

@KaiRo-at if QA wants to have results of our functional tests, you will have to trigger an ondemand_functional testrun for all the platforms and locales you are interested in.

So what we would need to get this fixed are two different Pulse listeners. One for en-US builds and another one for the locale repacks.

L10n repacks

This could rely on routing keys as send from TC like index.releases.v1.mozilla-beta.latest.firefox.latest.l10n.linux.#. Whereby I'm not sure if the builds would be already uploaded to the candidates folder at this step. @rail can you please clarify? IMHO we might have to wait for the beetmover tasks too which would be this task and produce routing keys like: index.releases.v1.mozilla-beta.latest.firefox.latest.beetmover.3.linux.

en-US builds

This is not that easy given that RelEng does no longer produce those builds. Instead they will be picked up from the last green build on mozilla-beta, and repacked for a release build. What we would need is a message when this build is available under the candidates folder. @rail mentioned beetmover tasks to me yesterday and as it looks like we want routing keys like index.releases.v1.mozilla-beta.latest.firefox.latest.beetmover.en_US.linux from this task.

Sadly all the beetmover tasks do not have any property.json file attached which we could use to identify the locales, branch, platform, version, and revision to test.

@rail can you please tell us more details?

[whimboo]

Just to update for beta releases on mozilla-beta you can find appropriate taskcluster tasks with the following filter set:

https://treeherder.allizom.org/#/jobs?repo=mozilla-beta&filter-searchStr=release&filter-tier=1&filter-tier=2&filter-tier=3&exclusion_profile=false&selectedJob=676273

Then just look for tasks in the Release group, and click on inspect Task. Via the link to the task graph you will find all necessary tasks for the specific release promotion task graph.

[whimboo]

Just to update for beta releases on mozilla-beta you can find appropriate taskcluster tasks with the following filter set:

https://treeherder.allizom.org/#/jobs?repo=mozilla-beta&filter-searchStr=release&filter-tier=1&filter-tier=2&filter-tier=3&exclusion_profile=false&selectedJob=676273

Then just look for tasks in the Release group, and click on inspect Task. Via the link to the task graph you will find all necessary tasks for the specific release promotion task graph.

[whimboo]

So there is actually an ongoing discussion on bug 1253369. So we should have it at a single place and I will paste my remaining questions over there.

[whimboo]

So there is actually an ongoing discussion on bug 1253369. So we should have it at a single place and I will paste my remaining questions over there.

[whimboo]

@rail and I will work on a solution so we can have mozmill-ci working with release promotion for 46.0b2.

[whimboo]

@rail and I will work on a solution so we can have mozmill-ci working with release promotion for 46.0b2.

[whimboo]

I got everything working locally now. Doing clean-up as next step and a PR should be up soon.

[whimboo]

I got everything working locally now. Doing clean-up as next step and a PR should be up soon.

[whimboo]

Here an example job for es-ES as fetched from the release promotion messages:
https://treeherder.allizom.org/#/jobs?repo=mozilla-beta&revision=5904e3eb711d&filter-searchStr=firefox%20ui&filter-tier=1&filter-tier=2&filter-tier=3&selectedJob=708284

[whimboo]

Here an example job for es-ES as fetched from the release promotion messages:
https://treeherder.allizom.org/#/jobs?repo=mozilla-beta&revision=5904e3eb711d&filter-searchStr=firefox%20ui&filter-tier=1&filter-tier=2&filter-tier=3&selectedJob=708284

[whimboo]

PR #774 has been merged. I will make this alive on staging now and will push to production on Monday if no regression for daily builds are noticed over the weekend.

[whimboo]

PR #774 has been merged. I will make this alive on staging now and will push to production on Monday if no regression for daily builds are noticed over the weekend.