Skip to content
This repository has been archived by the owner on Feb 20, 2023. It is now read-only.

Add taskcluster job for UI test automation #4088

Merged
merged 1 commit into from
Jul 26, 2019
Merged

Add taskcluster job for UI test automation #4088

merged 1 commit into from
Jul 26, 2019

Conversation

rpappalax
Copy link
Contributor

@rpappalax rpappalax commented Jul 16, 2019

Pull Request checklist

  • Quality: This PR builds and passes detekt/ktlint checks (A pre-push hook is recommended)
  • Tests: This PR includes thorough tests or an explanation of why it does not
  • Changelog: This PR includes a changelog entry or does not need one
  • Accessibility: The code in this PR follows accessibility best practices or does not include any user facing features

This pull request enables UI test automation to be run via taskcluster job on github "push."
UI tests run asyncronously on individual shards (physical devices) and should each complete in one minute or less. However, since we are running our tests on Firebase ARM devices, occasionally there can be user traffic jams on a given API and collective run may go on as long as 15 minutes.

To view test results, wait for taskcluster UI test task to complete. If task is marked fail, results can be best viewed in the Firebase dashboard.

NOTE:
There are a few tests that are currently broken. Please file a separate issue for any flaky/broken test and fix test or disable to prevent builds from being perma-red.

@rpappalax rpappalax added the eng:automation Build automation, Continuous integration, .. label Jul 16, 2019
@rpappalax rpappalax requested review from a team as code owners July 16, 2019 19:37
Copy link
Contributor

@mitchhentges mitchhentges left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Excited to have these tests running in automation!

automation/taskcluster/androidTest/ui-test.sh Outdated Show resolved Hide resolved
automation/taskcluster/androidTest/ui-test.sh Outdated Show resolved Hide resolved
automation/taskcluster/androidTest/ui-test.sh Outdated Show resolved Hide resolved
automation/taskcluster/androidTest/ui-test.sh Show resolved Hide resolved
automation/taskcluster/androidTest/ui-test.sh Outdated Show resolved Hide resolved
automation/taskcluster/androidTest/ui-test.sh Outdated Show resolved Hide resolved
automation/taskcluster/androidTest/ui-test.sh Show resolved Hide resolved
automation/taskcluster/decision_task.py Show resolved Hide resolved
automation/taskcluster/lib/tasks.py Outdated Show resolved Hide resolved
automation/taskcluster/lib/tasks.py Outdated Show resolved Hide resolved
.gitignore Outdated Show resolved Hide resolved
automation/taskcluster/helper/get-secret.py Outdated Show resolved Hide resolved
automation/taskcluster/lib/tasks.py Show resolved Hide resolved
automation/taskcluster/lib/tasks.py Show resolved Hide resolved
automation/taskcluster/lib/tasks.py Outdated Show resolved Hide resolved
automation/taskcluster/lib/tasks.py Show resolved Hide resolved
Copy link
Contributor

@pocmo pocmo left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

👍 Looks good from my side now.

@JohanLorenzo / @mitchhentges Does anyone of you want to look at it again from RelEng side and approve (or request changes)? :)

Copy link
Contributor

@mitchhentges mitchhentges left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm pretty happy with this, thanks for the review ping :)

@rpappalax rpappalax merged commit b39afe1 into mozilla-mobile:master Jul 26, 2019
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
eng:automation Build automation, Continuous integration, ..
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

5 participants