Skip to content
This repository has been archived by the owner on Feb 20, 2023. It is now read-only.

Taskgraph changes to allow running UI tests on nightly builds #18191

Conversation

isabelrios
Copy link
Contributor

Following comments on PR we are going to try a new approach to be able to have UI tests running on Nightly builds.

Currently only unit tests check the Nightly build generated. Having UI tests running for this build would be an extra/double check nice to have for Nightly builds.
This is something we should have at some point to prevent issues that UI tests could detect in master before Nightly build is created. For example comment on PR

@isabelrios
Copy link
Contributor Author

@escapewindow asking for review, as per comments in PR #17948. I'm creating this one with the changes mentioned there.

Looks like things are working here for debug and nightly(added the try_task_config.json to see it running). I'm still afraid like in the past PRs, things may be messed up when landing in master but I can't think of any other way to try these changes...

@isabelrios isabelrios force-pushed the taskgraph-changes-to-run-ui-tests-on-nightly-builds branch from d887d34 to f0bb788 Compare March 8, 2021 14:24
@isabelrios isabelrios closed this Mar 8, 2021
@isabelrios isabelrios reopened this Mar 8, 2021
@isabelrios
Copy link
Contributor Author

isabelrios commented Mar 8, 2021

@pocmo, @escapewindow sorry for pinging you again for review, just in case this fell off your radar 🙏

@escapewindow
Copy link
Contributor

Sorry about that! Don't forget to remove your try_task_config before merging.

@isabelrios isabelrios marked this pull request as ready for review March 9, 2021 08:55
@isabelrios isabelrios requested review from a team as code owners March 9, 2021 08:55
@codecov-io
Copy link

codecov-io commented Mar 9, 2021

Codecov Report

Merging #18191 (ae73bc6) into master (b661c83) will decrease coverage by 0.00%.
The diff coverage is n/a.

Impacted file tree graph

@@             Coverage Diff              @@
##             master   #18191      +/-   ##
============================================
- Coverage     33.27%   33.26%   -0.01%     
  Complexity     1417     1417              
============================================
  Files           461      461              
  Lines         19532    19533       +1     
  Branches       3011     3011              
============================================
- Hits           6499     6498       -1     
- Misses        12196    12197       +1     
- Partials        837      838       +1     
Impacted Files Coverage Δ Complexity Δ
...rg/mozilla/fenix/settings/account/AccountUiView.kt 32.50% <0.00%> (-2.50%) 4.00% <0.00%> (ø%)
...org/mozilla/fenix/crashes/CrashReporterFragment.kt 0.00% <0.00%> (ø) 0.00% <0.00%> (ø%)

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update b661c83...ae73bc6. Read the comment docs.

@mergify
Copy link
Contributor

mergify bot commented Mar 9, 2021

This pull request has conflicts when rebasing. Could you fix it @isabelrios? 🙏

@isabelrios isabelrios force-pushed the taskgraph-changes-to-run-ui-tests-on-nightly-builds branch from 5a79b4d to ae73bc6 Compare March 10, 2021 08:44
@isabelrios isabelrios merged commit 6002f94 into mozilla-mobile:master Mar 10, 2021
pkirakosyan pushed a commit to gexsi/user-agent-android that referenced this pull request Aug 5, 2021
…a-mobile#18191)

* Modify taskgraph to allow running UI tests on Nightly builds

* adding try_task_config file

* remove try_task_config file
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants