Closes #9433: Update Flank version in ui-tests Dockerfile

[AaronMT]

v8.0.1 -> flank_snapshot (see #9433)

https://github.com/Flank/flank/releases

[codecov-io]

Codecov Report

Merging #9466 into master will increase coverage by 0.09%.
The diff coverage is n/a.

@@             Coverage Diff              @@
##             master    #9466      +/-   ##
============================================
+ Coverage     19.42%   19.51%   +0.09%     
- Complexity      520      523       +3     
============================================
  Files           334      331       -3     
  Lines         13419    13316     -103     
  Branches       1786     1770      -16     
============================================
- Hits           2607     2599       -8     
+ Misses        10589    10494      -95     
  Partials        223      223

Impacted Files	Coverage Δ	Complexity Δ
...in/java/org/mozilla/fenix/components/Components.kt	29.23% <0%> (-2.44%)	1% <0%> (ø)
...la/fenix/collections/CollectionCreationFragment.kt	89.58% <0%> (-0.62%)	6% <0%> (ø)
.../src/main/java/org/mozilla/fenix/utils/Settings.kt	75.61% <0%> (-0.25%)	30% <0%> (ø)
...pp/src/main/java/org/mozilla/fenix/FeatureFlags.kt	0% <0%> (ø)	0% <0%> (ø)	⬇️
...x/home/sessioncontrol/viewholders/TabViewHolder.kt	0% <0%> (ø)	0% <0%> (ø)	⬇️
...g/mozilla/fenix/settings/logins/SavedLoginsView.kt	0% <0%> (ø)	0% <0%> (ø)	⬇️
...sessioncontrol/viewholders/CollectionViewHolder.kt	0% <0%> (ø)	0% <0%> (ø)	⬇️
...ain/java/org/mozilla/fenix/components/FxaServer.kt	0% <0%> (ø)	0% <0%> (ø)	⬇️
...in/java/org/mozilla/fenix/search/SearchFragment.kt	0% <0%> (ø)	0% <0%> (ø)	⬇️
...sions/SitePermissionsManagePhoneFeatureFragment.kt	0% <0%> (ø)	0% <0%> (ø)	⬇️
... and 21 more

---

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 3d55578...6f57bf3. Read the comment docs.

[AaronMT]

122 tests / 122 shards

[task 2020-03-27T18:39:53.418Z] {
[task 2020-03-27T18:39:53.418Z]   "code" : 400,
[task 2020-03-27T18:39:53.419Z]   "errors" : [ {
[task 2020-03-27T18:39:53.419Z]     "domain" : "global",
[task 2020-03-27T18:39:53.419Z]     "message" : "num_shards must be >= 1 and <= 50.",
[task 2020-03-27T18:39:53.419Z]     "reason" : "badRequest"
[task 2020-03-27T18:39:53.419Z]   } ],
[task 2020-03-27T18:39:53.419Z]   "message" : "num_shards must be >= 1 and <= 50.",
[task 2020-03-27T18:39:53.420Z]   "status" : "INVALID_ARGUMENT"
[task 2020-03-27T18:39:53.420Z] }

Interesting change. I'll try 50 and report on the timing.

[JohanLorenzo]

Looks good to me!

[JohanLorenzo]

Quick question: does 50 here overrides what's defined in automation/taskcluster/androidTest/flank-x86.yml? (not blocking this PR)

[AaronMT]

Yeah we should always use the shard value provided by the templates, which is not happening right now #9185

[AaronMT]

7m 4s on flank_snapshot

I'm also looking into the GoogleJsonResponseException and legacy-result reporting in the Firebase Community

Edit: This appears to be extra misleading noise and is a bug on snapshot. The legacy reporting also has a bug on snapshot. I am told that success Firebase URL logging will be very soon (tomorrow) in flank-snapshot.

[AaronMT]

@JohanLorenzo Just want to confirm wether new flank-snapshot changes (that could update reguarily) will force new docker rebuilding and if so, is that ok?

[JohanLorenzo]

@AaronMT I'm sorry, it won't. Some changes have to happen in taskcluster/docker/ui-tests/Dockerfile in order to force a new docker image build. It could be dummy change like adding a space somewhere. The original intent is to build new images only when it's needed and the only way for taskgraph to know is to monitor changes in checked-in files.

That said, we could write a cron job that monitors https://api.github.com/repos/Flank/flank/releases and then opens a PR to update taskcluster/docker/ui-tests/Dockerfile. @pocmo and I solved a similar case 2 weeks ago in #9251 🙂