Skip to content
This repository has been archived by the owner on Feb 20, 2023. It is now read-only.

Intermittent UI Test failure - legacy-x86 - rememberAllowAudioVideoPermissionChoiceTest #25971

Closed
Archaeopteryx opened this issue Jul 11, 2022 · 11 comments · Fixed by #26096, fork-house/fenix#12 or Smaehtin/fenix#114
Closed

Intermittent UI Test failure - legacy-x86 - rememberAllowAudioVideoPermissionChoiceTest #25971

Archaeopteryx opened this issue Jul 11, 2022 · 11 comments · Fixed by #26096, fork-house/fenix#12 or Smaehtin/fenix#114
Labels
eng:intermittent-test Evil test failures that only happen now-and-then and are a productivity killer eng:ui-test UI Tests

Comments

@Archaeopteryx
Copy link

Archaeopteryx commented Jul 11, 2022 •
edited by data-sync-user

Test Run:

https://console.firebase.google.com/project/moz-fenix/testlab/histories/bh.66b7091e15d53d45/matrices/8026323383195407621/executions/bs.f4841ba8f5a4ada/testcases/1/test-cases

Stacktrace:

java.lang.AssertionError: Page didn't load or doesn't contain the expected text
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at org.mozilla.fenix.ui.robots.BrowserRobot.verifyPageContent(BrowserRobot.kt:102)
	at org.mozilla.fenix.ui.SitePermissionsTest$rememberAllowAudioVideoPermissionChoiceTest$8.invoke(SitePermissionsTest.kt:132)
	at org.mozilla.fenix.ui.SitePermissionsTest$rememberAllowAudioVideoPermissionChoiceTest$8.invoke(SitePermissionsTest.kt:131)
	at org.mozilla.fenix.ui.robots.BrowserRobotKt.browserScreen(BrowserRobot.kt:862)
	at org.mozilla.fenix.ui.SitePermissionsTest.rememberAllowAudioVideoPermissionChoiceTest(SitePermissionsTest.kt:131)

Build:

279efff

┆Issue is synchronized with this Jira Task
@Archaeopteryx Archaeopteryx added the eng:intermittent-test Evil test failures that only happen now-and-then and are a productivity killer label Jul 11, 2022
@github-actions github-actions bot added the needs:triage Issue needs triage label Jul 11, 2022
@Archaeopteryx Archaeopteryx mentioned this issue Jul 11, 2022
Closed
@sv-ohorvath sv-ohorvath changed the title Intermittent Unit Test failure - legacy-x86 - rememberAllowAudioVideoPermissionChoiceTest Intermittent UI Test failure - legacy-x86 - rememberAllowAudioVideoPermissionChoiceTest Jul 11, 2022
@sv-ohorvath sv-ohorvath added eng:ui-test UI Tests and removed needs:triage Issue needs triage labels Jul 11, 2022
@AndiAJ
Copy link
Collaborator

AndiAJ commented Jul 15, 2022

Failed 1x on 7/15 Main
Firebase link

java.lang.AssertionError: Page didn't load or doesn't contain the expected text
at org.junit.Assert.fail(Assert.java:89)
at org.junit.Assert.assertTrue(Assert.java:42)
at org.mozilla.fenix.ui.robots.BrowserRobot.verifyPageContent(BrowserRobot.kt:102)
at org.mozilla.fenix.ui.SitePermissionsTest$rememberAllowAudioVideoPermissionChoiceTest$8.invoke(SitePermissionsTest.kt:132)
at org.mozilla.fenix.ui.SitePermissionsTest$rememberAllowAudioVideoPermissionChoiceTest$8.invoke(SitePermissionsTest.kt:131)
at org.mozilla.fenix.ui.robots.BrowserRobotKt.browserScreen(BrowserRobot.kt:863)
at org.mozilla.fenix.ui.SitePermissionsTest.rememberAllowAudioVideoPermissionChoiceTest(SitePermissionsTest.kt:131)

Firebase link

java.lang.AssertionError: Page didn't load or doesn't contain the expected text
at org.junit.Assert.fail(Assert.java:89)
at org.junit.Assert.assertTrue(Assert.java:42)
at org.mozilla.fenix.ui.robots.BrowserRobot.verifyPageContent(BrowserRobot.kt:102)
at org.mozilla.fenix.ui.SitePermissionsTest$rememberAllowAudioVideoPermissionChoiceTest$8.invoke(SitePermissionsTest.kt:132)
at org.mozilla.fenix.ui.SitePermissionsTest$rememberAllowAudioVideoPermissionChoiceTest$8.invoke(SitePermissionsTest.kt:131)
at org.mozilla.fenix.ui.robots.BrowserRobotKt.browserScreen(BrowserRobot.kt:863)
at org.mozilla.fenix.ui.SitePermissionsTest.rememberAllowAudioVideoPermissionChoiceTest(SitePermissionsTest.kt:131)

sv-ohorvath added a commit that referenced this issue Jul 19, 2022
@sv-ohorvath
Issue #25972, #25971: reduce test failures with more retries on legac…
7dabc92 
…y-api-tests
sv-ohorvath added a commit that referenced this issue Jul 19, 2022
@sv-ohorvath
Issue #25972, #25971: reduce test failures with more retries on legac…
e9a36fd 
…y-api-tests
@sv-ohorvath sv-ohorvath mentioned this issue Jul 19, 2022
Merged
4 tasks
@mergify mergify bot closed this as completed in #26096 Jul 20, 2022
mergify bot pushed a commit that referenced this issue Jul 20, 2022
@sv-ohorvath @mergify
Issue #25972, #25971: reduce test failures with more retries on legac…
f3ef158 
…y-api-tests
@github-actions github-actions bot added this to the 104 milestone Jul 20, 2022
This was referenced Jul 20, 2022
Merged
Merged
@AndiAJ
Copy link
Collaborator

AndiAJ commented Jul 25, 2022

Flaky 1x on 7/24 Main Firebase link

java.lang.AssertionError: Page didn't load or doesn't contain the expected text
at org.junit.Assert.fail(Assert.java:89)
at org.junit.Assert.assertTrue(Assert.java:42)
at org.mozilla.fenix.ui.robots.BrowserRobot.verifyPageContent(BrowserRobot.kt:102)
at org.mozilla.fenix.ui.SitePermissionsTest$rememberAllowAudioVideoPermissionChoiceTest$8.invoke(SitePermissionsTest.kt:133)
at org.mozilla.fenix.ui.SitePermissionsTest$rememberAllowAudioVideoPermissionChoiceTest$8.invoke(SitePermissionsTest.kt:132)
at org.mozilla.fenix.ui.robots.BrowserRobotKt.browserScreen(BrowserRobot.kt:863)
at org.mozilla.fenix.ui.SitePermissionsTest.rememberAllowAudioVideoPermissionChoiceTest(SitePermissionsTest.kt:132)

@AndiAJ AndiAJ reopened this Jul 25, 2022
@gabrielluong gabrielluong removed this from the 104 milestone Jul 25, 2022
@AndiAJ
Copy link
Collaborator

AndiAJ commented Aug 2, 2022

Flaky 1x on 8/1 Main Firebase link

java.lang.AssertionError: Page didn't load or doesn't contain the expected text
at org.junit.Assert.fail(Assert.java:89)
at org.junit.Assert.assertTrue(Assert.java:42)
at org.mozilla.fenix.ui.robots.BrowserRobot.verifyPageContent(BrowserRobot.kt:102)
at org.mozilla.fenix.ui.SitePermissionsTest$rememberAllowAudioVideoPermissionChoiceTest$8.invoke(SitePermissionsTest.kt:133)
at org.mozilla.fenix.ui.SitePermissionsTest$rememberAllowAudioVideoPermissionChoiceTest$8.invoke(SitePermissionsTest.kt:132)
at org.mozilla.fenix.ui.robots.BrowserRobotKt.browserScreen(BrowserRobot.kt:863)
at org.mozilla.fenix.ui.SitePermissionsTest.rememberAllowAudioVideoPermissionChoiceTest(SitePermissionsTest.kt:132)

@AndiAJ
Copy link
Collaborator

AndiAJ commented Aug 2, 2022

Flaky 1x on 8/2 Main Firebase link

java.lang.AssertionError: Page didn't load or doesn't contain the expected text
at org.junit.Assert.fail(Assert.java:89)
at org.junit.Assert.assertTrue(Assert.java:42)
at org.mozilla.fenix.ui.robots.BrowserRobot.verifyPageContent(BrowserRobot.kt:102)
at org.mozilla.fenix.ui.SitePermissionsTest$rememberAllowAudioVideoPermissionChoiceTest$8.invoke(SitePermissionsTest.kt:133)
at org.mozilla.fenix.ui.SitePermissionsTest$rememberAllowAudioVideoPermissionChoiceTest$8.invoke(SitePermissionsTest.kt:132)
at org.mozilla.fenix.ui.robots.BrowserRobotKt.browserScreen(BrowserRobot.kt:863)
at org.mozilla.fenix.ui.SitePermissionsTest.rememberAllowAudioVideoPermissionChoiceTest(SitePermissionsTest.kt:132)

@AndiAJ
Copy link
Collaborator

AndiAJ commented Aug 22, 2022

Flaky 1x on 8/22 Main Firebase link

java.lang.AssertionError: Page didn't load or doesn't contain the expected text
at org.junit.Assert.fail(Assert.java:89)
at org.junit.Assert.assertTrue(Assert.java:42)
at org.mozilla.fenix.ui.robots.BrowserRobot.verifyPageContent(BrowserRobot.kt:102)
at org.mozilla.fenix.ui.SitePermissionsTest$rememberAllowAudioVideoPermissionChoiceTest$8.invoke(SitePermissionsTest.kt:133)
at org.mozilla.fenix.ui.SitePermissionsTest$rememberAllowAudioVideoPermissionChoiceTest$8.invoke(SitePermissionsTest.kt:132)
at org.mozilla.fenix.ui.robots.BrowserRobotKt.browserScreen(BrowserRobot.kt:863)
at org.mozilla.fenix.ui.SitePermissionsTest.rememberAllowAudioVideoPermissionChoiceTest(SitePermissionsTest.kt:132)

@AndiAJ
Copy link
Collaborator

AndiAJ commented Sep 2, 2022

Flaky 1x on 9/2 Main Firebase link

java.lang.AssertionError: Page didn't load or doesn't contain the expected text
at org.junit.Assert.fail(Assert.java:89)
at org.junit.Assert.assertTrue(Assert.java:42)
at org.mozilla.fenix.ui.robots.BrowserRobot.verifyPageContent(BrowserRobot.kt:102)
at org.mozilla.fenix.ui.SitePermissionsTest$rememberAllowAudioVideoPermissionChoiceTest$8.invoke(SitePermissionsTest.kt:134)
at org.mozilla.fenix.ui.SitePermissionsTest$rememberAllowAudioVideoPermissionChoiceTest$8.invoke(SitePermissionsTest.kt:133)
at org.mozilla.fenix.ui.robots.BrowserRobotKt.browserScreen(BrowserRobot.kt:947)
at org.mozilla.fenix.ui.SitePermissionsTest.rememberAllowAudioVideoPermissionChoiceTest(SitePermissionsTest.kt:133)

@AndiAJ
Copy link
Collaborator

AndiAJ commented Sep 5, 2022

Flaky 1x on 9/4 Main Firebase link

java.lang.AssertionError: Page didn't load or doesn't contain the expected text
at org.junit.Assert.fail(Assert.java:89)
at org.junit.Assert.assertTrue(Assert.java:42)
at org.mozilla.fenix.ui.robots.BrowserRobot.verifyPageContent(BrowserRobot.kt:102)
at org.mozilla.fenix.ui.SitePermissionsTest$rememberAllowAudioVideoPermissionChoiceTest$8.invoke(SitePermissionsTest.kt:134)
at org.mozilla.fenix.ui.SitePermissionsTest$rememberAllowAudioVideoPermissionChoiceTest$8.invoke(SitePermissionsTest.kt:133)
at org.mozilla.fenix.ui.robots.BrowserRobotKt.browserScreen(BrowserRobot.kt:947)
at org.mozilla.fenix.ui.SitePermissionsTest.rememberAllowAudioVideoPermissionChoiceTest(SitePermissionsTest.kt:133)

@AndiAJ
Copy link
Collaborator

AndiAJ commented Sep 12, 2022

Flaky 1x on 9/10 Main Firebase link

java.lang.AssertionError: Page didn't load or doesn't contain the expected text
at org.junit.Assert.fail(Assert.java:89)
at org.junit.Assert.assertTrue(Assert.java:42)
at org.mozilla.fenix.ui.robots.BrowserRobot.verifyPageContent(BrowserRobot.kt:102)
at org.mozilla.fenix.ui.SitePermissionsTest$rememberAllowAudioVideoPermissionChoiceTest$8.invoke(SitePermissionsTest.kt:134)
at org.mozilla.fenix.ui.SitePermissionsTest$rememberAllowAudioVideoPermissionChoiceTest$8.invoke(SitePermissionsTest.kt:133)
at org.mozilla.fenix.ui.robots.BrowserRobotKt.browserScreen(BrowserRobot.kt:952)
at org.mozilla.fenix.ui.SitePermissionsTest.rememberAllowAudioVideoPermissionChoiceTest(SitePermissionsTest.kt:133)

@AndiAJ
Copy link
Collaborator

AndiAJ commented Sep 13, 2022

Flaky 1x on 9/13 Main Firebase link

java.lang.AssertionError: Page didn't load or doesn't contain the expected text
at org.junit.Assert.fail(Assert.java:89)
at org.junit.Assert.assertTrue(Assert.java:42)
at org.mozilla.fenix.ui.robots.BrowserRobot.verifyPageContent(BrowserRobot.kt:102)
at org.mozilla.fenix.ui.SitePermissionsTest$rememberAllowAudioVideoPermissionChoiceTest$8.invoke(SitePermissionsTest.kt:134)
at org.mozilla.fenix.ui.SitePermissionsTest$rememberAllowAudioVideoPermissionChoiceTest$8.invoke(SitePermissionsTest.kt:133)
at org.mozilla.fenix.ui.robots.BrowserRobotKt.browserScreen(BrowserRobot.kt:960)
at org.mozilla.fenix.ui.SitePermissionsTest.rememberAllowAudioVideoPermissionChoiceTest(SitePermissionsTest.kt:133)

@AndiAJ
Copy link
Collaborator

AndiAJ commented Sep 29, 2022

Flaky 1x on 9/29 Main Firebase link

java.lang.AssertionError: Page didn't load or doesn't contain the expected text
at org.junit.Assert.fail(Assert.java:89)
at org.junit.Assert.assertTrue(Assert.java:42)
at org.mozilla.fenix.ui.robots.BrowserRobot.verifyPageContent(BrowserRobot.kt:102)
at org.mozilla.fenix.ui.SitePermissionsTest$rememberAllowAudioVideoPermissionChoiceTest$8.invoke(SitePermissionsTest.kt:127)
at org.mozilla.fenix.ui.SitePermissionsTest$rememberAllowAudioVideoPermissionChoiceTest$8.invoke(SitePermissionsTest.kt:126)
at org.mozilla.fenix.ui.robots.BrowserRobotKt.browserScreen(BrowserRobot.kt:991)
at org.mozilla.fenix.ui.SitePermissionsTest.rememberAllowAudioVideoPermissionChoiceTest(SitePermissionsTest.kt:126)

@sv-ohorvath
Copy link
Contributor

I switched the test to run again on API 30 with ARM, I'll close this as fixed, but can be reopened again if it still fails.

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees
No one assigned
Labels
eng:intermittent-test Evil test failures that only happen now-and-then and are a productivity killer eng:ui-test UI Tests
Projects
None yet
Milestone
No milestone
4 participants
@Archaeopteryx @gabrielluong @sv-ohorvath @AndiAJ