Intermittent UI test failure - <SettingsAboutTest.verifyAboutFirefoxPreview> #20754

AndiAJ · 2021-08-09T07:22:43Z

Firebase Test Run: Firebase link

Stacktrace:

androidx.test.espresso.PerformException: Error performing 'single click' on view 'with text: is "Know your rights"'.
at androidx.test.espresso.PerformException$Builder.build(PerformException.java:5)
at androidx.test.espresso.base.DefaultFailureHandler.getUserFriendlyError(DefaultFailureHandler.java:25)
at androidx.test.espresso.base.DefaultFailureHandler.handle(DefaultFailureHandler.java:36)
at androidx.test.espresso.ViewInteraction.waitForAndHandleInteractionResults(ViewInteraction.java:106)
at androidx.test.espresso.ViewInteraction.desugaredPerform(ViewInteraction.java:43)
at androidx.test.espresso.ViewInteraction.perform(ViewInteraction.java:94)
at org.mozilla.fenix.ui.robots.SettingsSubMenuAboutRobotKt.assertKnowYourRights(SettingsSubMenuAboutRobot.kt:188)
at org.mozilla.fenix.ui.robots.SettingsSubMenuAboutRobotKt.access$assertKnowYourRights(SettingsSubMenuAboutRobot.kt:1)
at org.mozilla.fenix.ui.robots.SettingsSubMenuAboutRobotKt$verifyListElements$3.invoke(SettingsSubMenuAboutRobot.kt:85)
at org.mozilla.fenix.ui.robots.SettingsSubMenuAboutRobotKt$verifyListElements$3.invoke(SettingsSubMenuAboutRobot.kt:85)
at org.mozilla.fenix.ui.robots.SettingsSubMenuAboutRobotKt$navigateBackToAboutPage$6.invoke(SettingsSubMenuAboutRobot.kt:77)
at org.mozilla.fenix.ui.robots.SettingsSubMenuAboutRobotKt$navigateBackToAboutPage$6.invoke(SettingsSubMenuAboutRobot.kt:76)
at org.mozilla.fenix.ui.robots.SettingsRobot$Transition.openAboutFirefoxPreview(SettingsRobot.kt:118)
at org.mozilla.fenix.ui.robots.SettingsSubMenuAboutRobotKt.navigateBackToAboutPage(SettingsSubMenuAboutRobot.kt:76)
at org.mozilla.fenix.ui.robots.SettingsSubMenuAboutRobotKt.verifyListElements(SettingsSubMenuAboutRobot.kt:85)
at org.mozilla.fenix.ui.robots.SettingsSubMenuAboutRobotKt.assertFirefoxPreviewPage(SettingsSubMenuAboutRobot.kt:64)
at org.mozilla.fenix.ui.robots.SettingsSubMenuAboutRobotKt.access$assertFirefoxPreviewPage(SettingsSubMenuAboutRobot.kt:1)
at org.mozilla.fenix.ui.robots.SettingsSubMenuAboutRobot.verifyAboutFirefoxPreview(SettingsSubMenuAboutRobot.kt:46)
at org.mozilla.fenix.ui.SettingsAboutTest$verifyAboutFirefoxPreview$4.invoke(SettingsAboutTest.kt:82)
at org.mozilla.fenix.ui.SettingsAboutTest$verifyAboutFirefoxPreview$4.invoke(SettingsAboutTest.kt:81)
at org.mozilla.fenix.ui.robots.SettingsRobot$Transition.openAboutFirefoxPreview(SettingsRobot.kt:118)
at org.mozilla.fenix.ui.SettingsAboutTest.verifyAboutFirefoxPreview(SettingsAboutTest.kt:81)
at java.lang.reflect.Method.invoke(Native Method)
at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
at androidx.test.internal.runner.junit4.statement.RunBefores.evaluate(RunBefores.java:80)
at androidx.test.internal.runner.junit4.statement.RunAfters.evaluate(RunAfters.java:61)
at androidx.test.rule.ActivityTestRule$ActivityStatement.evaluate(ActivityTestRule.java:531)
at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366)
at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103)
at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63)
at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
at org.junit.runners.Suite.runChild(Suite.java:128)
at org.junit.runners.Suite.runChild(Suite.java:27)
at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
at org.junit.runner.JUnitCore.run(JUnitCore.java:137)
at org.junit.runner.JUnitCore.run(JUnitCore.java:115)
at androidx.test.internal.runner.TestExecutor.execute(TestExecutor.java:56)
at androidx.test.runner.AndroidJUnitRunner.onStart(AndroidJUnitRunner.java:395)
at android.app.Instrumentation$InstrumentationThread.run(Instrumentation.java:2145)
Caused by: java.lang.RuntimeException: Action will not be performed because the target view does not match one or more of the following constraints:
at least 90 percent of the view's area is displayed to the user.
Target view: "AppCompatTextView{id=2131361811, res-name=about_item_title, visibility=VISIBLE, width=1080, height=154, has-focus=false, has-focusable=false, has-window-focus=true, is-clickable=false, is-enabled=true, is-focused=false, is-focusable=false, is-layout-requested=false, is-selected=false, layout-params=androidx.constraintlayout.widget.ConstraintLayout$LayoutParams@26b2f89, tag=null, root-is-layout-requested=false, has-input-connection=false, x=0.0, y=0.0, text=Know your rights, input-type=0, ime-target=false, has-links=false}"
at androidx.test.espresso.ViewInteraction.doPerform(ViewInteraction.java:63)
at androidx.test.espresso.ViewInteraction.access$100(ViewInteraction.java:15)
at androidx.test.espresso.ViewInteraction$1.call(ViewInteraction.java:3)
at androidx.test.espresso.ViewInteraction$1.call(ViewInteraction.java:2)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at android.os.Handler.handleCallback(Handler.java:873)
at android.os.Handler.dispatchMessage(Handler.java:99)
at android.os.Looper.loop(Looper.java:193)
at android.app.ActivityThread.main(ActivityThread.java:6669)
at java.lang.reflect.Method.invoke(Native Method)
at com.android.internal.os.RuntimeInit$MethodAndArgsCaller.run(RuntimeInit.java:493)
at com.android.internal.os.ZygoteInit.main(ZygoteInit.java:858)

Build: 8/6 Main

┆Issue is synchronized with this Jira Story

AndiAJ · 2021-09-30T08:06:31Z

Flaky 1x on 9/29 Main Firebase link

sv-ohorvath · 2021-10-05T13:40:19Z

Also flaky on 10/5, with a different error: logs
`androidx.test.espresso.AmbiguousViewMatcherException: 'with id is org.mozilla.fenix.debug:id/mozac_browser_tabstray_close' matches multiple views in the hierarchy.

at androidx.test.espresso.ViewInteraction.perform(ViewInteraction.java:94)
at org.mozilla.fenix.helpers.ViewInteractionKt.click(ViewInteraction.kt:18)
at org.mozilla.fenix.ui.robots.TabDrawerRobot.closeTab(TabDrawerRobot.kt:97)
at org.mozilla.fenix.ui.robots.SettingsSubMenuAboutRobotKt$navigateBackToAboutPage$2.invoke(SettingsSubMenuAboutRobot.kt:72)
at org.mozilla.fenix.ui.robots.SettingsSubMenuAboutRobotKt$navigateBackToAboutPage$2.invoke(SettingsSubMenuAboutRobot.kt:71)
at org.mozilla.fenix.ui.robots.BrowserRobot$Transition.openTabDrawer(BrowserRobot.kt:504)
at org.mozilla.fenix.ui.robots.SettingsSubMenuAboutRobotKt.navigateBackToAboutPage(SettingsSubMenuAboutRobot.kt:71)
at org.mozilla.fenix.ui.robots.SettingsSubMenuAboutRobotKt.verifyListElements(SettingsSubMenuAboutRobot.kt:91)
at org.mozilla.fenix.ui.robots.SettingsSubMenuAboutRobotKt.assertFirefoxPreviewPage(SettingsSubMenuAboutRobot.kt:66)
at org.mozilla.fenix.ui.robots.SettingsSubMenuAboutRobotKt.access$assertFirefoxPreviewPage(SettingsSubMenuAboutRobot.kt:1)
at org.mozilla.fenix.ui.robots.SettingsSubMenuAboutRobot.verifyAboutFirefoxPreview(SettingsSubMenuAboutRobot.kt:48)
`

sv-ohorvath · 2021-10-06T14:14:44Z

Flaky on 10/6: AmbiguousViewMatcherException

AndiAJ · 2021-10-07T13:02:22Z

Flaky on 10/6 Main Firebase link

androidx.test.espresso.NoMatchingViewException: No views in hierarchy found matching: with id is <org.mozilla.fenix.debug:id/recycler_view>

AndiAJ · 2021-10-07T13:05:50Z

Flaky 1x on 10/7 Main Firebase link

androidx.test.espresso.NoMatchingViewException: No views in hierarchy found matching: with id is <org.mozilla.fenix.debug:id/recycler_view>

AndiAJ · 2021-10-11T08:46:28Z

Flaky 1x on 10/8 Main Firebase link

androidx.test.espresso.NoMatchingViewException: No views in hierarchy found matching: with id is <org.mozilla.fenix.debug:id/recycler_view>

AndiAJ · 2021-10-11T12:09:25Z

Fixed the AmbiguousViewMatcherException in #21704

AndiAJ · 2021-10-19T07:20:02Z

Flaky 1x on 10/19 Main Firebase link

androidx.test.espresso.base.DefaultFailureHandler$AssertionFailedWithCauseError: 'view has effective visibility=VISIBLE' doesn't match the selected view.
Expected: view has effective visibility=VISIBLE
Got: "AppCompatTextView{id=2131362650, res-name=mozac_lib_crash_empty, visibility=GONE, width=0, height=0, has-focus=false, has-focusable=false, has-window-focus=true, is-clickable=false, is-enabled=true, is-focused=false, is-focusable=false, is-layout-requested=true, is-selected=false, layout-params=android.widget.FrameLayout$LayoutParams@64dea6, tag=null, root-is-layout-requested=false, has-input-connection=false, x=0.0, y=0.0, text=No crash reports have been submitted., input-type=0, ime-target=false, has-links=false}"
at dalvik.system.VMStack.getThreadStackTrace(Native Method)
at java.lang.Thread.getStackTrace(Thread.java:1538)
at androidx.test.espresso.base.DefaultFailureHandler.getUserFriendlyError(DefaultFailureHandler.java:16)
at androidx.test.espresso.base.DefaultFailureHandler.handle(DefaultFailureHandler.java:36)
at androidx.test.espresso.ViewInteraction.waitForAndHandleInteractionResults(ViewInteraction.java:103)
at androidx.test.espresso.ViewInteraction.check(ViewInteraction.java:31)
at org.mozilla.fenix.ui.robots.SettingsSubMenuAboutRobotKt.assertCrashes(SettingsSubMenuAboutRobot.kt:180)
at org.mozilla.fenix.ui.robots.SettingsSubMenuAboutRobotKt.verifyListElements(SettingsSubMenuAboutRobot.kt:87)
at org.mozilla.fenix.ui.robots.SettingsSubMenuAboutRobotKt.assertFirefoxPreviewPage(SettingsSubMenuAboutRobot.kt:66)
at org.mozilla.fenix.ui.robots.SettingsSubMenuAboutRobotKt.access$assertFirefoxPreviewPage(SettingsSubMenuAboutRobot.kt:1)
at org.mozilla.fenix.ui.robots.SettingsSubMenuAboutRobot.verifyAboutFirefoxPreview(SettingsSubMenuAboutRobot.kt:48)
at org.mozilla.fenix.ui.SettingsAboutTest$verifyAboutFirefoxPreview$4.invoke(SettingsAboutTest.kt:85)
at org.mozilla.fenix.ui.SettingsAboutTest$verifyAboutFirefoxPreview$4.invoke(SettingsAboutTest.kt:84)
at org.mozilla.fenix.ui.robots.SettingsRobot$Transition.openAboutFirefoxPreview(SettingsRobot.kt:118)
at org.mozilla.fenix.ui.SettingsAboutTest.verifyAboutFirefoxPreview(SettingsAboutTest.kt:84)
at java.lang.reflect.Method.invoke(Native Method)

AndiAJ · 2021-10-20T08:19:58Z

Flaky 1x on 10/20 Main Firebase link

androidx.test.espresso.NoMatchingViewException: No views in hierarchy found matching: with id is org.mozilla.fenix.debug:id/recycler_view
View Hierarchy:
+>DecorView{id=-1, visibility=VISIBLE, width=1080, height=1920, has-focus=false, has-focusable=true, has-window-focus=true, is-clickable=false, is-enabled=true, is-focused=false, is-focusable=false, is-layout-requested=false, is-selected=false, layout-params={(0,0)(fillxfill) sim={adjust=resize} ty=BASE_APPLICATION wanim=0x7f14034b
fl=LAYOUT_IN_SCREEN LAYOUT_INSET_DECOR HARDWARE_ACCELERATED DRAWS_SYSTEM_BAR_BACKGROUNDS
pfl=FORCE_DRAW_STATUS_BAR_BACKGROUND
vsysui=LIGHT_STATUS_BAR LIGHT_NAVIGATION_BAR}, tag=null, root-is-layout-requested=false, has-input-connection=false, x=0.0, y=0.0, child-count=2}

…ew test

AndiAJ · 2021-10-21T11:51:53Z

Flaky 1x on 10/20 Main Firebase link

androidx.test.espresso.NoMatchingViewException: No views in hierarchy found matching: with id is org.mozilla.fenix.debug:id/recycler_view

AndiAJ · 2021-10-21T11:59:54Z

Flaky 1x on 10/21 Main Firebase link

androidx.test.espresso.NoMatchingViewException: No views in hierarchy found matching: with id is org.mozilla.fenix.debug:id/recycler_view

…ew test

AndiAJ · 2021-10-29T09:50:40Z

Flaky 1x on 10/28 Main
Firebase link

androidx.test.uiautomator.UiObjectNotFoundException: UiSelector[TEXT=About Firefox Preview]
at androidx.test.uiautomator.UiObject.click(UiObject.java:416)
at org.mozilla.fenix.ui.robots.SettingsRobot$Transition.openAboutFirefoxPreview(SettingsRobot.kt:124)
at org.mozilla.fenix.ui.robots.SettingsSubMenuAboutRobotKt.navigateBackToAboutPage(SettingsSubMenuAboutRobot.kt:73)
at org.mozilla.fenix.ui.robots.SettingsSubMenuAboutRobotKt.verifyListElements(SettingsSubMenuAboutRobot.kt:86)
at org.mozilla.fenix.ui.robots.SettingsSubMenuAboutRobotKt.assertFirefoxPreviewPage(SettingsSubMenuAboutRobot.kt:66)
at org.mozilla.fenix.ui.robots.SettingsSubMenuAboutRobotKt.access$assertFirefoxPreviewPage(SettingsSubMenuAboutRobot.kt:1)
at org.mozilla.fenix.ui.robots.SettingsSubMenuAboutRobot.verifyAboutFirefoxPreview(SettingsSubMenuAboutRobot.kt:48)
at org.mozilla.fenix.ui.SettingsAboutTest$verifyAboutFirefoxPreview$4.invoke(SettingsAboutTest.kt:85)
at org.mozilla.fenix.ui.SettingsAboutTest$verifyAboutFirefoxPreview$4.invoke(SettingsAboutTest.kt:84)
at org.mozilla.fenix.ui.robots.SettingsRobot$Transition.openAboutFirefoxPreview(SettingsRobot.kt:126)
at org.mozilla.fenix.ui.SettingsAboutTest.verifyAboutFirefoxPreview(SettingsAboutTest.kt:84)
at java.lang.reflect.Method.invoke(Native Method)

AndiAJ · 2021-12-14T08:51:32Z

Flaky 1x on 12/13 Main Firebase link

androidx.test.espresso.PerformException: Error performing 'single click' on view 'with text: is "Licensing information"'.
at androidx.test.espresso.PerformException$Builder.build(PerformException.java:5)
at androidx.test.espresso.base.DefaultFailureHandler.getUserFriendlyError(DefaultFailureHandler.java:25)
at androidx.test.espresso.base.DefaultFailureHandler.handle(DefaultFailureHandler.java:36)
at androidx.test.espresso.ViewInteraction.waitForAndHandleInteractionResults(ViewInteraction.java:106)
at androidx.test.espresso.ViewInteraction.desugaredPerform(ViewInteraction.java:43)
at androidx.test.espresso.ViewInteraction.perform(ViewInteraction.java:94)

AndiAJ · 2022-01-20T06:16:17Z

Flaky 1x on 1/19 Main Firebase link

androidx.test.espresso.base.DefaultFailureHandler$AssertionFailedWithCauseError: 'view has effective visibility=VISIBLE' doesn't match the selected view.
Expected: view has effective visibility=VISIBLE
Got: "AppCompatTextView{id=2131362661, res-name=mozac_lib_crash_empty, visibility=GONE, width=0, height=0, has-focus=false, has-focusable=false, has-window-focus=true, is-clickable=false, is-enabled=true, is-focused=false, is-focusable=false, is-layout-requested=true, is-selected=false, layout-params=android.widget.FrameLayout$LayoutParams@59c4ffd, tag=null, root-is-layout-requested=false, has-input-connection=false, x=0.0, y=0.0, text=No crash reports have been submitted., input-type=0, ime-target=false, has-links=false}"
at org.mozilla.fenix.ui.robots.SettingsSubMenuAboutRobotKt.assertCrashes(SettingsSubMenuAboutRobot.kt:174)
at org.mozilla.fenix.ui.robots.SettingsSubMenuAboutRobotKt.verifyListElements(SettingsSubMenuAboutRobot.kt:82)
at org.mozilla.fenix.ui.robots.SettingsSubMenuAboutRobotKt.assertFirefoxPreviewPage(SettingsSubMenuAboutRobot.kt:66)
at org.mozilla.fenix.ui.robots.SettingsSubMenuAboutRobotKt.access$assertFirefoxPreviewPage(SettingsSubMenuAboutRobot.kt:1)
at org.mozilla.fenix.ui.robots.SettingsSubMenuAboutRobot.verifyAboutFirefoxPreview(SettingsSubMenuAboutRobot.kt:48)

AndiAJ · 2022-02-15T08:48:55Z

Flaky 2x on 2/14 Main

Firebase link

androidx.test.espresso.base.DefaultFailureHandler$AssertionFailedWithCauseError: 'view has effective visibility=VISIBLE' doesn't match the selected view.
Expected: view has effective visibility=VISIBLE
Got: "AppCompatTextView{id=2131362665, res-name=mozac_lib_crash_empty, visibility=GONE, width=0, height=0, has-focus=false, has-focusable=false, has-window-focus=true, is-clickable=false, is-enabled=true, is-focused=false, is-focusable=false, is-layout-requested=true, is-selected=false, layout-params=android.widget.FrameLayout$LayoutParams@38bc300, tag=null, root-is-layout-requested=false, has-input-connection=false, x=0.0, y=0.0, text=No crash reports have been submitted., input-type=0, ime-target=false, has-links=false}"
at org.mozilla.fenix.ui.robots.SettingsSubMenuAboutRobotKt.assertCrashes(SettingsSubMenuAboutRobot.kt:174)
at org.mozilla.fenix.ui.robots.SettingsSubMenuAboutRobotKt.verifyListElements(SettingsSubMenuAboutRobot.kt:82)
at org.mozilla.fenix.ui.robots.SettingsSubMenuAboutRobotKt.assertFirefoxPreviewPage(SettingsSubMenuAboutRobot.kt:66)
at org.mozilla.fenix.ui.robots.SettingsSubMenuAboutRobotKt.access$assertFirefoxPreviewPage(SettingsSubMenuAboutRobot.kt:1)
at org.mozilla.fenix.ui.robots.SettingsSubMenuAboutRobot.verifyAboutFirefoxPreview(SettingsSubMenuAboutRobot.kt:48)

…utFirefoxPreview test

AndiAJ · 2022-03-10T05:35:47Z

Flaky 1x on 3/9 Main Firebase link

AndiAJ · 2022-04-12T09:55:06Z

Closing as it didn't fail for a month

AndiAJ · 2022-04-26T09:11:39Z

Flaky 1x on 4/26 Main Firebase link

AndiAJ · 2022-04-28T06:58:53Z

Flaky 1x on 4/27 Main Firebase link

AndiAJ · 2022-04-29T12:00:20Z

Flaky 1x on 4/28 Main Firebase link

AndiAJ · 2022-05-02T05:10:39Z

Flaky 1x on 4/30 Main Firebase link
androidx.test.espresso.base.DefaultFailureHandler$AssertionFailedWithCauseError: 'view has effective visibility ' doesn't match the selected view.
Expected: view has effective visibility
Got: view.getVisibility() was
View Details: AppCompatTextView{id=2131362680, res-name=mozac_lib_crash_empty, visibility=GONE, width=0, height=0, has-focus=false, has-focusable=false, has-window-focus=true, is-clickable=false, is-enabled=true, is-focused=false, is-focusable=false, is-layout-requested=true, is-selected=false, layout-params=android.widget.FrameLayout$LayoutParams@e20eca5, tag=null, root-is-layout-requested=false, has-input-connection=false, x=0.0, y=0.0, text=No crash reports have been submitted., input-type=0, ime-target=false, has-links=false}

at dalvik.system.VMStack.getThreadStackTrace(Native Method)
at java.lang.Thread.getStackTrace(Thread.java:1736)
at androidx.test.espresso.base.DefaultFailureHandler.getUserFriendlyError(DefaultFailureHandler.java:12)
at androidx.test.espresso.base.DefaultFailureHandler.handle(DefaultFailureHandler.java:7)
at androidx.test.espresso.ViewInteraction.waitForAndHandleInteractionResults(ViewInteraction.java:5)
at androidx.test.espresso.ViewInteraction.check(ViewInteraction.java:12)
at org.mozilla.fenix.ui.robots.SettingsSubMenuAboutRobotKt.assertCrashes(SettingsSubMenuAboutRobot.kt:174)
at org.mozilla.fenix.ui.robots.SettingsSubMenuAboutRobotKt.verifyListElements(SettingsSubMenuAboutRobot.kt:82)
at org.mozilla.fenix.ui.robots.SettingsSubMenuAboutRobotKt.assertFirefoxPreviewPage(SettingsSubMenuAboutRobot.kt:66)
at org.mozilla.fenix.ui.robots.SettingsSubMenuAboutRobotKt.access$assertFirefoxPreviewPage(SettingsSubMenuAboutRobot.kt:1)
at org.mozilla.fenix.ui.robots.SettingsSubMenuAboutRobot.verifyAboutFirefoxPreview(SettingsSubMenuAboutRobot.kt:48)
at org.mozilla.fenix.ui.SettingsAboutTest$verifyAboutFirefoxPreview$4.invoke(SettingsAboutTest.kt:85)
at org.mozilla.fenix.ui.SettingsAboutTest$verifyAboutFirefoxPreview$4.invoke(SettingsAboutTest.kt:84)
at org.mozilla.fenix.ui.robots.SettingsRobot$Transition.openAboutFirefoxPreview(SettingsRobot.kt:136)
at org.mozilla.fenix.ui.SettingsAboutTest.verifyAboutFirefoxPreview(SettingsAboutTest.kt:84)
... 33 trimmed

Caused by: junit.framework.AssertionFailedError: 'view has effective visibility ' doesn't match the selected view.
Expected: view has effective visibility
Got: view.getVisibility() was
View Details: AppCompatTextView{id=2131362680, res-name=mozac_lib_crash_empty, visibility=GONE, width=0, height=0, has-focus=false, has-focusable=false, has-window-focus=true, is-clickable=false, is-enabled=true, is-focused=false, is-focusable=false, is-layout-requested=true, is-selected=false, layout-params=android.widget.FrameLayout$LayoutParams@e20eca5, tag=null, root-is-layout-requested=false, has-input-connection=false, x=0.0, y=0.0, text=No crash reports have been submitted., input-type=0, ime-target=false, has-links=false}

at androidx.test.espresso.matcher.ViewMatchers.assertThat(ViewMatchers.java:16)
at androidx.test.espresso.assertion.ViewAssertions$MatchesViewAssertion.check(ViewAssertions.java:11)
at androidx.test.espresso.ViewInteraction$SingleExecutionViewAssertion.check(ViewInteraction.java:2)
at androidx.test.espresso.ViewInteraction$2.call(ViewInteraction.java:12)
at androidx.test.espresso.ViewInteraction$2.call(ViewInteraction.java:1)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at android.os.Handler.handleCallback(Handler.java:938)
at android.os.Handler.dispatchMessage(Handler.java:99)
at android.os.Looper.loop(Looper.java:223)
at android.app.ActivityThread.main(ActivityThread.java:7656)
at java.lang.reflect.Method.invoke(Native Method)
at com.android.internal.os.RuntimeInit$MethodAndArgsCaller.run(RuntimeInit.java:592)
at com.android.internal.os.ZygoteInit.main(ZygoteInit.java:947)

AndiAJ · 2022-05-04T03:53:00Z

Flaky 1x on 5/3 Main Firebase link

androidx.test.espresso.base.DefaultFailureHandler$AssertionFailedWithCauseError: 'view has effective visibility ' doesn't match the selected view.
Expected: view has effective visibility
Got: view.getVisibility() was
View Details: AppCompatTextView{id=2131362680, res-name=mozac_lib_crash_empty, visibility=GONE, width=0, height=0, has-focus=false, has-focusable=false, has-window-focus=true, is-clickable=false, is-enabled=true, is-focused=false, is-focusable=false, is-layout-requested=true, is-selected=false, layout-params=android.widget.FrameLayout$LayoutParams@117e0fc, tag=null, root-is-layout-requested=false, has-input-connection=false, x=0.0, y=0.0, text=No crash reports have been submitted., input-type=0, ime-target=false, has-links=false}

at dalvik.system.VMStack.getThreadStackTrace(Native Method)
at java.lang.Thread.getStackTrace(Thread.java:1736)
at androidx.test.espresso.base.DefaultFailureHandler.getUserFriendlyError(DefaultFailureHandler.java:12)
at androidx.test.espresso.base.DefaultFailureHandler.handle(DefaultFailureHandler.java:7)
at androidx.test.espresso.ViewInteraction.waitForAndHandleInteractionResults(ViewInteraction.java:5)
at androidx.test.espresso.ViewInteraction.check(ViewInteraction.java:12)
at org.mozilla.fenix.ui.robots.SettingsSubMenuAboutRobotKt.assertCrashes(SettingsSubMenuAboutRobot.kt:174)
at org.mozilla.fenix.ui.robots.SettingsSubMenuAboutRobotKt.verifyListElements(SettingsSubMenuAboutRobot.kt:82)
at org.mozilla.fenix.ui.robots.SettingsSubMenuAboutRobotKt.assertFirefoxPreviewPage(SettingsSubMenuAboutRobot.kt:66)
at org.mozilla.fenix.ui.robots.SettingsSubMenuAboutRobotKt.access$assertFirefoxPreviewPage(SettingsSubMenuAboutRobot.kt:1)
at org.mozilla.fenix.ui.robots.SettingsSubMenuAboutRobot.verifyAboutFirefoxPreview(SettingsSubMenuAboutRobot.kt:48)
at org.mozilla.fenix.ui.SettingsAboutTest$verifyAboutFirefoxPreview$4.invoke(SettingsAboutTest.kt:85)
at org.mozilla.fenix.ui.SettingsAboutTest$verifyAboutFirefoxPreview$4.invoke(SettingsAboutTest.kt:84)
at org.mozilla.fenix.ui.robots.SettingsRobot$Transition.openAboutFirefoxPreview(SettingsRobot.kt:136)
at org.mozilla.fenix.ui.SettingsAboutTest.verifyAboutFirefoxPreview(SettingsAboutTest.kt:84)
... 33 trimmed

Caused by: junit.framework.AssertionFailedError: 'view has effective visibility ' doesn't match the selected view.
Expected: view has effective visibility
Got: view.getVisibility() was
View Details: AppCompatTextView{id=2131362680, res-name=mozac_lib_crash_empty, visibility=GONE, width=0, height=0, has-focus=false, has-focusable=false, has-window-focus=true, is-clickable=false, is-enabled=true, is-focused=false, is-focusable=false, is-layout-requested=true, is-selected=false, layout-params=android.widget.FrameLayout$LayoutParams@117e0fc, tag=null, root-is-layout-requested=false, has-input-connection=false, x=0.0, y=0.0, text=No crash reports have been submitted., input-type=0, ime-target=false, has-links=false}

at androidx.test.espresso.matcher.ViewMatchers.assertThat(ViewMatchers.java:16)
at androidx.test.espresso.assertion.ViewAssertions$MatchesViewAssertion.check(ViewAssertions.java:11)
at androidx.test.espresso.ViewInteraction$SingleExecutionViewAssertion.check(ViewInteraction.java:2)
at androidx.test.espresso.ViewInteraction$2.call(ViewInteraction.java:12)
at androidx.test.espresso.ViewInteraction$2.call(ViewInteraction.java:1)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at android.os.Handler.handleCallback(Handler.java:938)
at android.os.Handler.dispatchMessage(Handler.java:99)
at android.os.Looper.loop(Looper.java:223)
at android.app.ActivityThread.main(ActivityThread.java:7656)
at java.lang.reflect.Method.invoke(Native Method)
at com.android.internal.os.RuntimeInit$MethodAndArgsCaller.run(RuntimeInit.java:592)
at com.android.internal.os.ZygoteInit.main(ZygoteInit.java:947)

AndiAJ · 2022-05-04T04:35:17Z

Flaky 2x on 5/4 Main

Firebase link

androidx.test.espresso.base.DefaultFailureHandler$AssertionFailedWithCauseError: 'view has effective visibility ' doesn't match the selected view.
Expected: view has effective visibility
Got: view.getVisibility() was
View Details: AppCompatTextView{id=2131362680, res-name=mozac_lib_crash_empty, visibility=GONE, width=0, height=0, has-focus=false, has-focusable=false, has-window-focus=true, is-clickable=false, is-enabled=true, is-focused=false, is-focusable=false, is-layout-requested=true, is-selected=false, layout-params=android.widget.FrameLayout$LayoutParams@2cdb922, tag=null, root-is-layout-requested=false, has-input-connection=false, x=0.0, y=0.0, text=No crash reports have been submitted., input-type=0, ime-target=false, has-links=false}

at dalvik.system.VMStack.getThreadStackTrace(Native Method)
at java.lang.Thread.getStackTrace(Thread.java:1736)
at androidx.test.espresso.base.DefaultFailureHandler.getUserFriendlyError(DefaultFailureHandler.java:12)
at androidx.test.espresso.base.DefaultFailureHandler.handle(DefaultFailureHandler.java:7)
at androidx.test.espresso.ViewInteraction.waitForAndHandleInteractionResults(ViewInteraction.java:5)
at androidx.test.espresso.ViewInteraction.check(ViewInteraction.java:12)
at org.mozilla.fenix.ui.robots.SettingsSubMenuAboutRobotKt.assertCrashes(SettingsSubMenuAboutRobot.kt:174)
at org.mozilla.fenix.ui.robots.SettingsSubMenuAboutRobotKt.verifyListElements(SettingsSubMenuAboutRobot.kt:82)
at org.mozilla.fenix.ui.robots.SettingsSubMenuAboutRobotKt.assertFirefoxPreviewPage(SettingsSubMenuAboutRobot.kt:66)
at org.mozilla.fenix.ui.robots.SettingsSubMenuAboutRobotKt.access$assertFirefoxPreviewPage(SettingsSubMenuAboutRobot.kt:1)
at org.mozilla.fenix.ui.robots.SettingsSubMenuAboutRobot.verifyAboutFirefoxPreview(SettingsSubMenuAboutRobot.kt:48)
at org.mozilla.fenix.ui.SettingsAboutTest$verifyAboutFirefoxPreview$4.invoke(SettingsAboutTest.kt:85)
at org.mozilla.fenix.ui.SettingsAboutTest$verifyAboutFirefoxPreview$4.invoke(SettingsAboutTest.kt:84)
at org.mozilla.fenix.ui.robots.SettingsRobot$Transition.openAboutFirefoxPreview(SettingsRobot.kt:136)
at org.mozilla.fenix.ui.SettingsAboutTest.verifyAboutFirefoxPreview(SettingsAboutTest.kt:84)
... 33 trimmed

Caused by: junit.framework.AssertionFailedError: 'view has effective visibility ' doesn't match the selected view.
Expected: view has effective visibility
Got: view.getVisibility() was
View Details: AppCompatTextView{id=2131362680, res-name=mozac_lib_crash_empty, visibility=GONE, width=0, height=0, has-focus=false, has-focusable=false, has-window-focus=true, is-clickable=false, is-enabled=true, is-focused=false, is-focusable=false, is-layout-requested=true, is-selected=false, layout-params=android.widget.FrameLayout$LayoutParams@2cdb922, tag=null, root-is-layout-requested=false, has-input-connection=false, x=0.0, y=0.0, text=No crash reports have been submitted., input-type=0, ime-target=false, has-links=false}

at androidx.test.espresso.matcher.ViewMatchers.assertThat(ViewMatchers.java:16)
at androidx.test.espresso.assertion.ViewAssertions$MatchesViewAssertion.check(ViewAssertions.java:11)
at androidx.test.espresso.ViewInteraction$SingleExecutionViewAssertion.check(ViewInteraction.java:2)
at androidx.test.espresso.ViewInteraction$2.call(ViewInteraction.java:12)
at androidx.test.espresso.ViewInteraction$2.call(ViewInteraction.java:1)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at android.os.Handler.handleCallback(Handler.java:938)
at android.os.Handler.dispatchMessage(Handler.java:99)
at android.os.Looper.loop(Looper.java:223)
at android.app.ActivityThread.main(ActivityThread.java:7656)
at java.lang.reflect.Method.invoke(Native Method)
at com.android.internal.os.RuntimeInit$MethodAndArgsCaller.run(RuntimeInit.java:592)
at com.android.internal.os.ZygoteInit.main(ZygoteInit.java:947)

AndiAJ · 2022-05-06T09:13:21Z

Disabled in #25128

(cherry picked from commit 94b9342)

AndiAJ added eng:intermittent-test Evil test failures that only happen now-and-then and are a productivity killer eng:ui-test UI Tests labels Aug 9, 2021

github-actions bot added the needs:triage Issue needs triage label Aug 9, 2021

AndiAJ removed the needs:triage Issue needs triage label Aug 9, 2021

sv-ohorvath closed this as completed Sep 30, 2021

sv-ohorvath reopened this Sep 30, 2021

sv-ohorvath self-assigned this Oct 13, 2021

sv-ohorvath pushed a commit that referenced this issue Oct 20, 2021

For #20754: fix intermittent click failure in verifyAboutFirefoxPrevi…

a23d38b

…ew test

sv-ohorvath mentioned this issue Oct 20, 2021

For #20754: fix intermittent click failure in verifyAboutFirefoxPreview test #22037

Merged

3 tasks

sv-ohorvath linked a pull request Oct 20, 2021 that will close this issue

For #20754: fix intermittent click failure in verifyAboutFirefoxPreview test #22037

Merged

3 tasks

mergify bot closed this as completed in #22037 Oct 21, 2021

mergify bot pushed a commit that referenced this issue Oct 21, 2021

For #20754: fix intermittent click failure in verifyAboutFirefoxPrevi…

34ca959

…ew test

AndiAJ reopened this Oct 29, 2021

pkirakosyan pushed a commit to gexsi/user-agent-android that referenced this issue Mar 7, 2022

For mozilla-mobile#20754: fix intermittent click failure in verifyAbo…

0bc7d5f

…utFirefoxPreview test

AndiAJ closed this as completed Apr 12, 2022

AndiAJ reopened this Apr 26, 2022

Amejia481 added a commit to Amejia481/fenix that referenced this issue May 5, 2022

Disable intermittent tests mozilla-mobile#20754.

728000c

Amejia481 added a commit to Amejia481/fenix that referenced this issue May 6, 2022

Disable intermittent tests mozilla-mobile#20754.

7e6a3cf

Amejia481 added a commit that referenced this issue May 6, 2022

Disable intermittent tests #20754.

94b9342

AndiAJ added the eng:disabled-test For any test that has been disabled label May 6, 2022

mergify bot pushed a commit that referenced this issue May 6, 2022

Disable intermittent tests #20754.

4867278

(cherry picked from commit 94b9342)

Amejia481 added a commit that referenced this issue May 7, 2022

Disable intermittent tests #20754.

ad5b3b9

(cherry picked from commit 94b9342)

sv-ohorvath pushed a commit that referenced this issue May 13, 2022

For #20754: Fix scrolling issues and re-enable verifyAboutFirefoxPreview

e9a1fd3

sv-ohorvath mentioned this issue May 13, 2022

For #20754: Fix scrolling issues and re-enable verifyAboutFirefoxPreview #25230

Merged

3 tasks

sv-ohorvath pushed a commit that referenced this issue May 16, 2022

For #20754: Fix scrolling issues and re-enable verifyAboutFirefoxPreview

e2f4b1c

sv-ohorvath linked a pull request May 17, 2022 that will close this issue

For #20754: Fix scrolling issues and re-enable verifyAboutFirefoxPreview #25230

Merged

3 tasks

mergify bot closed this as completed in #25230 May 17, 2022

mergify bot pushed a commit that referenced this issue May 17, 2022

For #20754: Fix scrolling issues and re-enable verifyAboutFirefoxPreview

f6f1446

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Intermittent UI test failure - <SettingsAboutTest.verifyAboutFirefoxPreview> #20754

Intermittent UI test failure - <SettingsAboutTest.verifyAboutFirefoxPreview> #20754

AndiAJ commented Aug 9, 2021 •

edited by data-sync-user

Loading

AndiAJ commented Sep 30, 2021

sv-ohorvath commented Oct 5, 2021

sv-ohorvath commented Oct 6, 2021

AndiAJ commented Oct 7, 2021

AndiAJ commented Oct 7, 2021

AndiAJ commented Oct 11, 2021

AndiAJ commented Oct 11, 2021

AndiAJ commented Oct 19, 2021

AndiAJ commented Oct 20, 2021

AndiAJ commented Oct 21, 2021

AndiAJ commented Oct 21, 2021

AndiAJ commented Oct 29, 2021

AndiAJ commented Dec 14, 2021

AndiAJ commented Jan 20, 2022 •

edited by sv-ohorvath

Loading

AndiAJ commented Feb 15, 2022 •

edited by sv-ohorvath

Loading

AndiAJ commented Mar 10, 2022

AndiAJ commented Apr 12, 2022

AndiAJ commented Apr 26, 2022

AndiAJ commented Apr 28, 2022 •

edited

Loading

AndiAJ commented Apr 29, 2022

AndiAJ commented May 2, 2022

AndiAJ commented May 4, 2022

AndiAJ commented May 4, 2022 •

edited

Loading

AndiAJ commented May 6, 2022

Intermittent UI test failure - <SettingsAboutTest.verifyAboutFirefoxPreview> #20754

Intermittent UI test failure - <SettingsAboutTest.verifyAboutFirefoxPreview> #20754

Comments

AndiAJ commented Aug 9, 2021 • edited by data-sync-user Loading

Firebase Test Run: Firebase link

Stacktrace:

Build: 8/6 Main

AndiAJ commented Sep 30, 2021

sv-ohorvath commented Oct 5, 2021

sv-ohorvath commented Oct 6, 2021

AndiAJ commented Oct 7, 2021

AndiAJ commented Oct 7, 2021

AndiAJ commented Oct 11, 2021

AndiAJ commented Oct 11, 2021

AndiAJ commented Oct 19, 2021

AndiAJ commented Oct 20, 2021

AndiAJ commented Oct 21, 2021

AndiAJ commented Oct 21, 2021

AndiAJ commented Oct 29, 2021

AndiAJ commented Dec 14, 2021

AndiAJ commented Jan 20, 2022 • edited by sv-ohorvath Loading

AndiAJ commented Feb 15, 2022 • edited by sv-ohorvath Loading

AndiAJ commented Mar 10, 2022

AndiAJ commented Apr 12, 2022

AndiAJ commented Apr 26, 2022

AndiAJ commented Apr 28, 2022 • edited Loading

AndiAJ commented Apr 29, 2022

AndiAJ commented May 2, 2022

AndiAJ commented May 4, 2022

AndiAJ commented May 4, 2022 • edited Loading

AndiAJ commented May 6, 2022

AndiAJ commented Aug 9, 2021 •

edited by data-sync-user

Loading

AndiAJ commented Jan 20, 2022 •

edited by sv-ohorvath

Loading

AndiAJ commented Feb 15, 2022 •

edited by sv-ohorvath

Loading

AndiAJ commented Apr 28, 2022 •

edited

Loading

AndiAJ commented May 4, 2022 •

edited

Loading