Skip to content
This repository has been archived by the owner on Feb 20, 2023. It is now read-only.

Intermittent UI test failure - < SettingsAdvancedTest. openLinkInAppTest > #23481

Closed
AndiAJ opened this issue Jan 31, 2022 · 14 comments
Closed

Intermittent UI test failure - < SettingsAdvancedTest. openLinkInAppTest > #23481

AndiAJ opened this issue Jan 31, 2022 · 14 comments
Labels
eng:intermittent-test Evil test failures that only happen now-and-then and are a productivity killer eng:ui-test UI Tests

Comments

@AndiAJ
Copy link
Collaborator

AndiAJ commented Jan 31, 2022 •
edited by data-sync-user

Firebase Test Run: Firebase link

Stacktrace:

androidx.test.uiautomator.UiObjectNotFoundException: UiSelector[CONTAINS_TEXT=Mozilla Playstore link]
at androidx.test.uiautomator.UiObject.click(UiObject.java:416)
at org.mozilla.fenix.ui.robots.BrowserRobot.clickLinkMatchingText(BrowserRobot.kt:318)
at org.mozilla.fenix.ui.SettingsAdvancedTest$openLinkInAppTest$6.invoke(SettingsAdvancedTest.kt:89)
at org.mozilla.fenix.ui.SettingsAdvancedTest$openLinkInAppTest$6.invoke(SettingsAdvancedTest.kt:87)
at org.mozilla.fenix.ui.robots.NavigationToolbarRobot$Transition.enterURLAndEnterToBrowser(NavigationToolbarRobot.kt:112)
at org.mozilla.fenix.ui.SettingsAdvancedTest.openLinkInAppTest(SettingsAdvancedTest.kt:87)
at java.lang.reflect.Method.invoke(Native Method)
at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
at androidx.test.internal.runner.junit4.statement.RunBefores.evaluate(RunBefores.java:80)
at androidx.test.internal.runner.junit4.statement.RunAfters.evaluate(RunAfters.java:61)
at androidx.test.rule.ActivityTestRule$ActivityStatement.evaluate(ActivityTestRule.java:531)
at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366)
at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103)
at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63)
at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
at org.junit.runners.Suite.runChild(Suite.java:128)
at org.junit.runners.Suite.runChild(Suite.java:27)
at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
at org.junit.runner.JUnitCore.run(JUnitCore.java:137)
at org.junit.runner.JUnitCore.run(JUnitCore.java:115)
at androidx.test.internal.runner.TestExecutor.execute(TestExecutor.java:56)
at androidx.test.runner.AndroidJUnitRunner.onStart(AndroidJUnitRunner.java:395)
at android.app.Instrumentation$InstrumentationThread.run(Instrumentation.java:2145)

Build: 1/29 Main

┆Issue is synchronized with this Jira Task
@AndiAJ AndiAJ added eng:intermittent-test Evil test failures that only happen now-and-then and are a productivity killer eng:ui-test UI Tests labels Jan 31, 2022
@github-actions github-actions bot added the needs:triage Issue needs triage label Jan 31, 2022
@AndiAJ AndiAJ removed the needs:triage Issue needs triage label Feb 3, 2022
@AndiAJ
Copy link
Collaborator Author

AndiAJ commented Feb 3, 2022

Flaky 1x on 2/2 Main Firebase link

@AndiAJ
Copy link
Collaborator Author

AndiAJ commented Feb 10, 2022

Flaky 1x on 2/9 Main Firebase link

androidx.test.uiautomator.UiObjectNotFoundException: UiSelector[CONTAINS_TEXT=Mozilla Playstore link]
at androidx.test.uiautomator.UiObject.click(UiObject.java:416)
at org.mozilla.fenix.ui.robots.BrowserRobot.clickLinkMatchingText(BrowserRobot.kt:318)
at org.mozilla.fenix.ui.SettingsAdvancedTest$openLinkInAppTest$6.invoke(SettingsAdvancedTest.kt:89)
at org.mozilla.fenix.ui.SettingsAdvancedTest$openLinkInAppTest$6.invoke(SettingsAdvancedTest.kt:87)
at org.mozilla.fenix.ui.robots.NavigationToolbarRobot$Transition.enterURLAndEnterToBrowser(NavigationToolbarRobot.kt:112)
at org.mozilla.fenix.ui.SettingsAdvancedTest.openLinkInAppTest(SettingsAdvancedTest.kt:87)
at java.lang.reflect.Method.invoke(Native Method)

@AndiAJ
Copy link
Collaborator Author

AndiAJ commented Feb 10, 2022

Flaky 1x on 2/9 Main Firebase link

@AndiAJ
Copy link
Collaborator Author

AndiAJ commented Feb 14, 2022

Flaky 2/11 Main Firebase link

@AndiAJ
Copy link
Collaborator Author

AndiAJ commented Mar 1, 2022

Flaky 1x on 2/28 Main Firebase link

@AndiAJ
Copy link
Collaborator Author

AndiAJ commented Mar 7, 2022

Flaky 1x on 3/4 Main Firebase link

@sv-ohorvath
Copy link
Contributor

Flaky 1x on 3/11 main: link

@AndiAJ
Copy link
Collaborator Author

AndiAJ commented Mar 18, 2022

Flaky 1x on 3/18 Main Firebase link

@AndiAJ
Copy link
Collaborator Author

AndiAJ commented Mar 22, 2022

Flaky 1x on 3/22 Main Firebase link

@AndiAJ
Copy link
Collaborator Author

AndiAJ commented Mar 23, 2022

Flaky 1x on 3/22 Main Firebase link

@AndiAJ
Copy link
Collaborator Author

AndiAJ commented Mar 24, 2022 •
edited

Failed 2x on 3/23 Main
Firebase link
Firebase link
Firebase link
Firebase link

@sv-ohorvath
Copy link
Contributor

sv-ohorvath commented Mar 25, 2022 •
edited

Flaky, failed 1/2 on 3/25:
androidx.test.espresso.base.DefaultFailureHandler$AssertionFailedWithCauseError: Wanted to match 1 intents. Actually matched 0 intents. IntentMatcher: resolvesTo: com.android.vending Matched intents:[] Recorded intents:[] at dalvik.system.VMStack.getThreadStackTrace(Native Method) at java.lang.Thread.getStackTrace(Thread.java:1538) at androidx.test.espresso.base.DefaultFailureHandler.getUserFriendlyError(DefaultFailureHandler.java:16) at androidx.test.espresso.base.DefaultFailureHandler.handle(DefaultFailureHandler.java:36) at androidx.test.espresso.ViewInteraction.waitForAndHandleInteractionResults(ViewInteraction.java:103) at androidx.test.espresso.ViewInteraction.check(ViewInteraction.java:31) at androidx.test.espresso.intent.Intents.intended(Intents.java:190) at androidx.test.espresso.intent.Intents.intended(Intents.java:170) at org.mozilla.fenix.helpers.TestHelper.assertNativeAppOpens(TestHelper.kt:226) at org.mozilla.fenix.ui.SettingsAdvancedTest$openLinkInAppTest$6.invoke(SettingsAdvancedTest.kt:91) at org.mozilla.fenix.ui.SettingsAdvancedTest$openLinkInAppTest$6.invoke(SettingsAdvancedTest.kt:87) at org.mozilla.fenix.ui.robots.NavigationToolbarRobot$Transition.enterURLAndEnterToBrowser(NavigationToolbarRobot.kt:112) at org.mozilla.fenix.ui.SettingsAdvancedTest.openLinkInAppTest(SettingsAdvancedTest.kt:87)
https://console.firebase.google.com/project/moz-fenix/testlab/histories/bh.66b7091e15d53d45/matrices/6597984534487927757/executions/bs.83d21cbeba52dfee

@AndiAJ
Copy link
Collaborator Author

AndiAJ commented Mar 28, 2022 •
edited

Flaky 2x on 3/28 Main
Firebase link
Firebase link

AndiAJ added a commit to AndiAJ/fenix that referenced this issue Mar 28, 2022
@AndiAJ
For mozilla-mobile#24375 and mozilla-mobile#23481 disable flaky UI tests
7780cd0
AndiAJ added a commit to AndiAJ/fenix that referenced this issue Mar 28, 2022
@AndiAJ
For mozilla-mobile#24375 mozilla-mobile#23481 mozilla-mobile#24458 mo…
422877d 
…zilla-mobile#24462 mozilla-mobile#24376 disable flaky UI tests
mergify bot pushed a commit that referenced this issue Mar 28, 2022
@AndiAJ @mergify
For #24375 #23481 #24458 #24462 #24376 disable flaky UI tests
20b738c
@AndiAJ AndiAJ added the eng:disabled-test For any test that has been disabled label Mar 28, 2022
@AndiAJ AndiAJ mentioned this issue May 24, 2022
Closed
AndiAJ added a commit to AndiAJ/fenix that referenced this issue May 24, 2022
@AndiAJ
For mozilla-mobile#23481 fix disabled openLinkInAppTest UI test
f68443e
@AndiAJ AndiAJ mentioned this issue May 24, 2022
Merged
3 tasks
AndiAJ added a commit to AndiAJ/fenix that referenced this issue May 25, 2022
@AndiAJ
For mozilla-mobile#23481 fix disabled openLinkInAppTest UI test
8ba984e
mergify bot pushed a commit that referenced this issue May 25, 2022
@AndiAJ @mergify
For #23481 fix disabled openLinkInAppTest UI test
0569816
@AndiAJ
Copy link
Collaborator Author

AndiAJ commented May 25, 2022

Fixed in #25346

@AndiAJ AndiAJ closed this as completed May 25, 2022
@AndiAJ AndiAJ removed the eng:disabled-test For any test that has been disabled label May 25, 2022
@AndiAJ AndiAJ mentioned this issue Aug 3, 2022
Closed
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees
No one assigned
Labels
eng:intermittent-test Evil test failures that only happen now-and-then and are a productivity killer eng:ui-test UI Tests
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@sv-ohorvath @AndiAJ