Skip to content
This repository has been archived by the owner on Feb 20, 2023. It is now read-only.

Intermittent UI test failure - < SearchTest. shortcutButtonTest > #25511

Closed
AndiAJ opened this issue Jun 3, 2022 · 4 comments
Closed

Intermittent UI test failure - < SearchTest. shortcutButtonTest > #25511

AndiAJ opened this issue Jun 3, 2022 · 4 comments
Labels
eng:intermittent-test Evil test failures that only happen now-and-then and are a productivity killer eng:ui-test UI Tests

Comments

@AndiAJ
Copy link
Collaborator

AndiAJ commented Jun 3, 2022

Firebase Test Run: Firebase link

Stacktrace:

java.lang.AssertionError: Failed to assertAny((Text + EditableText contains 'mozilla firefox' (ignoreCase: false)) && (Text + EditableText contains 'DuckDuckGo' (ignoreCase: false)))
None of the following nodes match:
Node #41 at (l=0.0, t=66.0, r=1080.0, b=220.0)px, Tag: 'mozac.awesomebar.suggestion'
Focused = 'false'
Text = '[mozilla, DuckDuckGo]'
Actions = [OnClick, GetTextLayoutResult]
MergeDescendants = 'true'
Selector used: 'TestTag = 'mozac.awesomebar.suggestion''

at androidx.compose.ui.test.AssertionsKt.assertAny(Assertions.kt:319)
at org.mozilla.fenix.ui.robots.SearchRobotKt$waitForSearchSuggestions$1.invoke(SearchRobot.kt:321)
at org.mozilla.fenix.ui.robots.SearchRobotKt$waitForSearchSuggestions$1.invoke(SearchRobot.kt:318)
at androidx.compose.ui.test.junit4.AndroidComposeTestRule.waitUntil(AndroidComposeTestRule.android.kt:312)
at org.mozilla.fenix.ui.robots.SearchRobotKt.assertSearchEngineResults(SearchRobot.kt:313)
at org.mozilla.fenix.ui.robots.SearchRobotKt.access$assertSearchEngineResults(SearchRobot.kt:1)
at org.mozilla.fenix.ui.robots.SearchRobot.verifySearchEngineResults(SearchRobot.kt:100)
at org.mozilla.fenix.ui.SearchTest$shortcutButtonTest$7.invoke(SearchTest.kt:103)
at org.mozilla.fenix.ui.SearchTest$shortcutButtonTest$7.invoke(SearchTest.kt:99)
at org.mozilla.fenix.ui.robots.HomeScreenRobot$Transition.openSearch(HomeScreenRobot.kt:263)
at org.mozilla.fenix.ui.SearchTest.shortcutButtonTest(SearchTest.kt:99)

Build: 6/2 Main

┆Issue is synchronized with this Jira Task

@AndiAJ AndiAJ added eng:intermittent-test Evil test failures that only happen now-and-then and are a productivity killer eng:ui-test UI Tests labels Jun 3, 2022
@github-actions github-actions bot added the needs:triage Issue needs triage label Jun 3, 2022
@sv-ohorvath sv-ohorvath removed the needs:triage Issue needs triage label Jun 10, 2022
@AndiAJ
Copy link
Collaborator Author

AndiAJ commented Jun 14, 2022

Flaky 1x on 6/13 Main Firebase link

java.lang.AssertionError: Failed to assertAny((Text + EditableText contains 'mozilla firefox' (ignoreCase: false)) && (Text + EditableText contains 'DuckDuckGo' (ignoreCase: false)))
None of the following nodes match:
Node #33 at (l=0.0, t=66.0, r=1080.0, b=220.0)px, Tag: 'mozac.awesomebar.suggestion'
Focused = 'false'
Text = '[mozilla, DuckDuckGo]'
Actions = [OnClick, GetTextLayoutResult]
MergeDescendants = 'true'
Selector used: 'TestTag = 'mozac.awesomebar.suggestion''

at androidx.compose.ui.test.AssertionsKt.assertAny(Assertions.kt:319)
at org.mozilla.fenix.ui.robots.SearchRobotKt$waitForSearchSuggestions$1.invoke(SearchRobot.kt:325)
at org.mozilla.fenix.ui.robots.SearchRobotKt$waitForSearchSuggestions$1.invoke(SearchRobot.kt:322)
at androidx.compose.ui.test.junit4.AndroidComposeTestRule.waitUntil(AndroidComposeTestRule.android.kt:312)
at org.mozilla.fenix.ui.robots.SearchRobotKt.assertSearchEngineResults(SearchRobot.kt:317)
at org.mozilla.fenix.ui.robots.SearchRobotKt.access$assertSearchEngineResults(SearchRobot.kt:1)
at org.mozilla.fenix.ui.robots.SearchRobot.verifySearchEngineResults(SearchRobot.kt:104)
at org.mozilla.fenix.ui.SearchTest$shortcutButtonTest$7.invoke(SearchTest.kt:103)
at org.mozilla.fenix.ui.SearchTest$shortcutButtonTest$7.invoke(SearchTest.kt:99)
at org.mozilla.fenix.ui.robots.HomeScreenRobot$Transition.openSearch(HomeScreenRobot.kt:259)
at org.mozilla.fenix.ui.SearchTest.shortcutButtonTest(SearchTest.kt:99)

@AndiAJ
Copy link
Collaborator Author

AndiAJ commented Jun 20, 2022

Failed 1x on 6/17 Main
Firebase link
Firebase link

java.lang.AssertionError: Failed to assertAny((Text + EditableText contains 'mozilla firefox' (ignoreCase: false)) && (Text + EditableText contains 'DuckDuckGo' (ignoreCase: false)))
None of the following nodes match:
Node #33 at (l=0.0, t=66.0, r=1080.0, b=220.0)px, Tag: 'mozac.awesomebar.suggestion'
Focused = 'false'
Text = '[mozilla, DuckDuckGo]'
Actions = [OnClick, GetTextLayoutResult]
MergeDescendants = 'true'
Selector used: 'TestTag = 'mozac.awesomebar.suggestion''

at androidx.compose.ui.test.AssertionsKt.assertAny(Assertions.kt:319)
at org.mozilla.fenix.ui.robots.SearchRobotKt$waitForSearchSuggestions$1.invoke(SearchRobot.kt:325)
at org.mozilla.fenix.ui.robots.SearchRobotKt$waitForSearchSuggestions$1.invoke(SearchRobot.kt:322)
at androidx.compose.ui.test.junit4.AndroidComposeTestRule.waitUntil(AndroidComposeTestRule.android.kt:312)
at org.mozilla.fenix.ui.robots.SearchRobotKt.assertSearchEngineResults(SearchRobot.kt:317)
at org.mozilla.fenix.ui.robots.SearchRobotKt.access$assertSearchEngineResults(SearchRobot.kt:1)
at org.mozilla.fenix.ui.robots.SearchRobot.verifySearchEngineResults(SearchRobot.kt:104)
at org.mozilla.fenix.ui.SearchTest$shortcutButtonTest$7.invoke(SearchTest.kt:103)
at org.mozilla.fenix.ui.SearchTest$shortcutButtonTest$7.invoke(SearchTest.kt:99)
at org.mozilla.fenix.ui.robots.HomeScreenRobot$Transition.openSearch(HomeScreenRobot.kt:259)
at org.mozilla.fenix.ui.SearchTest.shortcutButtonTest(SearchTest.kt:99)

@AndiAJ
Copy link
Collaborator Author

AndiAJ commented Jun 21, 2022

Fixed with #25632

@AndiAJ AndiAJ closed this as completed Jun 21, 2022
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
eng:intermittent-test Evil test failures that only happen now-and-then and are a productivity killer eng:ui-test UI Tests
Projects
None yet
Development

No branches or pull requests

2 participants