Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Db generation test and xfail #13457

Merged
merged 1 commit into from
Jun 14, 2022
Merged

Db generation test and xfail #13457

merged 1 commit into from
Jun 14, 2022

Conversation

churik
Copy link
Member

@churik churik commented Jun 7, 2022

No description provided.

@churik churik added the tests label Jun 7, 2022
@churik churik self-assigned this Jun 7, 2022
@status-github-bot status-github-bot bot added this to REVIEW in Pipeline for QA Jun 7, 2022
@status-im-auto
Copy link
Member

status-im-auto commented Jun 7, 2022

Jenkins Builds

Click to see older builds (49)
Commit #️⃣ Finished (UTC) Duration Platform Result
✔️ d6c0a69 #1 2022-06-07 15:20:17 ~9 min android-e2e 📦apk 📲
✔️ d6c0a69 #1 2022-06-07 15:22:36 ~12 min android 📦apk 📲
✔️ d6c0a69 #1 2022-06-07 15:27:04 ~16 min ios 📦ipa 📲
✔️ 519b556 #2 2022-06-10 15:33:48 ~10 min android-e2e 📦apk 📲
✔️ 519b556 #2 2022-06-10 15:35:18 ~12 min android 📦apk 📲
✔️ 519b556 #2 2022-06-10 15:46:54 ~23 min ios 📦ipa 📲
✔️ 8a10ac6 #3 2022-06-13 10:09:08 ~9 min android 📦apk 📲
✔️ 8a10ac6 #3 2022-06-13 10:09:16 ~9 min android-e2e 📦apk 📲
✔️ 8a10ac6 #3 2022-06-13 10:12:21 ~12 min ios 📦ipa 📲
✔️ 999b77d #4 2022-06-13 11:37:33 ~9 min android-e2e 📦apk 📲
✔️ 999b77d #4 2022-06-13 11:39:14 ~11 min android 📦apk 📲
✔️ 999b77d #4 2022-06-13 11:41:34 ~13 min ios 📦ipa 📲
✔️ d3a228c #5 2022-06-13 11:50:08 ~8 min android-e2e 📦apk 📲
✔️ d3a228c #5 2022-06-13 11:52:20 ~11 min android 📦apk 📲
✔️ d3a228c #5 2022-06-13 11:57:30 ~16 min ios 📦ipa 📲
✔️ f052090 #6 2022-06-13 12:04:27 ~10 min android-e2e 📦apk 📲
✔️ f052090 #6 2022-06-13 12:04:30 ~10 min android 📦apk 📲
✔️ f052090 #6 2022-06-13 12:10:56 ~16 min ios 📦ipa 📲
✔️ f704ee1 #7 2022-06-13 13:20:38 ~9 min android-e2e 📦apk 📲
✔️ f704ee1 #7 2022-06-13 13:20:39 ~9 min android 📦apk 📲
✔️ f704ee1 #7 2022-06-13 13:28:23 ~17 min ios 📦ipa 📲
✔️ 1d8b719 #8 2022-06-13 14:02:37 ~11 min android-e2e 📦apk 📲
✔️ 1d8b719 #8 2022-06-13 14:06:52 ~15 min ios 📦ipa 📲
✔️ d16d033 #9 2022-06-13 14:52:35 ~11 min android 📦apk 📲
✔️ d16d033 #9 2022-06-13 14:53:02 ~12 min ios 📦ipa 📲
✔️ 2bbf399 #10 2022-06-13 15:04:25 ~8 min android 📦apk 📲
✔️ 2bbf399 #10 2022-06-13 15:04:54 ~9 min android-e2e 📦apk 📲
✔️ 2bbf399 #10 2022-06-13 15:10:32 ~15 min ios 📦ipa 📲
✔️ 3127d08 #11 2022-06-13 15:11:47 ~12 min android 📦apk 📲
✔️ 3127d08 #11 2022-06-13 15:14:18 ~14 min ios 📦ipa 📲
✔️ 6b0dcf6 #12 2022-06-13 15:33:28 ~11 min android 📦apk 📲
✔️ 6b0dcf6 #12 2022-06-13 15:34:20 ~12 min ios 📦ipa 📲
✔️ f127492 #13 2022-06-13 16:01:11 ~8 min android 📦apk 📲
✔️ f127492 #13 2022-06-13 16:01:18 ~9 min android-e2e 📦apk 📲
f127492 #13 2022-06-13 16:02:29 ~10 min ios 📄log
✔️ 2152de3 #14 2022-06-14 08:40:11 ~9 min android 📦apk 📲
✔️ 2152de3 #14 2022-06-14 08:42:32 ~11 min android-e2e 📦apk 📲
✔️ 2152de3 #14 2022-06-14 08:44:21 ~13 min ios 📦ipa 📲
✔️ 8602639 #15 2022-06-14 11:09:03 ~8 min android 📦apk 📲
✔️ 8602639 #15 2022-06-14 11:10:22 ~10 min android-e2e 📦apk 📲
✔️ 8602639 #15 2022-06-14 11:10:47 ~10 min ios 📦ipa 📲
✔️ 8550ae1 #17 2022-06-14 13:11:34 ~9 min android 📦apk 📲
✔️ 8550ae1 #17 2022-06-14 13:12:43 ~10 min ios 📦ipa 📲
✔️ 8550ae1 #17 2022-06-14 13:13:40 ~11 min android-e2e 📦apk 📲
✔️ 41a7884 #16 2022-06-14 13:13:36 ~11 min android 📦apk 📲
✔️ 41a7884 #16 2022-06-14 13:15:44 ~13 min ios 📦ipa 📲
✔️ c68c817 #18 2022-06-14 13:43:13 ~13 min android-e2e 📦apk 📲
✔️ c68c817 #18 2022-06-14 13:44:55 ~15 min android 📦apk 📲
✔️ c68c817 #18 2022-06-14 13:50:47 ~21 min ios 📦ipa 📲
Commit #️⃣ Finished (UTC) Duration Platform Result
✔️ 57b2e21 #19 2022-06-14 14:13:17 ~10 min android-e2e 📦apk 📲
✔️ 57b2e21 #19 2022-06-14 14:13:40 ~10 min android 📦apk 📲
✔️ 57b2e21 #19 2022-06-14 14:19:36 ~16 min ios 📦ipa 📲
✔️ a141c75 #20 2022-06-14 15:14:17 ~10 min android-e2e 📦apk 📲
✔️ a141c75 #20 2022-06-14 15:14:43 ~10 min android 📦apk 📲
✔️ a141c75 #20 2022-06-14 15:17:33 ~13 min ios 📦ipa 📲

@status-im-auto
Copy link
Member

33% of end-end tests have passed

Total executed tests: 6
Failed tests: 4
Passed tests: 2
IDs of failed tests: 702184,702183,702244,702185 

Failed tests (4)

Click to expand
  • Rerun failed tests

  • 1. test_activity_center_accept_chats, id: 702184

    Device 2: Find `ProfileButton` by `xpath`: `//*[contains(@content-desc,'5 out of 5')]`
    Device 2: Sending message 'Message sender'

    Device `2`: `EditBox` by` accessibility id`: `chat-message-input` is not found on the screen after wait_for_element (possible issue: may fail due to #12345)

    Class: TestActivityCenterMultipleDeviceMedium

    Device sessions

    2. test_activity_center_reject_chats_no_pn, id: 702183
    Test is failed until fix (reason: [NOTRUN] https://github.com/status-im/status-react/issues/13476)

    Class: TestActivityCenterMultipleDeviceMedium

    3. test_deep_link_with_invalid_user_public_key_own_profile_key, id: 702244

    Device 1: Find `Button` by `accessibility id`: `new-chat-button`
    Device 1: ChatButton element not found

    Test setup failed: ( Device 1: ChatButton by accessibility id:`join-public-chat-button` is not found on the screen after wait_for_visibility_of_element)

    Class: TestDeeplinkChatProfileOneDevice

    Device sessions

    4. test_activity_center_notifications_on_mentions_in_groups_and_empty_state, id: 702185

    Device 2: Find `HomeButton` by `xpath`: `//*[contains(@content-desc,'tab, 1 out of 5')]`
    Device 2: Find `HomeButton` by `xpath`: `//*[contains(@content-desc,'tab, 1 out of 5')]`

    Device 1: Just fail to test

    Class: TestActivityCenterMultipleDeviceMedium

    Device sessions

    Passed tests (2)

    Click to expand

    1. test_browser_can_access_images_by_link, id: 702149

    Class: TestBrowserProfileOneDevice

    Device sessions

    2. test_activity_center_accept_chats_only_from_contacts, id: 702187

    Class: TestActivityCenterMultipleDeviceMedium

    Device sessions

    @churik
    Copy link
    Member Author

    churik commented Jun 13, 2022

    Failed tests (4)

    Click to expand
  • Rerun failed tests

  • 1. test_activity_center_accept_chats, id: 702184

    Device 2: Find `ProfileButton` by `xpath`: `//*[contains(@content-desc,'5 out of 5')]`
    Device 2: Sending message 'Message sender'

    Device `2`: `EditBox` by` accessibility id`: `chat-message-input` is not found on the screen after wait_for_element (possible issue: may fail due to (possible issue: may fail due to [#13456](https://github.com//issues/13476) )

    @status-im-auto
    Copy link
    Member

    20% of end-end tests have passed

    Total executed tests: 5
    Failed tests: 4
    Passed tests: 1
    
    IDs of failed tests: 702185,702183,702184,702244 
    

    Failed tests (4)

    Click to expand
  • Rerun failed tests

  • 1. test_activity_center_notifications_on_mentions_in_groups_and_empty_state, id: 702185

    Device 2: Find `HomeButton` by `xpath`: `//*[contains(@content-desc,'tab, 1 out of 5')]`
    Device 2: Find `HomeButton` by `xpath`: `//*[contains(@content-desc,'tab, 1 out of 5')]`

    Device 1: Just fail to test

    Class: TestActivityCenterMultipleDeviceMedium

    Device sessions

    2. test_activity_center_reject_chats_no_pn, id: 702183
    Test is failed until fix [reason: [NOTRUN] Failed due to #13476, recheck after fix]

    Class: TestActivityCenterMultipleDeviceMedium

    3. test_activity_center_accept_chats, id: 702184

    Device 2: Find `ProfileButton` by `xpath`: `//*[contains(@content-desc,'5 out of 5')]`
    Device 2: Sending message 'Message sender'

    Device `2`: `EditBox` by` accessibility id`: `chat-message-input` is not found on the screen after wait_for_element [may fail due to #12345 if error is bla bla]

    Class: TestActivityCenterMultipleDeviceMedium

    Device sessions

    4. test_deep_link_with_invalid_user_public_key_own_profile_key, id: 702244

    Device 1: Find `Button` by `accessibility id`: `new-chat-button`
    Device 1: ChatButton element not found

    Test setup failed: [ Device 1: ChatButton by accessibility id:`join-public-chat-button` is not found on the screen after wait_for_visibility_of_element]

    Class: TestDeeplinkChatProfileOneDevice

    Device sessions

    Passed tests (1)

    Click to expand

    1. test_browser_can_access_images_by_link, id: 702149

    Class: TestBrowserProfileOneDevice

    Device sessions

    @status-im-auto
    Copy link
    Member

    20% of end-end tests have passed

    Total executed tests: 5
    Failed tests: 4
    Passed tests: 1
    
    IDs of failed tests: 702184,702183,702244,702185 
    

    Failed tests (4)

    Click to expand
  • Rerun failed tests

  • 1. test_activity_center_accept_chats, id: 702184

    Device 2: Find `ProfileButton` by `xpath`: `//*[contains(@content-desc,'5 out of 5')]`
    Device 2: Sending message 'Message sender'

    Device `2`: `EditBox` by` accessibility id`: `chat-message-input` is not found on the screen after wait_for_element [may fail due to #12345 if error is bla bla]

    Class: TestActivityCenterMultipleDeviceMedium

    Device sessions

    2. test_activity_center_reject_chats_no_pn, id: 702183
    Test is not run, e2e blocker [reason: [NOTRUN] Failed due to #13476, recheck after fix]

    Class: TestActivityCenterMultipleDeviceMedium

    3. test_deep_link_with_invalid_user_public_key_own_profile_key, id: 702244

    Device 1: Find `Button` by `accessibility id`: `new-chat-button`
    Device 1: ChatButton element not found



    Class: TestDeeplinkChatProfileOneDevice

    Device sessions

    4. test_activity_center_notifications_on_mentions_in_groups_and_empty_state, id: 702185

    Device 2: Find `HomeButton` by `xpath`: `//*[contains(@content-desc,'tab, 1 out of 5')]`
    Device 2: Find `HomeButton` by `xpath`: `//*[contains(@content-desc,'tab, 1 out of 5')]`



    Class: TestActivityCenterMultipleDeviceMedium

    Device sessions

    Passed tests (1)

    Click to expand

    1. test_browser_can_access_images_by_link, id: 702149

    Class: TestBrowserProfileOneDevice

    Device sessions

    @status-im-auto
    Copy link
    Member

    33% of end-end tests have passed

    Total executed tests: 6
    Failed tests: 4
    Passed tests: 2
    
    IDs of failed tests: 702244,702185,702183,702184 
    

    Failed tests (4)

    Click to expand
  • Rerun failed tests

  • 1. test_deep_link_with_invalid_user_public_key_own_profile_key, id: 702244

    Device 1: Find `Button` by `accessibility id`: `new-chat-button`
    Device 1: ChatButton element not found

    Test setup failed: Device 1: ChatButton by accessibility id:`join-public-chat-button` is not found on the screen after wait_for_visibility_of_element

    Class: TestDeeplinkChatProfileOneDevice

    Device sessions

    2. test_activity_center_notifications_on_mentions_in_groups_and_empty_state, id: 702185

    Device 2: Find `HomeButton` by `xpath`: `//*[contains(@content-desc,'tab, 1 out of 5')]`
    Device 2: Find `HomeButton` by `xpath`: `//*[contains(@content-desc,'tab, 1 out of 5')]`

    Device 1: Just fail to test

    Class: TestActivityCenterMultipleDeviceMedium

    Device sessions

    3. test_activity_center_reject_chats_no_pn, id: 702183
    Test is not run, e2e blocker [[reason: [NOTRUN] Failed due to #13476, recheck after fix]]

    Class: TestActivityCenterMultipleDeviceMedium

    4. test_activity_center_accept_chats, id: 702184

    Device 2: Find `ProfileButton` by `xpath`: `//*[contains(@content-desc,'5 out of 5')]`
    Device 2: Sending message 'Message sender'

    Device `2`: `EditBox` by` accessibility id`: `chat-message-input` is not found on the screen after wait_for_element [[may fail due to #12345 if error is bla bla]]

    Class: TestActivityCenterMultipleDeviceMedium

    Device sessions

    Passed tests (2)

    Click to expand

    1. test_activity_center_accept_chats_only_from_contacts, id: 702187

    Class: TestActivityCenterMultipleDeviceMedium

    Device sessions

    2. test_browser_can_access_images_by_link, id: 702149

    Class: TestBrowserProfileOneDevice

    Device sessions

    @status-im-auto
    Copy link
    Member

    29% of end-end tests have passed

    Total executed tests: 7
    Failed tests: 5
    Passed tests: 2
    
    IDs of failed tests: 702281,702244,702185,702183,702184 
    

    Failed tests (5)

    Click to expand
  • Rerun failed tests

  • 1. test_profile_show_profile_picture_and_online_indicator_settings, id: 702281
    Test is not run, e2e blocker [[additional comment is failed]]

    Class: TestProfileGapsCommunityMediumMultipleDevicesMerged

    2. test_deep_link_with_invalid_user_public_key_own_profile_key, id: 702244

    Device 1: Find `Button` by `accessibility id`: `new-chat-button`
    Device 1: ChatButton element not found

    Test setup failed: Device 1: ChatButton by accessibility id:`join-public-chat-button` is not found on the screen after wait_for_visibility_of_element

    Class: TestDeeplinkChatProfileOneDevice

    Device sessions

    3. test_activity_center_notifications_on_mentions_in_groups_and_empty_state, id: 702185

    Device 2: Find `HomeButton` by `xpath`: `//*[contains(@content-desc,'tab, 1 out of 5')]`
    Device 2: Find `HomeButton` by `xpath`: `//*[contains(@content-desc,'tab, 1 out of 5')]`

    Device 1: Just fail to test

    Class: TestActivityCenterMultipleDeviceMedium

    Device sessions

    4. test_activity_center_reject_chats_no_pn, id: 702183
    Test is not run, e2e blocker [[reason: [NOTRUN] Failed due to #13476, recheck after fix]]

    Class: TestActivityCenterMultipleDeviceMedium

    5. test_activity_center_accept_chats, id: 702184

    Device 2: Find `ProfileButton` by `xpath`: `//*[contains(@content-desc,'5 out of 5')]`
    Device 2: Sending message 'Message sender'

    Device `2`: `EditBox` by` accessibility id`: `chat-message-input` is not found on the screen after wait_for_element [[may fail due to #12345 if error is bla bla]]

    Class: TestActivityCenterMultipleDeviceMedium

    Device sessions

    Passed tests (2)

    Click to expand

    1. test_activity_center_accept_chats_only_from_contacts, id: 702187

    Class: TestActivityCenterMultipleDeviceMedium

    Device sessions

    2. test_browser_can_access_images_by_link, id: 702149

    Class: TestBrowserProfileOneDevice

    Device sessions

    @status-im-auto
    Copy link
    Member

    86% of end-end tests have passed

    Total executed tests: 7
    Failed tests: 1
    Passed tests: 6
    
    IDs of failed tests: 702185 
    

    Failed tests (1)

    Click to expand
  • Rerun failed tests

  • 1. test_activity_center_notifications_on_mentions_in_groups_and_empty_state, id: 702185

    Device 1: Click until `EditBox` by `accessibility id`: `chat-message-input` will be presented
    Device 1: Find `Button` by `accessibility id`: `join-chat-button`

    Device 1: Button by accessibility id: `join-chat-button` is not found on the screen

    Class: TestActivityCenterMultipleDeviceMedium

    Device sessions

    Passed tests (6)

    Click to expand

    1. test_profile_show_profile_picture_and_online_indicator_settings, id: 702281

    Class: TestProfileGapsCommunityMediumMultipleDevicesMerged

    Device sessions

    2. test_deep_link_with_invalid_user_public_key_own_profile_key, id: 702244

    Class: TestDeeplinkChatProfileOneDevice

    Device sessions

    3. test_activity_center_reject_chats_no_pn, id: 702183

    Class: TestActivityCenterMultipleDeviceMedium

    Device sessions

    4. test_activity_center_accept_chats_only_from_contacts, id: 702187

    Class: TestActivityCenterMultipleDeviceMedium

    Device sessions

    5. test_activity_center_accept_chats, id: 702184

    Class: TestActivityCenterMultipleDeviceMedium

    Device sessions

    6. test_browser_can_access_images_by_link, id: 702149

    Class: TestBrowserProfileOneDevice

    Device sessions

    @status-im-auto
    Copy link
    Member

    33% of end-end tests have passed

    Total executed tests: 6
    Failed tests: 4
    Passed tests: 2
    Not executed tests: 1
    
    IDs of not executed tests: 702281 
    
    IDs of failed tests: 702184,702183,702244,702185 
    

    Not executed tests (1)

    Click to expand
  • Rerun not executed tests
  • Failed tests (4)

    Click to expand
  • Rerun failed tests

  • 1. test_activity_center_accept_chats, id: 702184

    Device 2: Find `ProfileButton` by `xpath`: `//*[contains(@content-desc,'5 out of 5')]`
    Device 2: Sending message 'Message sender'

    Device `2`: `EditBox` by` accessibility id`: `chat-message-input` is not found on the screen after wait_for_element [[may fail due to #12345 if error is bla bla]]

    Class: TestActivityCenterMultipleDeviceMedium

    Device sessions

    2. test_activity_center_reject_chats_no_pn, id: 702183
    Test is not run, e2e blocker [[reason: [NOTRUN] Failed due to #13476, recheck after fix]]

    Class: TestActivityCenterMultipleDeviceMedium

    3. test_deep_link_with_invalid_user_public_key_own_profile_key, id: 702244

    Device 1: Find `Button` by `accessibility id`: `new-chat-button`
    Device 1: ChatButton element not found

    Test setup failed: Device 1: ChatButton by accessibility id:`join-public-chat-button` is not found on the screen after wait_for_visibility_of_element

    Class: TestDeeplinkChatProfileOneDevice

    Device sessions

    4. test_activity_center_notifications_on_mentions_in_groups_and_empty_state, id: 702185

    Device 2: Find `HomeButton` by `xpath`: `//*[contains(@content-desc,'tab, 1 out of 5')]`
    Device 2: Find `HomeButton` by `xpath`: `//*[contains(@content-desc,'tab, 1 out of 5')]`

    Device 1: Just fail to test

    Class: TestActivityCenterMultipleDeviceMedium

    Device sessions

    Passed tests (2)

    Click to expand

    1. test_browser_can_access_images_by_link, id: 702149

    Class: TestBrowserProfileOneDevice

    Device sessions

    2. test_activity_center_accept_chats_only_from_contacts, id: 702187

    Class: TestActivityCenterMultipleDeviceMedium

    Device sessions

    @status-im-auto
    Copy link
    Member

    0% of end-end tests have passed

    Total executed tests: 7
    Failed tests: 7
    Passed tests: 0
    
    IDs of failed tests: 702281,702184,702285,702284,702183,702244,702185 
    

    Failed tests (7)

    Click to expand
  • Rerun failed tests

  • 1. test_profile_show_profile_picture_and_online_indicator_settings, id: 702281

    Device 2: EditBox element not found
    Device 2: Find `Button` by `accessibility id`: `join-chat-button`

    Test setup failed: Device 2: Button by accessibility id: `join-chat-button` is not found on the screen [[additional comment is failed]]

    Class: TestProfileGapsCommunityMediumMultipleDevicesMerged

    Device sessions

    2. test_activity_center_accept_chats, id: 702184

    Device 2: Find `ProfileButton` by `xpath`: `//*[contains(@content-desc,'5 out of 5')]`
    Device 2: Sending message 'Message sender'

    Device `2`: `EditBox` by` accessibility id`: `chat-message-input` is not found on the screen after wait_for_element [[may fail due to #12345 if error is bla bla]]

    Class: TestActivityCenterMultipleDeviceMedium

    Device sessions

    3. test_profile_custom_bootnodes_enable_disable, id: 702285
    Test setup failed: Device 1: FAILING ON SETUP special

    Class: TestTimelineHistoryNodesBootnodesMultipleDeviceMergedMedium

    4. test_public_chat_timeline_different_statuses_reaction, id: 702284

    Device 2: Find `Button` by `accessibility id`: `lets-go-button`
    ## New multiaccount is created successfully!

    Test setup failed: Device 1: FAILING ON SETUP special [[some additional comment]]

    Class: TestTimelineHistoryNodesBootnodesMultipleDeviceMergedMedium

    Device sessions

    5. test_activity_center_reject_chats_no_pn, id: 702183
    Test is not run, e2e blocker [[reason: [NOTRUN] Failed due to #13476, recheck after fix]]

    Class: TestActivityCenterMultipleDeviceMedium

    6. test_deep_link_with_invalid_user_public_key_own_profile_key, id: 702244

    Device 1: Find `Button` by `accessibility id`: `new-chat-button`
    Device 1: ChatButton element not found

    Test setup failed: Device 1: ChatButton by accessibility id:`join-public-chat-button` is not found on the screen after wait_for_visibility_of_element

    Class: TestDeeplinkChatProfileOneDevice

    Device sessions

    7. test_activity_center_notifications_on_mentions_in_groups_and_empty_state, id: 702185

    Device 2: Find `HomeButton` by `xpath`: `//*[contains(@content-desc,'tab, 1 out of 5')]`
    Device 2: Find `HomeButton` by `xpath`: `//*[contains(@content-desc,'tab, 1 out of 5')]`

    Device 1: Just fail to test [[something weird may happen]]

    Class: TestActivityCenterMultipleDeviceMedium

    Device sessions

    @churik churik force-pushed the tests/db-performance branch 2 times, most recently from 8550ae1 to c68c817 Compare June 14, 2022 13:29
    @status-im-auto
    Copy link
    Member

    52% of end-end tests have passed

    Total executed tests: 21
    Failed tests: 10
    Passed tests: 11
    
    IDs of failed tests: 702269,702258,695890,702295,702273,702185,3998,702272,702270,702271 
    

    Failed tests (10)

    Click to expand
  • Rerun failed tests

  • 1. test_pairing_sync_initial_community_send_message, id: 702269

    Device 3: EditBox element not found
    Device 3: Find `Button` by `accessibility id`: `join-chat-button`

    Test setup failed: Device 3: Button by accessibility id: `join-chat-button` is not found on the screen [[too long setup, can fail with Remote end closed connection]]

    Class: TestPairingSyncMediumMultipleDevicesMerged

    Device sessions

    2. test_chat_group_chat_set_nickname_and_ens_via_group_info_mention, id: 702258

    Device 2: Click until `EditBox` by `accessibility id`: `chat-message-input` will be presented
    Device 2: Find `Button` by `accessibility id`: `join-chat-button`

    Device 2: Button by accessibility id: `join-chat-button` is not found on the screen

    Class: TestChatMediumMultipleDevice

    Device sessions

    3. test_profile_use_another_fleets_balance_bsc_xdai_advanced_set_nonce, id: 695890

    Device 1: Find `AdvancedButton` by `accessibility id`: `advanced-button`
    Device 1: Find `AdvancedButton` by `accessibility id`: `advanced-button`

    Device 1: AdvancedButton by accessibility id: `advanced-button` is not found on the screen; also Unexpected Alert is shown: 'nonce too low'

    Device sessions

    4. test_keycard_1_1_chat_command_request_and_send_tx_stt_in_1_1_chat_offline_opened_from_push, id: 702295

    Device 2: Finding transaction by amount 0.00014131046
    Device 2: Find `TransactionElement` by `xpath`: `(//android.widget.TextView[contains(@text,'0.00014131046 STT')])`

    Push notification is not received after going back from offline

    Class: TestChatKeycardMentionsMediumMultipleDevice

    Device sessions

    5. test_pairing_sync_group_chat_send_different_messages, id: 702273
    Test setup failed: Device 3: Button by accessibility id: `join-chat-button` is not found on the screen

    Class: TestPairingSyncMediumMultipleDevicesMerged

    6. test_activity_center_notifications_on_mentions_in_groups_and_empty_state, id: 702185

    Device 1: Looking for chat: 'Weary Soupy Siberiantiger'
    Device 1: Find `ChatMessagePreview` by `xpath`: `//*[@content-desc='chat-name-or-sender-text'][starts-with(@text,'Weary Soupy Siberiantiger')]/../..//*[@content-desc='chat-message-text']`

    Device 1: ChatMessagePreview by xpath: `//*[@content-desc='chat-name-or-sender-text'][starts-with(@text,'Weary Soupy Siberiantiger')]/../..//*[@content-desc='chat-message-text']` is not found on the screen

    Class: TestActivityCenterMultipleDeviceMedium

    Device sessions

    7. test_group_chat_offline_pn, id: 3998

    Device 2: Click until `EditBox` by `accessibility id`: `chat-message-input` will be presented
    Device 2: Find `Button` by `accessibility id`: `join-chat-button`

    Device 2: Button by accessibility id: `join-chat-button` is not found on the screen [[mysterious issue when PNs are not fetched from offline, can not reproduce on real devices]]

    Class: TestGroupChatMultipleDeviceMerged

    Device sessions

    8. test_pairing_sync_community_add_new, id: 702272
    Test setup failed: Device 3: Button by accessibility id: `join-chat-button` is not found on the screen

    Class: TestPairingSyncMediumMultipleDevicesMerged

    9. test_pairing_sync_community_add_new_channel, id: 702270
    Test setup failed: Device 3: Button by accessibility id: `join-chat-button` is not found on the screen

    Class: TestPairingSyncMediumMultipleDevicesMerged

    10. test_pairing_sync_community_leave, id: 702271
    Test setup failed: Device 3: Button by accessibility id: `join-chat-button` is not found on the screen

    Class: TestPairingSyncMediumMultipleDevicesMerged

    Passed tests (11)

    Click to expand

    1. test_keycard_relogin_after_restore, id: 700768

    Class: TestKeycardTxOneDeviceMerged

    Device sessions

    2. test_1_1_chat_command_request_and_send_tx_stt_in_1_1_chat_offline, id: 6263

    Class: TestCommandsMultipleDevicesMerged

    Device sessions

    3. test_chat_group_chat_rename, id: 702098

    Class: TestChatMediumMultipleDevice

    Device sessions

    4. test_keycard_send_tx_sign_message_request_stt_testdapp, id: 700769

    Class: TestKeycardTxOneDeviceMerged

    Device sessions

    5. test_sticker_1_1_public_chat, id: 702157

    Class: TestEnsStickersMultipleDevicesMerged

    Device sessions

    6. test_chat_1_1_pin_messages, id: 702069

    Class: TestChatMediumMultipleDevice

    Device sessions

    7. test_chat_pin_messages_in_group_chat, id: 702070

    Class: TestChatMediumMultipleDevice

    Device sessions

    8. test_chat_public_markdown_support, id: 702065

    Class: TestChatMediumMultipleDevice

    Device sessions

    9. test_chat_1_1_push_and_reaction_for_messages_sticker_audio_image, id: 702066

    Class: TestChatMediumMultipleDevice

    Device sessions

    10. test_chat_block_and_unblock_user_from_group_chat_via_group_info, id: 702097

    Class: TestChatMediumMultipleDevice

    Device sessions

    11. test_testdapp_deploy_simple_contract_send_tx, id: 702326

    Class: TestWalletTestDappMediumMultipleDevicesMerged

    Device sessions

    @status-im-auto
    Copy link
    Member

    60% of end-end tests have passed

    Total executed tests: 10
    Failed tests: 4
    Passed tests: 6
    
    IDs of failed tests: 695890,702295,702185,3998 
    

    Failed tests (4)

    Click to expand
  • Rerun failed tests

  • 1. test_profile_use_another_fleets_balance_bsc_xdai_advanced_set_nonce, id: 695890

    ## Sign in (password:qwerty, keycard:False)
    Device 1: Find `EditBox` by `accessibility id`: `password-input`

    Device 1: EditBox by accessibility id: `password-input` is not found on the screen; also Unexpected Alert is shown: 'TypeError: Network request failed'

    Device sessions

    2. test_keycard_1_1_chat_command_request_and_send_tx_stt_in_1_1_chat_offline_opened_from_push, id: 702295

    Device 2: Finding transaction by amount 0.00014141716
    Device 2: Find `TransactionElement` by `xpath`: `(//android.widget.TextView[contains(@text,'0.00014141716 STT')])`

    Push notification is not received after going back from offline [[mysterious issue when PNs are not fetched from offline, can not reproduce on real devices; needs investigation]]

    Class: TestChatKeycardMentionsMediumMultipleDevice

    Device sessions

    3. test_activity_center_notifications_on_mentions_in_groups_and_empty_state, id: 702185

    Device 1: Looking for chat: 'Muddy Grim Bighorn'
    Device 1: Find `ChatMessagePreview` by `xpath`: `//*[@content-desc='chat-name-or-sender-text'][starts-with(@text,'Muddy Grim Bighorn')]/../..//*[@content-desc='chat-message-text']`

    Device 1: ChatMessagePreview by xpath: `//*[@content-desc='chat-name-or-sender-text'][starts-with(@text,'Muddy Grim Bighorn')]/../..//*[@content-desc='chat-message-text']` is not found on the screen

    Class: TestActivityCenterMultipleDeviceMedium

    Device sessions

    4. test_group_chat_offline_pn, id: 3998

    Device 2: Click until `EditBox` by `accessibility id`: `chat-message-input` will be presented
    Device 2: Find `Button` by `accessibility id`: `join-chat-button`

    Device 2: Button by accessibility id: `join-chat-button` is not found on the screen [[mysterious issue when PNs are not fetched from offline, can not reproduce on real devices; needs investigation]]

    Class: TestGroupChatMultipleDeviceMerged

    Device sessions

    Passed tests (6)

    Click to expand

    1. test_pairing_sync_initial_community_send_message, id: 702269

    Class: TestPairingSyncMediumMultipleDevicesMerged

    Device sessions

    2. test_chat_group_chat_set_nickname_and_ens_via_group_info_mention, id: 702258

    Class: TestChatMediumMultipleDevice

    Device sessions

    3. test_pairing_sync_group_chat_send_different_messages, id: 702273

    Class: TestPairingSyncMediumMultipleDevicesMerged

    Device sessions

    4. test_pairing_sync_community_add_new, id: 702272

    Class: TestPairingSyncMediumMultipleDevicesMerged

    Device sessions

    5. test_pairing_sync_community_add_new_channel, id: 702270

    Class: TestPairingSyncMediumMultipleDevicesMerged

    Device sessions

    6. test_pairing_sync_community_leave, id: 702271

    Class: TestPairingSyncMediumMultipleDevicesMerged

    Device sessions

    @churik churik changed the title [WIP] db generation Db generation test and xfail Jun 14, 2022
    @churik churik merged commit a141c75 into develop Jun 14, 2022
    @churik churik deleted the tests/db-performance branch June 14, 2022 15:04
    Pipeline for QA automation moved this from REVIEW to DONE Jun 14, 2022
    Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
    Labels
    Projects
    Archived in project
    Development

    Successfully merging this pull request may close these issues.

    None yet

    3 participants