Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Ongoing replication e2e test is flaky #8583

Closed
garethbowen opened this issue Sep 24, 2023 · 3 comments · Fixed by #8625
Closed

Ongoing replication e2e test is flaky #8583

garethbowen opened this issue Sep 24, 2023 · 3 comments · Fixed by #8625
Assignees
@dianabarsan
Labels
Flaky Indicates a flaky or unreliable test Type: Technical issue Improve something that users won't notice
Milestone
4.5.0

Comments

@garethbowen
Copy link
Member

Describe the issue
This test has failed a couple of times on master lately:

https://github.com/medic/cht-core/actions/runs/6291825895/job/17080708783#step:16:954
https://github.com/medic/cht-core/actions/runs/6254360099/job/16982086351#step:16:890

Logs

------------------------------------------------------------------
[chrome 117.0.5938.88 linux #0-3] Running: chrome (v117.0.5938.88) on linux
[chrome 117.0.5938.88 linux #0-3] Session ID: e4d53aea-6d21-4c5a-b5e9-29692e278fc6
[chrome 117.0.5938.88 linux #0-3]
[chrome 117.0.5938.88 linux #0-3] » /tests/e2e/default/db/ongoing-replication.wdio-spec.js
[chrome 117.0.5938.88 linux #0-3] ongoing replication
[chrome 117.0.5938.88 linux #0-3]    ✓ should download new documents 
[chrome 117.0.5938.88 linux #0-3]    ✓ should handle updates to existing documents
[chrome 117.0.5938.88 linux #0-3]    ✓ should download new forms and update forms
[chrome 117.0.5938.88 linux #0-3]    ✓ should download new languages and language updates
[chrome 117.0.5938.88 linux #0-3]    ✖ should handle deletes
[chrome 117.0.5938.88 linux #0-3]    ✖ should handle deletes
[chrome 117.0.5938.88 linux #0-3]    ✖ should handle deletes
[chrome 117.0.5938.88 linux #0-3]    ✖ should handle deletes
[chrome 117.0.5938.88 linux #0-3]    ✖ should handle deletes
[chrome 117.0.5938.88 linux #0-3]    ✖ should handle deletes
[chrome 117.0.5938.88 linux #0-3]    ✖ should download settings updates
[chrome 117.0.5938.88 linux #0-3]    ✖ should download settings updates
[chrome 117.0.5938.88 linux #0-3]    ✖ should download settings updates
[chrome 117.0.5938.88 linux #0-3]    ✖ should download settings updates
[chrome 117.0.5938.88 linux #0-3]    ✖ should download settings updates
[chrome 117.0.5938.88 linux #0-3]    ✖ should download settings updates
[chrome 117.0.5938.88 linux #0-3]    ✖ should handle conflicts
[chrome 117.0.5938.88 linux #0-3]    ✖ should handle conflicts
[chrome 117.0.5938.88 linux #0-3]    ✖ should handle conflicts
[chrome 117.0.5938.88 linux #0-3]    ✖ should handle conflicts
[chrome 117.0.5938.88 linux #0-3]    ✖ should handle conflicts
[chrome 117.0.5938.88 linux #0-3]    ✖ should handle conflicts
[chrome 117.0.5938.88 linux #0-3]
[chrome 117.0.5938.88 linux #0-3] 4 passing (8m 48.7s)
[chrome 117.0.5938.88 linux #0-3] 3 failing
[chrome 117.0.5938.88 linux #0-3]
[chrome 117.0.5938.88 linux #0-3] 1) ongoing replication should handle deletes
[chrome 117.0.5938.88 linux #0-3] Timed out looking for details in logs.
[chrome 117.0.5938.88 linux #0-3] Error: Timed out looking for details in logs.
[chrome 117.0.5938.88 linux #0-3]     at Timeout._onTimeout (/home/runner/work/cht-core/cht-core/tests/utils/index.js:1079:14)
[chrome 117.0.5938.88 linux #0-3]     at listOnTimeout (node:internal/timers:559:17)
[chrome 117.0.5938.88 linux #0-3]     at processTimers (node:internal/timers:502:7)
[chrome 117.0.5938.88 linux #0-3]
[chrome 117.0.5938.88 linux #0-3] 2) ongoing replication should handle deletes
[chrome 117.0.5938.88 linux #0-3] Timed out looking for details in logs.
[chrome 117.0.5938.88 linux #0-3] Error: Timed out looking for details in logs.
[chrome 117.0.5938.88 linux #0-3]     at Timeout._onTimeout (/home/runner/work/cht-core/cht-core/tests/utils/index.js:1079:14)
[chrome 117.0.5938.88 linux #0-3]     at listOnTimeout (node:internal/timers:559:17)
[chrome 117.0.5938.88 linux #0-3]     at processTimers (node:internal/timers:502:7)
[chrome 117.0.5938.88 linux #0-3]
[chrome 117.0.5938.88 linux #0-3] 3) ongoing replication should handle deletes
[chrome 117.0.5938.88 linux #0-3] element ("#header-dropdown-link") still not clickable after 15000ms
[chrome 117.0.5938.88 linux #0-3] Error: element ("#header-dropdown-link") still not clickable after 15000ms
[chrome 117.0.5938.88 linux #0-3]     at async openHamburgerMenu (/home/runner/work/cht-core/cht-core/tests/page-objects/default/common/common.wdio.page.js:155:5)
[chrome 117.0.5938.88 linux #0-3]     at async syncAndWaitForSuccess (/home/runner/work/cht-core/cht-core/tests/page-objects/default/common/common.wdio.page.js:290:3)
[chrome 117.0.5938.88 linux #0-3]     at async Object.sync (/home/runner/work/cht-core/cht-core/tests/page-objects/default/common/common.wdio.page.js:301:3)
[chrome 117.0.5938.88 linux #0-3]
[chrome 117.0.5938.88 linux #0-3] 4) ongoing replication should handle deletes
[chrome 117.0.5938.88 linux #0-3] element ("#header-dropdown-link") still not clickable after 15000ms
[chrome 117.0.5938.88 linux #0-3] Error: element ("#header-dropdown-link") still not clickable after 15000ms
[chrome 117.0.5938.88 linux #0-3]     at async openHamburgerMenu (/home/runner/work/cht-core/cht-core/tests/page-objects/default/common/common.wdio.page.js:155:5)
[chrome 117.0.5938.88 linux #0-3]     at async syncAndWaitForSuccess (/home/runner/work/cht-core/cht-core/tests/page-objects/default/common/common.wdio.page.js:288:3)
[chrome 117.0.5938.88 linux #0-3]     at async Object.sync (/home/runner/work/cht-core/cht-core/tests/page-objects/default/common/common.wdio.page.js:301:3)
[chrome 117.0.5938.88 linux #0-3]
[chrome 117.0.5938.88 linux #0-3] 5) ongoing replication should handle deletes
[chrome 117.0.5938.88 linux #0-3] element ("#header-dropdown-link") still not clickable after 15000ms
[chrome 117.0.5938.88 linux #0-3] Error: element ("#header-dropdown-link") still not clickable after 15000ms
[chrome 117.0.5938.88 linux #0-3]     at async openHamburgerMenu (/home/runner/work/cht-core/cht-core/tests/page-objects/default/common/common.wdio.page.js:155:5)
[chrome 117.0.5938.88 linux #0-3]     at async syncAndWaitForSuccess (/home/runner/work/cht-core/cht-core/tests/page-objects/default/common/common.wdio.page.js:288:3)
[chrome 117.0.5938.88 linux #0-3]     at async Object.sync (/home/runner/work/cht-core/cht-core/tests/page-objects/default/common/common.wdio.page.js:301:3)
[chrome 117.0.5938.88 linux #0-3]
[chrome 117.0.5938.88 linux #0-3] 6) ongoing replication should handle deletes
[chrome 117.0.5938.88 linux #0-3] element ("#header-dropdown-link") still not clickable after 15000ms
[chrome 117.0.5938.88 linux #0-3] Error: element ("#header-dropdown-link") still not clickable after 15000ms
[chrome 117.0.5938.88 linux #0-3]     at async openHamburgerMenu (/home/runner/work/cht-core/cht-core/tests/page-objects/default/common/common.wdio.page.js:155:5)
[chrome 117.0.5938.88 linux #0-3]     at async syncAndWaitForSuccess (/home/runner/work/cht-core/cht-core/tests/page-objects/default/common/common.wdio.page.js:288:3)
[chrome 117.0.5938.88 linux #0-3]     at async Object.sync (/home/runner/work/cht-core/cht-core/tests/page-objects/default/common/common.wdio.page.js:301:3)
[chrome 117.0.5938.88 linux #0-3]
[chrome 117.0.5938.88 linux #0-3] 7) ongoing replication should download settings updates
[chrome 117.0.5938.88 linux #0-3] element ("#header-dropdown-link") still not clickable after 15000ms
[chrome 117.0.5938.88 linux #0-3] Error: element ("#header-dropdown-link") still not clickable after 15000ms
[chrome 117.0.5938.88 linux #0-3]     at async openHamburgerMenu (/home/runner/work/cht-core/cht-core/tests/page-objects/default/common/common.wdio.page.js:155:5)
[chrome 117.0.5938.88 linux #0-3]     at async syncAndWaitForSuccess (/home/runner/work/cht-core/cht-core/tests/page-objects/default/common/common.wdio.page.js:290:3)
[chrome 117.0.5938.88 linux #0-3]     at async Object.sync (/home/runner/work/cht-core/cht-core/tests/page-objects/default/common/common.wdio.page.js:306:3)
[chrome 117.0.5938.88 linux #0-3]
[chrome 117.0.5938.88 linux #0-3] 8) ongoing replication should download settings updates
[chrome 117.0.5938.88 linux #0-3] A previous test did not call revertSettings
[chrome 117.0.5938.88 linux #0-3] Error: A previous test did not call revertSettings
[chrome 117.0.5938.88 linux #0-3]     at updateCustomSettings (/home/runner/work/cht-core/cht-core/tests/utils/index.js:438:11)
[chrome 117.0.5938.88 linux #0-3]     at Object.updateSettings (/home/runner/work/cht-core/cht-core/tests/utils/index.js:483:9)
[chrome 117.0.5938.88 linux #0-3]     at processTicksAndRejections (node:internal/process/task_queues:96:5)
[chrome 117.0.5938.88 linux #0-3]     at async Context.<anonymous> (/home/runner/work/cht-core/cht-core/tests/e2e/default/db/ongoing-replication.wdio-spec.js:173:5)
[chrome 117.0.5938.88 linux #0-3]
[chrome 117.0.5938.88 linux #0-3] 9) ongoing replication should download settings updates
[chrome 117.0.5938.88 linux #0-3] A previous test did not call revertSettings
[chrome 117.0.5938.88 linux #0-3] Error: A previous test did not call revertSettings
[chrome 117.0.5938.88 linux #0-3]     at updateCustomSettings (/home/runner/work/cht-core/cht-core/tests/utils/index.js:438:11)
[chrome 117.0.5938.88 linux #0-3]     at Object.updateSettings (/home/runner/work/cht-core/cht-core/tests/utils/index.js:483:9)
[chrome 117.0.5938.88 linux #0-3]     at processTicksAndRejections (node:internal/process/task_queues:96:5)
[chrome 117.0.5938.88 linux #0-3]     at async Context.<anonymous> (/home/runner/work/cht-core/cht-core/tests/e2e/default/db/ongoing-replication.wdio-spec.js:173:5)
[chrome 117.0.5938.88 linux #0-3]
[chrome 117.0.5938.88 linux #0-3] 10) ongoing replication should download settings updates
[chrome 117.0.5938.88 linux #0-3] A previous test did not call revertSettings
[chrome 117.0.5938.88 linux #0-3] Error: A previous test did not call revertSettings
[chrome 117.0.5938.88 linux #0-3]     at updateCustomSettings (/home/runner/work/cht-core/cht-core/tests/utils/index.js:438:11)
[chrome 117.0.5938.88 linux #0-3]     at Object.updateSettings (/home/runner/work/cht-core/cht-core/tests/utils/index.js:483:9)
[chrome 117.0.5938.88 linux #0-3]     at processTicksAndRejections (node:internal/process/task_queues:96:5)
[chrome 117.0.5938.88 linux #0-3]     at async Context.<anonymous> (/home/runner/work/cht-core/cht-core/tests/e2e/default/db/ongoing-replication.wdio-spec.js:173:5)
[chrome 117.0.5938.88 linux #0-3]
[chrome 117.0.5938.88 linux #0-3] 11) ongoing replication should download settings updates
[chrome 117.0.5938.88 linux #0-3] A previous test did not call revertSettings
[chrome 117.0.5938.88 linux #0-3] Error: A previous test did not call revertSettings
[chrome 117.0.5938.88 linux #0-3]     at updateCustomSettings (/home/runner/work/cht-core/cht-core/tests/utils/index.js:438:11)
[chrome 117.0.5938.88 linux #0-3]     at Object.updateSettings (/home/runner/work/cht-core/cht-core/tests/utils/index.js:483:9)
[chrome 117.0.5938.88 linux #0-3]     at processTicksAndRejections (node:internal/process/task_queues:96:5)
[chrome 117.0.5938.88 linux #0-3]     at async Context.<anonymous> (/home/runner/work/cht-core/cht-core/tests/e2e/default/db/ongoing-replication.wdio-spec.js:173:5)
[chrome 117.0.5938.88 linux #0-3]
[chrome 117.0.5938.88 linux #0-3] 12) ongoing replication should download settings updates
[chrome 117.0.5938.88 linux #0-3] A previous test did not call revertSettings
[chrome 117.0.5938.88 linux #0-3] Error: A previous test did not call revertSettings
[chrome 117.0.5938.88 linux #0-3]     at updateCustomSettings (/home/runner/work/cht-core/cht-core/tests/utils/index.js:438:11)
[chrome 117.0.5938.88 linux #0-3]     at Object.updateSettings (/home/runner/work/cht-core/cht-core/tests/utils/index.js:483:9)
[chrome 117.0.5938.88 linux #0-3]     at processTicksAndRejections (node:internal/process/task_queues:96:5)
[chrome 117.0.5938.88 linux #0-3]     at async Context.<anonymous> (/home/runner/work/cht-core/cht-core/tests/e2e/default/db/ongoing-replication.wdio-spec.js:173:5)
[chrome 117.0.5938.88 linux #0-3]
[chrome 117.0.5938.88 linux #0-3] 13) ongoing replication should handle conflicts
[chrome 117.0.5938.88 linux #0-3] element ("#header-dropdown-link") still not clickable after 15000ms
[chrome 117.0.5938.88 linux #0-3] Error: element ("#header-dropdown-link") still not clickable after 15000ms
[chrome 117.0.5938.88 linux #0-3]     at async openHamburgerMenu (/home/runner/work/cht-core/cht-core/tests/page-objects/default/common/common.wdio.page.js:155:5)
[chrome 117.0.5938.88 linux #0-3]     at async syncAndWaitForSuccess (/home/runner/work/cht-core/cht-core/tests/page-objects/default/common/common.wdio.page.js:288:3)
[chrome 117.0.5938.88 linux #0-3]     at async Object.sync (/home/runner/work/cht-core/cht-core/tests/page-objects/default/common/common.wdio.page.js:301:3)
[chrome 117.0.5938.88 linux #0-3]
[chrome 117.0.5938.88 linux #0-3] 14) ongoing replication should handle conflicts
[chrome 117.0.5938.88 linux #0-3] element ("#header-dropdown-link") still not clickable after 15000ms
[chrome 117.0.5938.88 linux #0-3] Error: element ("#header-dropdown-link") still not clickable after 15000ms
[chrome 117.0.5938.88 linux #0-3]     at async openHamburgerMenu (/home/runner/work/cht-core/cht-core/tests/page-objects/default/common/common.wdio.page.js:155:5)
[chrome 117.0.5938.88 linux #0-3]     at async syncAndWaitForSuccess (/home/runner/work/cht-core/cht-core/tests/page-objects/default/common/common.wdio.page.js:288:3)
[chrome 117.0.5938.88 linux #0-3]     at async Object.sync (/home/runner/work/cht-core/cht-core/tests/page-objects/default/common/common.wdio.page.js:301:3)
[chrome 117.0.5938.88 linux #0-3]
[chrome 117.0.5938.88 linux #0-3] 15) ongoing replication should handle conflicts
[chrome 117.0.5938.88 linux #0-3] element ("#header-dropdown-link") still not clickable after 15000ms
[chrome 117.0.5938.88 linux #0-3] Error: element ("#header-dropdown-link") still not clickable after 15000ms
[chrome 117.0.5938.88 linux #0-3]     at async openHamburgerMenu (/home/runner/work/cht-core/cht-core/tests/page-objects/default/common/common.wdio.page.js:155:5)
[chrome 117.0.5938.88 linux #0-3]     at async syncAndWaitForSuccess (/home/runner/work/cht-core/cht-core/tests/page-objects/default/common/common.wdio.page.js:288:3)
[chrome 117.0.5938.88 linux #0-3]     at async Object.sync (/home/runner/work/cht-core/cht-core/tests/page-objects/default/common/common.wdio.page.js:301:3)
[chrome 117.0.5938.88 linux #0-3]
[chrome 117.0.5938.88 linux #0-3] 16) ongoing replication should handle conflicts
[chrome 117.0.5938.88 linux #0-3] element ("#header-dropdown-link") still not clickable after 15000ms
[chrome 117.0.5938.88 linux #0-3] Error: element ("#header-dropdown-link") still not clickable after 15000ms
[chrome 117.0.5938.88 linux #0-3]     at async openHamburgerMenu (/home/runner/work/cht-core/cht-core/tests/page-objects/default/common/common.wdio.page.js:155:5)
[chrome 117.0.5938.88 linux #0-3]     at async syncAndWaitForSuccess (/home/runner/work/cht-core/cht-core/tests/page-objects/default/common/common.wdio.page.js:288:3)
[chrome 117.0.5938.88 linux #0-3]     at async Object.sync (/home/runner/work/cht-core/cht-core/tests/page-objects/default/common/common.wdio.page.js:301:3)
[chrome 117.0.5938.88 linux #0-3]
[chrome 117.0.5938.88 linux #0-3] 17) ongoing replication should handle conflicts
[chrome 117.0.5938.88 linux #0-3] element ("#header-dropdown-link") still not clickable after 15000ms
[chrome 117.0.5938.88 linux #0-3] Error: element ("#header-dropdown-link") still not clickable after 15000ms
[chrome 117.0.5938.88 linux #0-3]     at async openHamburgerMenu (/home/runner/work/cht-core/cht-core/tests/page-objects/default/common/common.wdio.page.js:155:5)
[chrome 117.0.5938.88 linux #0-3]     at async syncAndWaitForSuccess (/home/runner/work/cht-core/cht-core/tests/page-objects/default/common/common.wdio.page.js:288:3)
[chrome 117.0.5938.88 linux #0-3]     at async Object.sync (/home/runner/work/cht-core/cht-core/tests/page-objects/default/common/common.wdio.page.js:301:3)
[chrome 117.0.5938.88 linux #0-3]
[chrome 117.0.5938.88 linux #0-3] 18) ongoing replication should handle conflicts
[chrome 117.0.5938.88 linux #0-3] element ("#header-dropdown-link") still not clickable after 15000ms
[chrome 117.0.5938.88 linux #0-3] Error: element ("#header-dropdown-link") still not clickable after 15000ms
[chrome 117.0.5938.88 linux #0-3]     at async openHamburgerMenu (/home/runner/work/cht-core/cht-core/tests/page-objects/default/common/common.wdio.page.js:155:5)
[chrome 117.0.5938.88 linux #0-3]     at async syncAndWaitForSuccess (/home/runner/work/cht-core/cht-core/tests/page-objects/default/common/common.wdio.page.js:288:3)
[chrome 117.0.5938.88 linux #0-3]     at async Object.sync (/home/runner/work/cht-core/cht-core/tests/page-objects/default/common/common.wdio.page.js:301:3)
------------------------------------------------------------------
@garethbowen garethbowen added Type: Technical issue Improve something that users won't notice Flaky Indicates a flaky or unreliable test labels Sep 24, 2023
@dianabarsan dianabarsan self-assigned this Sep 26, 2023
@dianabarsan
Copy link
Member

This is a little weird.
The timer that expires looks for a service worker update after deleting a language. The language deletion does make it to API and does trigger translation updates and reloading transitions, but it seems like the code to regenerate the service worker never runs.

For reference, these are the API logs from the event:

2023-09-24T19:22:02.253 REQ: f1fb7033-99d3-4c3c-92f4-bd0cce9851c9 172.18.0.1 admin POST /medic-test/_all_docs?include_docs=true HTTP/1.0
[0-3] 2023-09-24T19:22:02.464 RES: f1fb7033-99d3-4c3c-92f4-bd0cce9851c9 172.18.0.1 admin POST /medic-test/_all_docs?include_docs=true HTTP/1.0 200 - 56.105 ms
[0-3] 2023-09-24T19:22:02.494 REQ: e2948b7b-dba0-4e51-9442-3c25e57484af 172.18.0.1 admin POST /medic-test/_bulk_docs HTTP/1.0
[0-3] 2023-09-24T19:22:02.638 DEBUG: Checking for a configured outgoing message service 
[0-3] 2023-09-24T19:22:03.638 DEBUG: Checking for a configured outgoing message service 
[0-3] 2023-09-24T19:22:03.966 INFO: Detected form change for form:dummy 
[0-3] 2023-09-24T19:22:04.553 INFO: Detected translations change - reloading 
[0-3] 2023-09-24T19:22:04.639 DEBUG: Checking for a configured outgoing message service 
[0-3] 2023-09-24T19:22:05.349 WARN: Disabled transition "update_clinics" 
[0-3] 2023-09-24T19:22:05.353 WARN: Disabled transition "self_report" 
[0-3] 2023-09-24T19:22:05.354 WARN: Disabled transition "registration" 
[0-3] 2023-09-24T19:22:05.354 WARN: Disabled transition "accept_patient_reports" 
[0-3] 2023-09-24T19:22:05.355 WARN: Disabled transition "accept_case_reports" 
[0-3] 2023-09-24T19:22:05.356 WARN: Disabled transition "generate_shortcode_on_contacts" 
[0-3] 2023-09-24T19:22:05.357 INFO: Loading transition "generate_patient_id_on_people" 
[0-3] 2023-09-24T19:22:05.357 INFO: Skipping asynchronous transition "generate_patient_id_on_people" 
[0-3] 2023-09-24T19:22:05.357 WARN: Disabled transition "default_responses" 
[0-3] 2023-09-24T19:22:05.358 WARN: Disabled transition "update_sent_by" 
[0-3] 2023-09-24T19:22:05.358 INFO: Loading transition "death_reporting" 
[0-3] 2023-09-24T19:22:05.359 WARN: Disabled transition "conditional_alerts" 
[0-3] 2023-09-24T19:22:05.359 WARN: Disabled transition "multi_report_alerts" 
[0-3] 2023-09-24T19:22:05.360 WARN: Disabled transition "update_notifications" 
[0-3] 2023-09-24T19:22:05.360 WARN: Disabled transition "update_scheduled_reports" 
[0-3] 2023-09-24T19:22:05.360 WARN: Disabled transition "resolve_pending" 
[0-3] 2023-09-24T19:22:05.375 WARN: Disabled transition "muting" 
[0-3] 2023-09-24T19:22:05.375 WARN: Disabled transition "mark_for_outbound" 
[0-3] 2023-09-24T19:22:05.375 WARN: Disabled transition "create_user_for_contacts" 
[0-3] 2023-09-24T19:22:05.638 DEBUG: Checking for a configured outgoing message service 
[0-3] 2023-09-24T19:22:05.780 RES: e2948b7b-dba0-4e51-9442-3c25e57484af 172.18.0.1 admin POST /medic-test/_bulk_docs HTTP/1.0 201 7080 3285.175 ms
[0-3] 2023-09-24T19:22:05.809 REQ: 5dc0a813-f165-4d73-9427-5633569fbcec 172.18.0.1 admin GET /medic-test-sentinel/_local/transitions-seq? HTTP/1.0
[0-3] 2023-09-24T19:22:05.976 RES: 5dc0a813-f165-4d73-9427-5633569fbcec 172.18.0.1 admin GET /medic-test-sentinel/_local/transitions-seq? HTTP/1.0 200 504 166.684 ms
[0-3] 2023-09-24T19:22:06.000 REQ: c521e234-3994-4564-a5ae-4ae27fd3cfa0 172.18.0.1 admin GET /medic-test/_changes?since=6916-g1AAAARFeJyl0zFOwzAUBmBDkVhYEXdAAqVxnNoSEgxMbND6ALEdK4oCnZjZ2Rm4ALS-RAV36CV6AgZa99V5Q4dEIHn6lSjv09NvpyGEnFQDQ8709FlXRt1gXqSXzVQXTQMfHBZEnUo5qauBgqfvR3h3rEVuTcb6JzvV4Z66M6U6d26OsAswV0bketQ_3AnTfRhMp6693yB8FeBRKYpEif7hP3vYmV7B1mOE3wNsRc650TFVgDlRtXMzhF8DrFhKTU5jqgBzrl68X7fwwU-AGU0Ey7o6_ncVYG6ejsiDlG-4c9a2TJNSD3lEGaCOQYX4hHNE_K7dOy0oi7oboM5Ahfj1foGlfAU8zS21rIwoBdQ1qBD3Ui4R9wFPWFFyEfO7tGUvIT6cW2Ett7h5arVI4mqBslcQcMM9br5oD1RzO6RZP1BvAQHOV1I HTTP/1.0
[0-3] 2023-09-24T19:22:06.656 DEBUG: Checking for a configured outgoing message service 
[0-3] 2023-09-24T19:22:07.672 DEBUG: Checking for a configured outgoing message service 
[0-3] 2023-09-24T19:22:08.485 RES: c521e234-3994-4564-a5ae-4ae27fd3cfa0 172.18.0.1 admin GET /medic-test/_changes?since=6916-g1AAAARFeJyl0zFOwzAUBmBDkVhYEXdAAqVxnNoSEgxMbND6ALEdK4oCnZjZ2Rm4ALS-RAV36CV6AgZa99V5Q4dEIHn6lSjv09NvpyGEnFQDQ8709FlXRt1gXqSXzVQXTQMfHBZEnUo5qauBgqfvR3h3rEVuTcb6JzvV4Z66M6U6d26OsAswV0bketQ_3AnTfRhMp6693yB8FeBRKYpEif7hP3vYmV7B1mOE3wNsRc650TFVgDlRtXMzhF8DrFhKTU5jqgBzrl68X7fwwU-AGU0Ey7o6_ncVYG6ejsiDlG-4c9a2TJNSD3lEGaCOQYX4hHNE_K7dOy0oi7oboM5Ahfj1foGlfAU8zS21rIwoBdQ1qBD3Ui4R9wFPWFFyEfO7tGUvIT6cW2Ett7h5arVI4mqBslcQcMM9br5oD1RzO6RZP1BvAQHOV1I HTTP/1.0 200 - 983.968 ms
[0-3] 2023-09-24T19:22:08.633 REQ: e10ad2ff-551b-421b-bf3d-f1eb44308086 172.18.0.1 admin GET /medic-test-sentinel/_local/transitions-seq? HTTP/1.0
[0-3] 2023-09-24T19:22:08.673 DEBUG: Checking for a configured outgoing message service 
[0-3] 2023-09-24T19:22:08.829 RES: e10ad2ff-551b-421b-bf3d-f1eb44308086 172.18.0.1 admin GET /medic-test-sentinel/_local/transitions-seq? HTTP/1.0 200 504 184.496 ms
[0-3] 2023-09-24T19:22:08.854 REQ: b7b0c56d-8452-4b79-8582-ea99c7808a02 172.18.0.1 admin GET /medic-test/_changes?since=6918-g1AAAARFeJyl0zFOwzAUBmBDkVhYEXdAAqVxnNoSEgxMbND6ALEdK4oCnZjZ2Rm4ALS-RIXEFXqJnoCB1n113tAhEUiefiXK-_T022kIISfVwJAzPX3WlVE3mBfpZTPVRdPAB4cFUadSTupqoODp-xHeHWuRW5Ox_slOdbin7kypzp2bI-wCzJURuR71D3fCdB8G06lr7zcIXwV4VIoiUaJ_-M8edqZXsPUY4fcAW5FzbnRMFWBOVO3cDOHXACuWUpPTmCrAnKsX79ctfPATYEYTwbKujv9dBZibpyPyIOUb7py1LdOk1EMeUQaoY1AhPuEcEb9r904LyqLuBqgzUCF-vV9gKV8BT3NLLSsjSgF1DSrEvZRLxH3AE1aUXMT8Lm3ZS4gP51ZYyy1unlotkrhaoOwVBNxwj5sv2gPV3A5p1g_UWwnwV1Q HTTP/1.0
[0-3] 2023-09-24T19:22:09.925 DEBUG: Checking for a configured outgoing message service 
[0-3] 2023-09-24T19:22:10.234 RES: b7b0c56d-8452-4b79-8582-ea99c7808a02 172.18.0.1 admin GET /medic-test/_changes?since=6918-g1AAAARFeJyl0zFOwzAUBmBDkVhYEXdAAqVxnNoSEgxMbND6ALEdK4oCnZjZ2Rm4ALS-RIXEFXqJnoCB1n113tAhEUiefiXK-_T022kIISfVwJAzPX3WlVE3mBfpZTPVRdPAB4cFUadSTupqoODp-xHeHWuRW5Ox_slOdbin7kypzp2bI-wCzJURuR71D3fCdB8G06lr7zcIXwV4VIoiUaJ_-M8edqZXsPUY4fcAW5FzbnRMFWBOVO3cDOHXACuWUpPTmCrAnKsX79ctfPATYEYTwbKujv9dBZibpyPyIOUb7py1LdOk1EMeUQaoY1AhPuEcEb9r904LyqLuBqgzUCF-vV9gKV8BT3NLLSsjSgF1DSrEvZRLxH3AE1aUXMT8Lm3ZS4gP51ZYyy1unlotkrhaoOwVBNxwj5sv2gPV3A5p1g_UWwnwV1Q HTTP/1.0 200 - 318.027 ms
[0-3] 2023-09-24T19:22:10.440 REQ: 50846b72-2b1e-4a28-9946-d8f74ab92111 172.18.0.1 admin GET /medic-test-sentinel/_local/transitions-seq? HTTP/1.0
[0-3] 2023-09-24T19:22:10.506 RES: 50846b72-2b1e-4a28-9946-d8f74ab92111 172.18.0.1 admin GET /medic-test-sentinel/_local/transitions-seq? HTTP/1.0 200 504 64.983 ms
[0-3] 2023-09-24T19:22:10.522 REQ: 3829c8c4-5743-4c7d-a6c5-c2f5[348](https://github.com/medic/cht-core/actions/runs/6291825895/job/17080708783#step:16:349)db452 172.18.0.1 admin GET /medic-test/_changes?since=6923-g1AAAARFeJyl0zFOwzAUBmBDkVhYEXdAAqVxnNoSEgxMbND6ALEdK4oCnZjZ2RlZofUlKgaO0Ev0BAy07qvzhg6JQPL0K1Hep6ffTkMIOakGhpzp6bOujLrBvEgvm6kumgY-OCyIOpVyUlcDBU_fj_DuWIvcmoz1T3aqwz11Z0p17twcYRdgrozI9ah_uBOm-zCYTl17v0H4KsCjUhSJEv3Df_awM72CrccIvwfYipxzo2OqAHOiaudmCL8GWLGUmpzGVAHmXL14v27hg58AM5oIlnV1_O8qwNw8HZEHKd9w56xtmSalHvKIMkAdgwrxCeeI-F27d1pQFnU3QJ2BCvHr_QJL-Qp4mltqWRlRCqhrUCHupVwi7gOesKLkIuZ3acteQnw4t8JabnHz1GqRxNUCZa8g4IZ73HzRHqjmdkizfqDeAhoZV1k HTTP/1.0
[0-3] 2023-09-24T19:22:10.925 DEBUG: Checking for a configured outgoing message service 
[0-3] 2023-09-24T19:22:11.926 DEBUG: Checking for a configured outgoing message service 
[0-3] 2023-09-24T19:22:11.935 RES: [382](https://github.com/medic/cht-core/actions/runs/6291825895/job/17080708783#step:16:383)9c8c4-5743-4c7d-a6c5-c2f5348db452 172.18.0.1 admin GET /medic-test/_changes?since=6923-g1AAAARFeJyl0zFOwzAUBmBDkVhYEXdAAqVxnNoSEgxMbND6ALEdK4oCnZjZ2RlZofUlKgaO0Ev0BAy07qvzhg6JQPL0K1Hep6ffTkMIOakGhpzp6bOujLrBvEgvm6kumgY-OCyIOpVyUlcDBU_fj_DuWIvcmoz1T3aqwz11Z0p17twcYRdgrozI9ah_uBOm-zCYTl17v0H4KsCjUhSJEv3Df_awM72CrccIvwfYipxzo2OqAHOiaudmCL8GWLGUmpzGVAHmXL14v27hg58AM5oIlnV1_O8qwNw8HZEHKd9w56xtmSalHvKIMkAdgwrxCeeI-F27d1pQFnU3QJ2BCvHr_QJL-Qp4mltqWRlRCqhrUCHupVwi7gOesKLkIuZ3acteQnw4t8JabnHz1GqRxNUCZa8g4IZ73HzRHqjmdkizfqDeAhoZV1k HTTP/1.0 200 - 79.264 ms
[0-3] 2023-09-24T19:22:12.054 REQ: ae6a643a-bee5-4d69-9176-675af7f05f07 172.18.0.1 admin GET /medic-test-sentinel/_local/transitions-seq? HTTP/1.0

@dianabarsan
Copy link
Member

Ok, I checked the logs again and it seems like it takes over 10 seconds from the time we push the deletes to the time the service worker is successfully generated:

2023-09-24T19:22:02.494 REQ: e2948b7b-dba0-4e51-9442-3c25e57484af 172.18.0.1 admin POST /medic-test/_bulk_docs HTTP/1.0
2023-09-24T19:22:02.638 DEBUG: Checking for a configured outgoing message service 
2023-09-24T19:22:03.638 DEBUG: Checking for a configured outgoing message service 
2023-09-24T19:22:03.966 INFO: Detected form change for form:dummy 
2023-09-24T19:22:04.553 INFO: Detected translations change - reloading 
2023-09-24T19:22:04.639 DEBUG: Checking for a configured outgoing message service 
2023-09-24T19:22:05.349 WARN: Disabled transition "update_clinics" 
2023-09-24T19:22:05.353 WARN: Disabled transition "self_report" 
2023-09-24T19:22:05.354 WARN: Disabled transition "registration" 
2023-09-24T19:22:05.354 WARN: Disabled transition "accept_patient_reports" 
2023-09-24T19:22:05.355 WARN: Disabled transition "accept_case_reports" 
2023-09-24T19:22:05.356 WARN: Disabled transition "generate_shortcode_on_contacts" 
2023-09-24T19:22:05.357 INFO: Loading transition "generate_patient_id_on_people" 
2023-09-24T19:22:05.357 INFO: Skipping asynchronous transition "generate_patient_id_on_people" 
2023-09-24T19:22:05.357 WARN: Disabled transition "default_responses" 
2023-09-24T19:22:05.358 WARN: Disabled transition "update_sent_by" 
2023-09-24T19:22:05.358 INFO: Loading transition "death_reporting" 
2023-09-24T19:22:05.359 WARN: Disabled transition "conditional_alerts" 
2023-09-24T19:22:05.359 WARN: Disabled transition "multi_report_alerts" 
2023-09-24T19:22:05.360 WARN: Disabled transition "update_notifications" 
2023-09-24T19:22:05.360 WARN: Disabled transition "update_scheduled_reports" 
2023-09-24T19:22:05.360 WARN: Disabled transition "resolve_pending" 
2023-09-24T19:22:05.375 WARN: Disabled transition "muting" 
2023-09-24T19:22:05.375 WARN: Disabled transition "mark_for_outbound" 
2023-09-24T19:22:05.375 WARN: Disabled transition "create_user_for_contacts" 
2023-09-24T19:22:05.638 DEBUG: Checking for a configured outgoing message service 
2023-09-24T19:22:05.780 RES: e2948b7b-dba0-4e51-9442-3c25e57484af 172.18.0.1 admin POST /medic-test/_bulk_docs HTTP/1.0 201 7080 3285.175 ms
2023-09-24T19:22:05.809 REQ: 5dc0a813-f165-4d73-9427-5633569fbcec 172.18.0.1 admin GET /medic-test-sentinel/_local/transitions-seq? HTTP/1.0
2023-09-24T19:22:05.976 RES: 5dc0a813-f165-4d73-9427-5633569fbcec 172.18.0.1 admin GET /medic-test-sentinel/_local/transitions-seq? HTTP/1.0 200 504 166.684 ms
2023-09-24T19:22:06.000 REQ: c521e234-3994-4564-a5ae-4ae27fd3cfa0 172.18.0.1 admin GET /medic-test/_changes?since=6916-g1AAAARFeJyl0zFOwzAUBmBDkVhYEXdAAqVxnNoSEgxMbND6ALEdK4oCnZjZ2Rm4ALS-RAV36CV6AgZa99V5Q4dEIHn6lSjv09NvpyGEnFQDQ8709FlXRt1gXqSXzVQXTQMfHBZEnUo5qauBgqfvR3h3rEVuTcb6JzvV4Z66M6U6d26OsAswV0bketQ_3AnTfRhMp6693yB8FeBRKYpEif7hP3vYmV7B1mOE3wNsRc650TFVgDlRtXMzhF8DrFhKTU5jqgBzrl68X7fwwU-AGU0Ey7o6_ncVYG6ejsiDlG-4c9a2TJNSD3lEGaCOQYX4hHNE_K7dOy0oi7oboM5Ahfj1foGlfAU8zS21rIwoBdQ1qBD3Ui4R9wFPWFFyEfO7tGUvIT6cW2Ett7h5arVI4mqBslcQcMM9br5oD1RzO6RZP1BvAQHOV1I HTTP/1.0
2023-09-24T19:22:06.656 DEBUG: Checking for a configured outgoing message service 
2023-09-24T19:22:07.672 DEBUG: Checking for a configured outgoing message service 
2023-09-24T19:22:08.485 RES: c521e234-3994-4564-a5ae-4ae27fd3cfa0 172.18.0.1 admin GET /medic-test/_changes?since=6916-g1AAAARFeJyl0zFOwzAUBmBDkVhYEXdAAqVxnNoSEgxMbND6ALEdK4oCnZjZ2Rm4ALS-RAV36CV6AgZa99V5Q4dEIHn6lSjv09NvpyGEnFQDQ8709FlXRt1gXqSXzVQXTQMfHBZEnUo5qauBgqfvR3h3rEVuTcb6JzvV4Z66M6U6d26OsAswV0bketQ_3AnTfRhMp6693yB8FeBRKYpEif7hP3vYmV7B1mOE3wNsRc650TFVgDlRtXMzhF8DrFhKTU5jqgBzrl68X7fwwU-AGU0Ey7o6_ncVYG6ejsiDlG-4c9a2TJNSD3lEGaCOQYX4hHNE_K7dOy0oi7oboM5Ahfj1foGlfAU8zS21rIwoBdQ1qBD3Ui4R9wFPWFFyEfO7tGUvIT6cW2Ett7h5arVI4mqBslcQcMM9br5oD1RzO6RZP1BvAQHOV1I HTTP/1.0 200 - 983.968 ms
2023-09-24T19:22:08.633 REQ: e10ad2ff-551b-421b-bf3d-f1eb44308086 172.18.0.1 admin GET /medic-test-sentinel/_local/transitions-seq? HTTP/1.0
2023-09-24T19:22:08.673 DEBUG: Checking for a configured outgoing message service 
2023-09-24T19:22:08.829 RES: e10ad2ff-551b-421b-bf3d-f1eb44308086 172.18.0.1 admin GET /medic-test-sentinel/_local/transitions-seq? HTTP/1.0 200 504 184.496 ms
2023-09-24T19:22:08.854 REQ: b7b0c56d-8452-4b79-8582-ea99c7808a02 172.18.0.1 admin GET /medic-test/_changes?since=6918-g1AAAARFeJyl0zFOwzAUBmBDkVhYEXdAAqVxnNoSEgxMbND6ALEdK4oCnZjZ2Rm4ALS-RIXEFXqJnoCB1n113tAhEUiefiXK-_T022kIISfVwJAzPX3WlVE3mBfpZTPVRdPAB4cFUadSTupqoODp-xHeHWuRW5Ox_slOdbin7kypzp2bI-wCzJURuR71D3fCdB8G06lr7zcIXwV4VIoiUaJ_-M8edqZXsPUY4fcAW5FzbnRMFWBOVO3cDOHXACuWUpPTmCrAnKsX79ctfPATYEYTwbKujv9dBZibpyPyIOUb7py1LdOk1EMeUQaoY1AhPuEcEb9r904LyqLuBqgzUCF-vV9gKV8BT3NLLSsjSgF1DSrEvZRLxH3AE1aUXMT8Lm3ZS4gP51ZYyy1unlotkrhaoOwVBNxwj5sv2gPV3A5p1g_UWwnwV1Q HTTP/1.0
2023-09-24T19:22:09.925 DEBUG: Checking for a configured outgoing message service 
2023-09-24T19:22:10.234 RES: b7b0c56d-8452-4b79-8582-ea99c7808a02 172.18.0.1 admin GET /medic-test/_changes?since=6918-g1AAAARFeJyl0zFOwzAUBmBDkVhYEXdAAqVxnNoSEgxMbND6ALEdK4oCnZjZ2Rm4ALS-RIXEFXqJnoCB1n113tAhEUiefiXK-_T022kIISfVwJAzPX3WlVE3mBfpZTPVRdPAB4cFUadSTupqoODp-xHeHWuRW5Ox_slOdbin7kypzp2bI-wCzJURuR71D3fCdB8G06lr7zcIXwV4VIoiUaJ_-M8edqZXsPUY4fcAW5FzbnRMFWBOVO3cDOHXACuWUpPTmCrAnKsX79ctfPATYEYTwbKujv9dBZibpyPyIOUb7py1LdOk1EMeUQaoY1AhPuEcEb9r904LyqLuBqgzUCF-vV9gKV8BT3NLLSsjSgF1DSrEvZRLxH3AE1aUXMT8Lm3ZS4gP51ZYyy1unlotkrhaoOwVBNxwj5sv2gPV3A5p1g_UWwnwV1Q HTTP/1.0 200 - 318.027 ms
2023-09-24T19:22:10.440 REQ: 50846b72-2b1e-4a28-9946-d8f74ab92111 172.18.0.1 admin GET /medic-test-sentinel/_local/transitions-seq? HTTP/1.0
2023-09-24T19:22:10.506 RES: 50846b72-2b1e-4a28-9946-d8f74ab92111 172.18.0.1 admin GET /medic-test-sentinel/_local/transitions-seq? HTTP/1.0 200 504 64.983 ms
2023-09-24T19:22:10.522 REQ: 3829c8c4-5743-4c7d-a6c5-c2f5348db452 172.18.0.1 admin GET /medic-test/_changes?since=6923-g1AAAARFeJyl0zFOwzAUBmBDkVhYEXdAAqVxnNoSEgxMbND6ALEdK4oCnZjZ2RlZofUlKgaO0Ev0BAy07qvzhg6JQPL0K1Hep6ffTkMIOakGhpzp6bOujLrBvEgvm6kumgY-OCyIOpVyUlcDBU_fj_DuWIvcmoz1T3aqwz11Z0p17twcYRdgrozI9ah_uBOm-zCYTl17v0H4KsCjUhSJEv3Df_awM72CrccIvwfYipxzo2OqAHOiaudmCL8GWLGUmpzGVAHmXL14v27hg58AM5oIlnV1_O8qwNw8HZEHKd9w56xtmSalHvKIMkAdgwrxCeeI-F27d1pQFnU3QJ2BCvHr_QJL-Qp4mltqWRlRCqhrUCHupVwi7gOesKLkIuZ3acteQnw4t8JabnHz1GqRxNUCZa8g4IZ73HzRHqjmdkizfqDeAhoZV1k HTTP/1.0
2023-09-24T19:22:10.925 DEBUG: Checking for a configured outgoing message service 
2023-09-24T19:22:11.926 DEBUG: Checking for a configured outgoing message service 
2023-09-24T19:22:11.935 RES: 3829c8c4-5743-4c7d-a6c5-c2f5348db452 172.18.0.1 admin GET /medic-test/_changes?since=6923-g1AAAARFeJyl0zFOwzAUBmBDkVhYEXdAAqVxnNoSEgxMbND6ALEdK4oCnZjZ2RlZofUlKgaO0Ev0BAy07qvzhg6JQPL0K1Hep6ffTkMIOakGhpzp6bOujLrBvEgvm6kumgY-OCyIOpVyUlcDBU_fj_DuWIvcmoz1T3aqwz11Z0p17twcYRdgrozI9ah_uBOm-zCYTl17v0H4KsCjUhSJEv3Df_awM72CrccIvwfYipxzo2OqAHOiaudmCL8GWLGUmpzGVAHmXL14v27hg58AM5oIlnV1_O8qwNw8HZEHKd9w56xtmSalHvKIMkAdgwrxCeeI-F27d1pQFnU3QJ2BCvHr_QJL-Qp4mltqWRlRCqhrUCHupVwi7gOesKLkIuZ3acteQnw4t8JabnHz1GqRxNUCZa8g4IZ73HzRHqjmdkizfqDeAhoZV1k HTTP/1.0 200 - 79.264 ms
2023-09-24T19:22:12.054 REQ: ae6a643a-bee5-4d69-9176-675af7f05f07 172.18.0.1 admin GET /medic-test-sentinel/_local/transitions-seq? HTTP/1.0
2023-09-24T19:22:12.182 RES: ae6a643a-bee5-4d69-9176-675af7f05f07 172.18.0.1 admin GET /medic-test-sentinel/_local/transitions-seq? HTTP/1.0 200 504 127.605 ms
2023-09-24T19:22:12.219 REQ: 64e55a35-2163-4d80-aaa7-a8db124e8a79 172.18.0.1 admin GET /medic-test/_changes?since=6936-g1AAAARFeJyl0zFOwzAUBmBDK7GwIu6ABErjOLUlJBiY2KD1AWI7VhQFOjGzs7MyQutLVEycoJfoCRhozavzhg6JQPL0K1Hep6ffTkMIOa4Ghpzq2ZOujLrGPE8vmpkumgY-OCyIOpFyWlcDBU9fD_DuSIvcmoz1T3aqoz11Z0p15twCYRdgrozI9bh_uBOm-zCYTl15v0X4MsDjUhSJEv3Df_awM72CrScIvwXYipxzo2OqAHOqaufmCL8EWLGUmpzGVAHmQj17v2nhg-8AM5oIlnV1_O8qwNw-Dsm9lK-4s2hbpkmpRzyiDFAnoEJ8wDkiftvunRaURd0NUOegQvx4v8RSPgOe5pZaVkaUAuoGVIg7KVe4-TDgCStKLmJ-l7bsFcS7c2vEb3Dz1GqRxNUCZa8h4IZ7rGXZHqjmdkSzfqD-BVJcVmc HTTP/1.0
2023-09-24T19:22:12.483 INFO: Service worker generated successfully

This means that we would need to increase the length of time we wait for this.

@dianabarsan dianabarsan mentioned this issue Oct 9, 2023
Merged
5 tasks
@dianabarsan dianabarsan linked a pull request Oct 9, 2023 that will close this issue
chore(#8583): wait for 12 seconds for logs, instead of 10. #8625
Merged
5 tasks
dianabarsan added a commit that referenced this issue Oct 10, 2023
@dianabarsan
chore(#8583): wait for 20 seconds for logs, instead of 10. (#8625)
595f028 
#8583
Benmuiruri pushed a commit that referenced this issue Oct 26, 2023
@dianabarsan @Benmuiruri
chore(#8583): wait for 20 seconds for logs, instead of 10. (#8625)
83d882b 
#8583
@garethbowen garethbowen added this to the 4.5.0 milestone Nov 8, 2023
@garethbowen
Copy link
Member Author

Still flaky: https://github.com/medic/cht-core/actions/runs/7723449323/job/21053957569

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@dianabarsan dianabarsan

Labels
Flaky Indicates a flaky or unreliable test Type: Technical issue Improve something that users won't notice
Projects
None yet
Milestone
4.5.0
Development

Successfully merging a pull request may close this issue.

chore(#8583): wait for 12 seconds for logs, instead of 10. medic/cht-core
2 participants
@garethbowen @dianabarsan