Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Increase default Jest timeout to 30s #5901

Merged
merged 1 commit into from
Feb 19, 2021
Merged

Conversation

pierlon
Copy link
Contributor

@pierlon pierlon commented Feb 19, 2021

Summary

The E2E test Template mode recommendations with non-reader-theme active › makes correct recommendations when user is not technical and the current theme is not a reader theme has become flaky as it now sometimes times out while attempting to install the hestia theme.

To resolve this, this PR increases the default Jest timeout from 10s to 30s. Alternatively, the 30s timeout could be applied specifically to the aforementioned test, but that may also have to be done for similar tests that sometimes have long timeouts (like the ones that await on installing themes and plugins, for example).

Example of flaky test: https://github.com/ampproject/amp-wp/runs/1930306642#step:12:17

@pierlon pierlon added Testing Issues related with Unit, E2E, Smoke, and other testing requirements/needs WS:Core Work stream for Plugin core labels Feb 19, 2021
@pierlon pierlon added this to the v2.1 milestone Feb 19, 2021
@pierlon pierlon self-assigned this Feb 19, 2021
@codecov
Copy link

codecov bot commented Feb 19, 2021

Codecov Report

Merging #5901 (14be930) into develop (26034a7) will decrease coverage by 0.03%.
The diff coverage is 100.00%.

Impacted file tree graph

@@              Coverage Diff              @@
##             develop    #5901      +/-   ##
=============================================
- Coverage      75.16%   75.12%   -0.04%     
- Complexity      5665     5667       +2     
=============================================
  Files            210      210              
  Lines          17019    17023       +4     
=============================================
- Hits           12792    12789       -3     
- Misses          4227     4234       +7     
Flag Coverage Δ Complexity Δ
javascript 75.13% <ø> (ø) 0.00 <ø> (ø)
php 75.12% <100.00%> (-0.04%) 0.00 <2.00> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files Coverage Δ Complexity Δ
src/Validation/SavePostValidationEvent.php 91.66% <100.00%> (-2.46%) 18.00 <1.00> (+1.00) ⬇️
src/Validation/URLValidationCron.php 73.68% <100.00%> (-20.44%) 8.00 <1.00> (+1.00) ⬇️
...c/BackgroundTask/SingleScheduledBackgroundTask.php 83.33% <0.00%> (-16.67%) 5.00% <0.00%> (ø%)

@github-actions
Copy link
Contributor

Plugin builds for 1097e87 are ready 🛎️!

@westonruter westonruter merged commit 22b78c5 into develop Feb 19, 2021
@westonruter westonruter deleted the fix/flaky-e2e-test branch February 19, 2021 16:25
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Testing Issues related with Unit, E2E, Smoke, and other testing requirements/needs WS:Core Work stream for Plugin core
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants