Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

chore: Increase paralleled machines for desktop-gui tests #18725

Merged
merged 3 commits into from
Nov 1, 2021

Conversation

jennifer-shehane
Copy link
Member

@jennifer-shehane jennifer-shehane commented Nov 1, 2021

Our percy finalize job waits for other jobs in circle to finish, like the desktop-gui tests. This was timing out lately because the desktop-gui tests are now taking longer than 10 mins to finish (about 12) and CircleCI exits any job when it gets no signal after 10 mins.

This PR parallelizes the desktop-gui tests at the number of machines recommended by our dashboard (7).

This should make our tests run faster and the percy-finalize job should no longer exit from no signal.

@jennifer-shehane jennifer-shehane marked this pull request as draft November 1, 2021 14:52
@jennifer-shehane jennifer-shehane changed the title Add DEBUG logs to percy finalize chore: Add DEBUG logs to percy finalize Nov 1, 2021
@jennifer-shehane jennifer-shehane changed the title chore: Add DEBUG logs to percy finalize chore: Increase paralleled machines for desktop-gui tests Nov 1, 2021
@cypress
Copy link

cypress bot commented Nov 1, 2021



Test summary

18569 3 214 7Flakiness 2


Run details

Project cypress
Status Failed
Commit cd27176
Started Nov 1, 2021 3:31 PM
Ended Nov 1, 2021 3:41 PM
Duration 10:44 💡
OS Linux Debian - 10.9
Browser Multiple

View run in Cypress Dashboard ➡️


Failures

Run group: 5x-driver-electron (Linux, Electron )
commands/navigation_spec.js Failed
1 ... > throws when failOnStatusCode is false and retryOnStatusCodeFailure is true
commands/assertions_spec.js Failed
1 ... > rejects any element not in the document
Run group: 5x-driver-chrome (Linux, Chrome )
e2e/redirects_spec.js Failed
1 redirection > meta > binds to the new page after a timeout

Flakiness

commands/net_stubbing_spec.ts Flakiness
1 network stubbing > waiting and aliasing > can timeout waiting on a single request using "alias.request"
cypress/proxy-logging-spec.ts Flakiness
1 Proxy Logging > request logging > xhr log has response body/status code

This comment has been generated by cypress-bot as a result of this project's GitHub integration settings. You can manage this integration in this project's settings in the Cypress Dashboard

@jennifer-shehane jennifer-shehane marked this pull request as ready for review November 1, 2021 15:26
Copy link
Contributor

@flotwig flotwig left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Makes sense, LGTM

Since it times out on node ./scripts/wait-on-circle-jobs.js with "Too long with no output", if it crops up again (if we really want tests that take longer than 10 minutes), we could get that script to print out a period every minute or something to stop circleci from thinking the job is hung: https://app.circleci.com/pipelines/github/cypress-io/cypress/25826/workflows/e2d267a1-a9cb-4c07-86fe-793134bf7ad9/jobs/970366

@jennifer-shehane
Copy link
Member Author

@flotwig Yah I started out trying to add some debug log printing to the script so that it would report in, but it might not be great for any job to take longer than 10 mins, so it may just be hiding an issue more than helping. (Although it's not obvious what the issue is from the current way it's set up)

@jennifer-shehane jennifer-shehane merged commit 4cb97b3 into develop Nov 1, 2021
@jennifer-shehane jennifer-shehane deleted the debug-logs-percy-finalize branch November 1, 2021 15:45
tgriesser added a commit that referenced this pull request Nov 3, 2021
* develop: (40 commits)
  fix(driver): Sticky elements within a fixed container will not prevent an element from being scrolled to (#18441)
  chore: make `create` function on server.ts obsolete (#18615)
  docs: Add instructions to squash commits to develop in Contributing (#18728)
  fix(@cypress/react): throw if using Next.js swc-loader without nodeVersion=system (#18686)
  refactor: remove Ramda (#18723)
  chore: Increase paralleled machines for desktop-gui tests (#18725)
  chore: Update Chrome (stable) to 95.0.4638.69 (#18696)
  chore: release @cypress/vue-v3.0.4
  chore: release @cypress/react-v5.10.2
  chore: release @cypress/schematic-v1.5.3
  fix: remove outdated registry link (#18710)
  chore: release @cypress/schematic-v1.5.2
  chore: release create-cypress-tests-v1.1.3
  chore: Update Chrome (beta) to 96.0.4664.27 (#18676)
  chore(tests): Remove flaky assertion that relies on png how compression (#18668)
  fix: make sure to go back to no-specs when delete spec file (#17760)
  fix: Next.JS 12 components testing failing with ` TypeError: Cannot read property 'traceChild' of undefined` (#18648)
  Backport .gitignore from unified-desktop-gui
  chore(docs): add 'Upgrading Electron' instructions (#18594)
  release 8.7.0 [skip ci]
  ...
tgriesser added a commit that referenced this pull request Nov 3, 2021
* develop: (40 commits)
  fix(driver): Sticky elements within a fixed container will not prevent an element from being scrolled to (#18441)
  chore: make `create` function on server.ts obsolete (#18615)
  docs: Add instructions to squash commits to develop in Contributing (#18728)
  fix(@cypress/react): throw if using Next.js swc-loader without nodeVersion=system (#18686)
  refactor: remove Ramda (#18723)
  chore: Increase paralleled machines for desktop-gui tests (#18725)
  chore: Update Chrome (stable) to 95.0.4638.69 (#18696)
  chore: release @cypress/vue-v3.0.4
  chore: release @cypress/react-v5.10.2
  chore: release @cypress/schematic-v1.5.3
  fix: remove outdated registry link (#18710)
  chore: release @cypress/schematic-v1.5.2
  chore: release create-cypress-tests-v1.1.3
  chore: Update Chrome (beta) to 96.0.4664.27 (#18676)
  chore(tests): Remove flaky assertion that relies on png how compression (#18668)
  fix: make sure to go back to no-specs when delete spec file (#17760)
  fix: Next.JS 12 components testing failing with ` TypeError: Cannot read property 'traceChild' of undefined` (#18648)
  Backport .gitignore from unified-desktop-gui
  chore(docs): add 'Upgrading Electron' instructions (#18594)
  release 8.7.0 [skip ci]
  ...
tgriesser added a commit that referenced this pull request Nov 4, 2021
…ve-activeProject

* unified-desktop-gui: (57 commits)
  chore: Add e2e tests for global mode (#18719)
  chore: add percy to app and launchpad package (#18781)
  chore: update test
  refactor: move settings in app (#18729)
  feat: setup launchpad lifecycle (#18734)
  feat(app): decouple event manager from driver (#18695)
  chore: Force single resolution for core modules, infinite loop guard (#18764)
  fix(driver): Sticky elements within a fixed container will not prevent an element from being scrolled to (#18441)
  chore: cleaning up the runner container pattern (#18741)
  feat: Use .config files (#18578)
  chore(app): basic style and example to stop scrollIntoView bug (#18736)
  chore: make `create` function on server.ts obsolete (#18615)
  feat: add codegen utility (#18708)
  docs: Add instructions to squash commits to develop in Contributing (#18728)
  fix(@cypress/react): throw if using Next.js swc-loader without nodeVersion=system (#18686)
  refactor: remove Ramda (#18723)
  fix: support using create-cypress-tests as part of build process (#18714)
  chore: Increase paralleled machines for desktop-gui tests (#18725)
  fix(app): do not cache graphql (#18716)
  chore: Update Chrome (stable) to 95.0.4638.69 (#18696)
  ...
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants