Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

"Cypress verification failed" after upgrading to 13.6.5 with use of NX #28982

Closed
danr-za opened this issue Feb 21, 2024 · 16 comments · Fixed by #28994
Closed

"Cypress verification failed" after upgrading to 13.6.5 with use of NX #28982

danr-za opened this issue Feb 21, 2024 · 16 comments · Fixed by #28994

Comments

@danr-za
Copy link

danr-za commented Feb 21, 2024

Current behavior

After upgrading to v 13.6.5, running Cypress throws "Cypress verification failed.".

Desired behavior

Should not fail after upgrading

Test code to reproduce

cypress open

Cypress Version

13.6.5

Node version

20.11.0

Operating System

macOS

Debug Logs

[FAILED] Cypress Version: 13.6.5
Cypress verification failed.

This command failed with the following output:

/home/runner/.cache/Cypress/13.6.5/Cypress/Cypress --no-sandbox --smoke-test --ping=846

Other

No response

@Squixx
Copy link

Squixx commented Feb 21, 2024

Can confirm, also having this on both macOs, and linux (and CI). Also on node 20.10

@johansunden
Copy link

Our pipeline step for cypress tests failed after upgrading to v13.6.5, so I had to revert the upgrade. My DevOps guy thought it was a memory leak somewhere.

FATAL ERROR: Ineffective mark-compacts near heap limit Allocation failed - JavaScript heap out of memory

Related to this, or a separate issue?

@jennifer-shehane
Copy link
Member

@johansunden Can you open a seperate issue please?

@jennifer-shehane
Copy link
Member

@danr-za Could you run Cypress in debug mode mode and print the entire set of logs here?

@jennifer-shehane jennifer-shehane added the stage: needs information Not enough info to reproduce the issue label Feb 21, 2024
@jennifer-shehane
Copy link
Member

  • Could you try running cypress cache clear to see if this resolves the issue?
  • Could y'all also verify what package manager you're using to install?

The Cache path in the first example looks not right to me. There's an extra Cypress at the end there.

/home/runner/.cache/Cypress/13.6.5/Cypress/Cypress --no-sandbox --smoke-test --ping=846

This is a successful cache path:

 cypress open
It looks like this is your first time using Cypress: 13.6.5

✔  Verified Cypress! /Users/jennifer/Library/Caches/Cypress/13.6.5/Cypress.app

@danr-za
Copy link
Author

danr-za commented Feb 21, 2024

Here are the debug logs.
I can confirm that:

  • Running cypress cache clear -> cypress install -> cypress open works
  • But with nx, after clear & install it doesn't work. I'll check that separately there.

Has something changed in this manner in 13.6.5? We never had this issue in version upgrades. (especially in patch)

  cypress:cli exporting Cypress module interface +0ms
  cypress:cli verifying Cypress app +0ms
  cypress:cli checking environment variables +0ms
  cypress:cli checking if executable exists /Users/dan/Library/Caches/Cypress/13.6.5/Cypress.app/Contents/MacOS/Cypress +2ms
  cypress:cli Binary is executable? : true +0ms
  cypress:cli binaryDir is  /Users/dan/Library/Caches/Cypress/13.6.5/Cypress.app +1ms
  cypress:cli Reading binary package.json from: /Users/dan/Library/Caches/Cypress/13.6.5/Cypress.app/Contents/Resources/app/package.json +0ms
  cypress:cli Found binary version 13.6.5 installed in: /Users/dan/Library/Caches/Cypress/13.6.5/Cypress.app +3ms
  cypress:cli could not read binary_state.json file at "/Users/dan/Library/Caches/Cypress/13.6.5/binary_state.json" +4ms
  cypress:cli {} +0ms
  cypress:cli is Verified ? undefined +1ms
  cypress:cli running binary verification check 13.6.5 +0ms
It looks like this is your first time using Cypress: 13.6.5


  cypress:cli clearing out the verified version +3ms
  cypress:cli needs Xvfb? false +0ms
  cypress:cli spawning, should retry on display problem? false +0ms
  cypress:cli disabling Electron sandbox +0ms
  cypress:cli running smoke test +0ms
  cypress:cli using Cypress executable /Users/dan/Library/Caches/Cypress/13.6.5/Cypress.app/Contents/MacOS/Cypress +0ms
  cypress:cli smoke test command: /Users/dan/Library/Caches/Cypress/13.6.5/Cypress.app/Contents/MacOS/Cypress --no-sandbox --smoke-test --ping=346 +0ms
  cypress:cli smoke test timeout 30000 ms +0ms
  cypress:cli smoke test stdout "It looks like you are running the Cypress binary directly.

This is not the recommended approach, and Cypress may not work correctly.

Please install the cypress NPM package and follow the instructions here:

https://on.cypress.io/installing-cypress
346" +783ms
  cypress:cli Smoke test failed because could not find 346 in: {
  command: '/Users/dan/Library/Caches/Cypress/13.6.5/Cypress.app/Contents/MacOS/Cypress --no-sandbox --smoke-test --ping=346',
  exitCode: 0,
  stdout: '\x1B[35mIt looks like you are running the Cypress binary directly.\x1B[39m\n' +
    '\x1B[35m\x1B[39m\n' +
    '\x1B[35mThis is not the recommended approach, and Cypress may not work correctly.\x1B[39m\n' +
    '\x1B[35m\x1B[39m\n' +
    '\x1B[35mPlease install the \x1B[33mcypress\x1B[35m NPM package and follow the instructions here:\x1B[39m\n' +
    '\x1B[35m\x1B[39m\n' +
    '\x1B[35mhttps://on.cypress.io/installing-cypress\x1B[39m\n' +
    '\x1B[33m346\x1B[39m',
  stderr: '2024-02-21T15:03:01.410Z cypress:snapshot:info Caching 3471, defining 4299 modules! Using cache\n' +
    '2024-02-21T15:03:01.413Z cypress:snapshot:debug initializing packherd require\n' +
    '2024-02-21T15:03:01.521Z cypress:server:performance-benchmark elapsed time at v8-snapshot-startup-time: 114.532ms\n' +
    '2024-02-21T15:03:01.562Z cypress:server:appdata path: /Users/dan/Library/Application Support/Cypress/cy/production/browsers\n' +
    "2024-02-21T15:03:01.567Z cypress:server:cypress starting cypress with argv [ '/Users/dan/Library/Caches/Cypress/13.6.5/Cypress.app/Contents/MacOS/Cypress', '--no-sandbox', '--smoke-test', '--ping=346' ]\n" +
    "2024-02-21T15:03:01.567Z cypress:server:args argv array: [ '/Users/dan/Library/Caches/Cypress/13.6.5/Cypress.app/Contents/MacOS/Cypress', '--no-sandbox', '--smoke-test', '--ping=346' ]\n" +
    "2024-02-21T15:03:01.568Z cypress:server:args parsed argv options { options: { _: [ '/Users/dan/Library/Caches/Cypress/13.6.5/Cypress.app/Contents/MacOS/Cypress' ], sandbox: false, 'smoke-test': true, smokeTest: true, ping: 346 } }\n" +
    "2024-02-21T15:03:01.570Z cypress:server:args argv parsed: { _: [ '/Users/dan/Library/Caches/Cypress/13.6.5/Cypress.app/Contents/MacOS/Cypress' ], sandbox: false, smokeTest: true, ping: 346, invokedFromCli: false, cwd: '/Users/dan/work/apps' }\n" +
    '2024-02-21T15:03:01.571Z cypress:server:util:proxy found proxy environment variables {}\n' +
    "2024-02-21T15:03:01.572Z cypress:server:args options { _: [ '/Users/dan/Library/Caches/Cypress/13.6.5/Cypress.app/Contents/MacOS/Cypress' ], sandbox: false, smokeTest: true, ping: 346, invokedFromCli: false, cwd: '/Users/dan/work/apps', config: {} }\n" +
    "2024-02-21T15:03:01.572Z cypress:server:args argv options: { _: [ '/Users/dan/Library/Caches/Cypress/13.6.5/Cypress.app/Contents/MacOS/Cypress' ], sandbox: false, smokeTest: true, ping: 346, invokedFromCli: false, cwd: '/Users/dan/work/apps', config: {}, pong: 346 }\n" +
    "2024-02-21T15:03:01.572Z cypress:server:cypress from argv [ '/Users/dan/Library/Caches/Cypress/13.6.5/Cypress.app/Contents/MacOS/Cypress', '--no-sandbox', '--smoke-test', '--ping=346' ] got options { _: [ '/Users/dan/Library/Caches/Cypress/13.6.5/Cypress.app/Contents/MacOS/Cypress' ], sandbox: false, smokeTest: true, ping: 346, invokedFromCli: false, cwd: '/Users/dan/work/apps', config: {}, pong: 346 }\n" +
    '2024-02-21T15:03:01.600Z cypress:server:appdata path: /Users/dan/Library/Application Support/Cypress/cy/production\n' +
    '\n' +
    'DevTools listening on ws://127.0.0.1:57259/devtools/browser/df32d1d2-7b95-48e7-8771-ec4a9048ffc4\n' +
    '2024-02-21 17:03:01.630 Cypress[10864:1570941] WARNING: Secure coding is not enabled for restorable state! Enable secure coding by implementing NSApplicationDelegate.applicationSupportsSecureRestorableState: and returning YES.\n' +
    "2024-02-21T15:03:01.661Z cypress:server:cypress starting in mode smokeTest with options { _: [ '/Users/dan/Library/Caches/Cypress/13.6.5/Cypress.app/Contents/MacOS/Cypress' ], sandbox: false, smokeTest: true, ping: 346, invokedFromCli: false, cwd: '/Users/dan/work/apps', config: {}, pong: 346 }\n" +
    '2024-02-21T15:03:01.664Z cypress:server:cypress running Electron currently\n' +
    '2024-02-21T15:03:01.668Z cypress:server:cypress about to exit with code 0\n' +
    '2024-02-21T15:03:01.668Z cypress:server:browsers browsers.kill called with no active instance',
  all: undefined,
  failed: false,
  timedOut: false,
  isCanceled: false,
  killed: false
} +0ms

Cypress verification failed.

This command failed with the following output:

/Users/dan/Library/Caches/Cypress/13.6.5/Cypress.app/Contents/MacOS/Cypress --no-sandbox --smoke-test --ping=346

----------

2024-02-21T15:03:01.410Z cypress:snapshot:info Caching 3471, defining 4299 modules! Using cache
2024-02-21T15:03:01.413Z cypress:snapshot:debug initializing packherd require
2024-02-21T15:03:01.521Z cypress:server:performance-benchmark elapsed time at v8-snapshot-startup-time: 114.532ms
2024-02-21T15:03:01.562Z cypress:server:appdata path: /Users/dan/Library/Application Support/Cypress/cy/production/browsers
2024-02-21T15:03:01.567Z cypress:server:cypress starting cypress with argv [ '/Users/dan/Library/Caches/Cypress/13.6.5/Cypress.app/Contents/MacOS/Cypress', '--no-sandbox', '--smoke-test', '--ping=346' ]
2024-02-21T15:03:01.567Z cypress:server:args argv array: [ '/Users/dan/Library/Caches/Cypress/13.6.5/Cypress.app/Contents/MacOS/Cypress', '--no-sandbox', '--smoke-test', '--ping=346' ]
2024-02-21T15:03:01.568Z cypress:server:args parsed argv options { options: { _: [ '/Users/dan/Library/Caches/Cypress/13.6.5/Cypress.app/Contents/MacOS/Cypress' ], sandbox: false, 'smoke-test': true, smokeTest: true, ping: 346 } }
2024-02-21T15:03:01.570Z cypress:server:args argv parsed: { _: [ '/Users/dan/Library/Caches/Cypress/13.6.5/Cypress.app/Contents/MacOS/Cypress' ], sandbox: false, smokeTest: true, ping: 346, invokedFromCli: false, cwd: '/Users/dan/work/apps' }
2024-02-21T15:03:01.571Z cypress:server:util:proxy found proxy environment variables {}
2024-02-21T15:03:01.572Z cypress:server:args options { _: [ '/Users/dan/Library/Caches/Cypress/13.6.5/Cypress.app/Contents/MacOS/Cypress' ], sandbox: false, smokeTest: true, ping: 346, invokedFromCli: false, cwd: '/Users/dan/work/apps', config: {} }
2024-02-21T15:03:01.572Z cypress:server:args argv options: { _: [ '/Users/dan/Library/Caches/Cypress/13.6.5/Cypress.app/Contents/MacOS/Cypress' ], sandbox: false, smokeTest: true, ping: 346, invokedFromCli: false, cwd: '/Users/dan/work/apps', config: {}, pong: 346 }
2024-02-21T15:03:01.572Z cypress:server:cypress from argv [ '/Users/dan/Library/Caches/Cypress/13.6.5/Cypress.app/Contents/MacOS/Cypress', '--no-sandbox', '--smoke-test', '--ping=346' ] got options { _: [ '/Users/dan/Library/Caches/Cypress/13.6.5/Cypress.app/Contents/MacOS/Cypress' ], sandbox: false, smokeTest: true, ping: 346, invokedFromCli: false, cwd: '/Users/dan/work/apps', config: {}, pong: 346 }
2024-02-21T15:03:01.600Z cypress:server:appdata path: /Users/dan/Library/Application Support/Cypress/cy/production

DevTools listening on ws://127.0.0.1:57259/devtools/browser/df32d1d2-7b95-48e7-8771-ec4a9048ffc4
2024-02-21 17:03:01.630 Cypress[10864:1570941] WARNING: Secure coding is not enabled for restorable state! Enable secure coding by implementing NSApplicationDelegate.applicationSupportsSecureRestorableState: and returning YES.
2024-02-21T15:03:01.661Z cypress:server:cypress starting in mode smokeTest with options { _: [ '/Users/dan/Library/Caches/Cypress/13.6.5/Cypress.app/Contents/MacOS/Cypress' ], sandbox: false, smokeTest: true, ping: 346, invokedFromCli: false, cwd: '/Users/dan/work/apps', config: {}, pong: 346 }
2024-02-21T15:03:01.664Z cypress:server:cypress running Electron currently
2024-02-21T15:03:01.668Z cypress:server:cypress about to exit with code 0
2024-02-21T15:03:01.668Z cypress:server:browsers browsers.kill called with no active instance

----------

Platform: darwin-arm64 (23.3.0)
Cypress Version: 13.6.5

@jennifer-shehane
Copy link
Member

jennifer-shehane commented Feb 21, 2024

Could y'all specify which Mac you're using? Intel/M1/etc, and which Mac OS? (Sonoma, etc)?

We didn't change anything directly within the verification code. My suspicions is this has to do with our Electron upgrade. There's oftentimes some unexpected errors whenever we upgrade Electron regardless of how much we test it.

@danr-za
Copy link
Author

danr-za commented Feb 21, 2024

M1 with Sonoma 14.3.1

@leosvelperez
Copy link
Contributor

@jennifer-shehane I'm using an M2 Max with Sonoma 14.2.1. I've also reproduced it in CI agents running on Ubuntu 22.04. This is also using Nx, though Nx is actually running cypress run as shown in the debug logs. Running cypress run directly works fine. I work at Nx, so I'd be happy to provide more info or try some things as needed to get this solved.

Failure logs
DEBUG=cypress:* pnpm nx e2e app1-e2e

> nx run app1-e2e:e2e

  cypress:cli:cli cli starts with arguments ["/Users/leosvel/.volta/tools/image/node/20.10.0/bin/node","/Users/leosvel/code/playground/baz/node_modules/cypress/bin/cypress","run"] +0ms
  cypress:cli NODE_OPTIONS is not set +0ms
  cypress:cli:cli program parsing arguments +1ms
  cypress:cli:cli running Cypress with args [ Command { _events: [Object: null prototype] { 'option:auto-cancel-after-failures': [Function (anonymous)], 'option:browser': [Function (anonymous)], 'option:ci-build-id': [Function (anonymous)], 'option:component': [Function (anonymous)], 'option:config': [Function (anonymous)], 'option:config-file': [Function (anonymous)], 'option:e2e': [Function (anonymous)], 'option:env': [Function (anonymous)], 'option:group': [Function (anonymous)], 'option:key': [Function (anonymous)], 'option:headed': [Function (anonymous)], 'option:headless': [Function (anonymous)], 'option:no-exit': [Function (anonymous)], 'option:parallel': [Function (anonymous)], 'option:port': [Function (anonymous)], 'option:project': [Function (anonymous)], 'option:quiet': [Function (anonymous)], 'option:record': [Function (anonymous)], 'option:reporter': [Function (anonymous)], 'option:runner-ui': [Function (anonymous)], 'option:no-runner-ui': [Function (anonymous)], 'option:reporter-options': [Function (anonymous)], 'option:spec': [Function (anonymous)], 'option:tag': [Function (anonymous)], 'option:dev': [Function (anonymous)] }, _eventsCount: 25, _maxListeners: undefined, commands: [], options: [ [Option], [Option], [Option], [Option], [Option], [Option], [Option], [Option], [Option], [Option], [Option], [Option], [Option], [Option], [Option], [Option], [Option], [Option], [Option], [Option], [Option], [Option], [Option], [Option], [Option] ], parent: Command { _events: [Object: null prototype], _eventsCount: 1, _maxListeners: undefined, commands: [Array], options: [Array], parent: null, _allowUnknownOption: false, _args: [], rawArgs: [Array], _scriptPath: '/Users/leosvel/code/playground/baz/node_modules/cypress/bin/cypress', _name: 'cypress', _optionValues: {}, _storeOptionsAsProperties: true, _storeOptionsAsPropertiesCalled: true, _passCommandToAction: true, _actionResults: [], _actionHandler: null, _executableHandler: false, _executableFile: null, _defaultCommandName: null, _exitCallback: null, _aliases: [], _combineFlagAndOptionalValue: true, _hidden: false, _hasHelpOption: true, _helpFlags: '-h, --help', _helpDescription: 'display help for command', _helpShortFlag: '-h', _helpLongFlag: '--help', _hasImplicitHelpCommand: undefined, _helpCommandName: 'help', _helpCommandnameAndArgs: 'help [command]', _helpCommandDescription: 'display help for command', _usage: '<command> [options]', args: [Array], [Symbol(kCapture)]: false }, _allowUnknownOption: false, _args: [], rawArgs: null, _scriptPath: null, _name: 'run', _optionValues: {}, _storeOptionsAsProperties: true, _storeOptionsAsPropertiesCalled: false, _passCommandToAction: true, _actionResults: [], _actionHandler: [Function: listener], _executableHandler: false, _executableFile: null, _defaultCommandName: null, _exitCallback: null, _aliases: [], _combineFlagAndOptionalValue: true, _hidden: false, _hasHelpOption: true, _helpFlags: '-h, --help', _helpDescription: 'display help for command', _helpShortFlag: '-h', _helpLongFlag: '--help', _hasImplicitHelpCommand: 0, _helpCommandName: 'help', _helpCommandnameAndArgs: 'help [command]', _helpCommandDescription: 'display help for command', _usage: '[options]', _description: 'Runs Cypress tests from the CLI without the GUI', _argsDescription: undefined, exit: true, args: [], [Symbol(kCapture)]: false } ] +0ms
  cypress:cli:cli variable-length opts parsed { args: [ '/Users/leosvel/.volta/tools/image/node/20.10.0/bin/node', '/Users/leosvel/code/playground/baz/node_modules/cypress/bin/cypress', 'run' ], opts: Command { _events: [Object: null prototype] { 'option:auto-cancel-after-failures': [Function (anonymous)], 'option:browser': [Function (anonymous)], 'option:ci-build-id': [Function (anonymous)], 'option:component': [Function (anonymous)], 'option:config': [Function (anonymous)], 'option:config-file': [Function (anonymous)], 'option:e2e': [Function (anonymous)], 'option:env': [Function (anonymous)], 'option:group': [Function (anonymous)], 'option:key': [Function (anonymous)], 'option:headed': [Function (anonymous)], 'option:headless': [Function (anonymous)], 'option:no-exit': [Function (anonymous)], 'option:parallel': [Function (anonymous)], 'option:port': [Function (anonymous)], 'option:project': [Function (anonymous)], 'option:quiet': [Function (anonymous)], 'option:record': [Function (anonymous)], 'option:reporter': [Function (anonymous)], 'option:runner-ui': [Function (anonymous)], 'option:no-runner-ui': [Function (anonymous)], 'option:reporter-options': [Function (anonymous)], 'option:spec': [Function (anonymous)], 'option:tag': [Function (anonymous)], 'option:dev': [Function (anonymous)] }, _eventsCount: 25, _maxListeners: undefined, commands: [], options: [ [Option], [Option], [Option], [Option], [Option], [Option], [Option], [Option], [Option], [Option], [Option], [Option], [Option], [Option], [Option], [Option], [Option], [Option], [Option], [Option], [Option], [Option], [Option], [Option], [Option] ], parent: Command { _events: [Object: null prototype], _eventsCount: 1, _maxListeners: undefined, commands: [Array], options: [Array], parent: null, _allowUnknownOption: false, _args: [], rawArgs: [Array], _scriptPath: '/Users/leosvel/code/playground/baz/node_modules/cypress/bin/cypress', _name: 'cypress', _optionValues: {}, _storeOptionsAsProperties: true, _storeOptionsAsPropertiesCalled: true, _passCommandToAction: true, _actionResults: [], _actionHandler: null, _executableHandler: false, _executableFile: null, _defaultCommandName: null, _exitCallback: null, _aliases: [], _combineFlagAndOptionalValue: true, _hidden: false, _hasHelpOption: true, _helpFlags: '-h, --help', _helpDescription: 'display help for command', _helpShortFlag: '-h', _helpLongFlag: '--help', _hasImplicitHelpCommand: undefined, _helpCommandName: 'help', _helpCommandnameAndArgs: 'help [command]', _helpCommandDescription: 'display help for command', _usage: '<command> [options]', args: [Array], [Symbol(kCapture)]: false }, _allowUnknownOption: false, _args: [], rawArgs: null, _scriptPath: null, _name: 'run', _optionValues: {}, _storeOptionsAsProperties: true, _storeOptionsAsPropertiesCalled: false, _passCommandToAction: true, _actionResults: [], _actionHandler: [Function: listener], _executableHandler: false, _executableFile: null, _defaultCommandName: null, _exitCallback: null, _aliases: [], _combineFlagAndOptionalValue: true, _hidden: false, _hasHelpOption: true, _helpFlags: '-h, --help', _helpDescription: 'display help for command', _helpShortFlag: '-h', _helpLongFlag: '--help', _hasImplicitHelpCommand: 0, _helpCommandName: 'help', _helpCommandnameAndArgs: 'help [command]', _helpCommandDescription: 'display help for command', _usage: '[options]', _description: 'Runs Cypress tests from the CLI without the GUI', _argsDescription: undefined, exit: true, args: [], [Symbol(kCapture)]: false } } +36ms
  cypress:cli parsed cli options {} +37ms
  cypress:cli verifying Cypress app +0ms
  cypress:cli checking environment variables +0ms
  cypress:cli checking if executable exists /Users/leosvel/Library/Caches/Cypress/13.6.5/Cypress.app/Contents/MacOS/Cypress +1ms
  cypress:cli Binary is executable? : true +0ms
  cypress:cli binaryDir is  /Users/leosvel/Library/Caches/Cypress/13.6.5/Cypress.app +1ms
  cypress:cli Reading binary package.json from: /Users/leosvel/Library/Caches/Cypress/13.6.5/Cypress.app/Contents/Resources/app/package.json +0ms
  cypress:cli Found binary version 13.6.5 installed in: /Users/leosvel/Library/Caches/Cypress/13.6.5/Cypress.app +0ms
  cypress:cli could not read binary_state.json file at "/Users/leosvel/Library/Caches/Cypress/13.6.5/binary_state.json" +2ms
  cypress:cli {} +0ms
  cypress:cli is Verified ? undefined +2ms
  cypress:cli running binary verification check 13.6.5 +0ms
It looks like this is your first time using Cypress: 13.6.5


  cypress:cli clearing out the verified version +2ms
  cypress:cli needs Xvfb? false +1ms
  cypress:cli spawning, should retry on display problem? false +0ms
  cypress:cli disabling Electron sandbox +0ms
  cypress:cli running smoke test +0ms
  cypress:cli using Cypress executable /Users/leosvel/Library/Caches/Cypress/13.6.5/Cypress.app/Contents/MacOS/Cypress +0ms
  cypress:cli smoke test command: /Users/leosvel/Library/Caches/Cypress/13.6.5/Cypress.app/Contents/MacOS/Cypress --no-sandbox --smoke-test --ping=397 +0ms
  cypress:cli smoke test timeout 30000 ms +0ms
  cypress:cli smoke test stdout "It looks like you are running the Cypress binary directly.

This is not the recommended approach, and Cypress may not work correctly.

Please install the cypress NPM package and follow the instructions here:

https://on.cypress.io/installing-cypress
397" +3s
  cypress:cli Smoke test failed because could not find 397 in: {
  command: '/Users/leosvel/Library/Caches/Cypress/13.6.5/Cypress.app/Contents/MacOS/Cypress --no-sandbox --smoke-test --ping=397',
  exitCode: 0,
  stdout: '\x1B[35mIt looks like you are running the Cypress binary directly.\x1B[39m\n' +
    '\x1B[35m\x1B[39m\n' +
    '\x1B[35mThis is not the recommended approach, and Cypress may not work correctly.\x1B[39m\n' +
    '\x1B[35m\x1B[39m\n' +
    '\x1B[35mPlease install the \x1B[33mcypress\x1B[35m NPM package and follow the instructions here:\x1B[39m\n' +
    '\x1B[35m\x1B[39m\n' +
    '\x1B[35mhttps://on.cypress.io/installing-cypress\x1B[39m\n' +
    '\x1B[33m397\x1B[39m',
  stderr: '2024-02-21T15:41:44.055Z cypress:snapshot:info Caching 3471, defining 4299 modules! Using cache\n' +
    '2024-02-21T15:41:44.055Z cypress:snapshot:debug initializing packherd require\n' +
    '2024-02-21T15:41:44.144Z cypress:server:performance-benchmark elapsed time at v8-snapshot-startup-time: 91.567ms\n' +
    '2024-02-21T15:41:44.171Z cypress:server:appdata path: /Users/leosvel/Library/Application Support/Cypress/cy/production/browsers\n' +
    "2024-02-21T15:41:44.175Z cypress:server:cypress starting cypress with argv [ '/Users/leosvel/Library/Caches/Cypress/13.6.5/Cypress.app/Contents/MacOS/Cypress', '--no-sandbox', '--smoke-test', '--ping=397' ]\n" +
    "2024-02-21T15:41:44.175Z cypress:server:args argv array: [ '/Users/leosvel/Library/Caches/Cypress/13.6.5/Cypress.app/Contents/MacOS/Cypress', '--no-sandbox', '--smoke-test', '--ping=397' ]\n" +
    "2024-02-21T15:41:44.176Z cypress:server:args parsed argv options { options: { _: [ '/Users/leosvel/Library/Caches/Cypress/13.6.5/Cypress.app/Contents/MacOS/Cypress' ], sandbox: false, 'smoke-test': true, smokeTest: true, ping: 397 } }\n" +
    "2024-02-21T15:41:44.177Z cypress:server:args argv parsed: { _: [ '/Users/leosvel/Library/Caches/Cypress/13.6.5/Cypress.app/Contents/MacOS/Cypress' ], sandbox: false, smokeTest: true, ping: 397, invokedFromCli: false, cwd: '/Users/leosvel/code/playground/baz/apps/app1-e2e' }\n" +
    '2024-02-21T15:41:44.178Z cypress:server:util:proxy found proxy environment variables {}\n' +
    "2024-02-21T15:41:44.179Z cypress:server:args options { _: [ '/Users/leosvel/Library/Caches/Cypress/13.6.5/Cypress.app/Contents/MacOS/Cypress' ], sandbox: false, smokeTest: true, ping: 397, invokedFromCli: false, cwd: '/Users/leosvel/code/playground/baz/apps/app1-e2e', config: {} }\n" +
    "2024-02-21T15:41:44.179Z cypress:server:args argv options: { _: [ '/Users/leosvel/Library/Caches/Cypress/13.6.5/Cypress.app/Contents/MacOS/Cypress' ], sandbox: false, smokeTest: true, ping: 397, invokedFromCli: false, cwd: '/Users/leosvel/code/playground/baz/apps/app1-e2e', config: {}, pong: 397 }\n" +
    "2024-02-21T15:41:44.179Z cypress:server:cypress from argv [ '/Users/leosvel/Library/Caches/Cypress/13.6.5/Cypress.app/Contents/MacOS/Cypress', '--no-sandbox', '--smoke-test', '--ping=397' ] got options { _: [ '/Users/leosvel/Library/Caches/Cypress/13.6.5/Cypress.app/Contents/MacOS/Cypress' ], sandbox: false, smokeTest: true, ping: 397, invokedFromCli: false, cwd: '/Users/leosvel/code/playground/baz/apps/app1-e2e', config: {}, pong: 397 }\n" +
    '2024-02-21T15:41:44.192Z cypress:server:appdata path: /Users/leosvel/Library/Application Support/Cypress/cy/production\n' +
    '\n' +
    'DevTools listening on ws://127.0.0.1:60453/devtools/browser/523fde03-4c63-4b10-ad8c-177fcf420250\n' +
    '2024-02-21 16:41:44.205 Cypress[65346:36315567] WARNING: Secure coding is not enabled for restorable state! Enable secure coding by implementing NSApplicationDelegate.applicationSupportsSecureRestorableState: and returning YES.\n' +
    "2024-02-21T15:41:44.215Z cypress:server:cypress starting in mode smokeTest with options { _: [ '/Users/leosvel/Library/Caches/Cypress/13.6.5/Cypress.app/Contents/MacOS/Cypress' ], sandbox: false, smokeTest: true, ping: 397, invokedFromCli: false, cwd: '/Users/leosvel/code/playground/baz/apps/app1-e2e', config: {}, pong: 397 }\n" +
    '2024-02-21T15:41:44.217Z cypress:server:cypress running Electron currently\n' +
    '2024-02-21T15:41:44.220Z cypress:server:cypress about to exit with code 0\n' +
    '2024-02-21T15:41:44.220Z cypress:server:browsers browsers.kill called with no active instance',
  all: undefined,
  failed: false,
  timedOut: false,
  isCanceled: false,
  killed: false
} +0ms

Cypress verification failed.

This command failed with the following output:

/Users/leosvel/Library/Caches/Cypress/13.6.5/Cypress.app/Contents/MacOS/Cypress --no-sandbox --smoke-test --ping=397

----------

2024-02-21T15:41:44.055Z cypress:snapshot:info Caching 3471, defining 4299 modules! Using cache
2024-02-21T15:41:44.055Z cypress:snapshot:debug initializing packherd require
2024-02-21T15:41:44.144Z cypress:server:performance-benchmark elapsed time at v8-snapshot-startup-time: 91.567ms
2024-02-21T15:41:44.171Z cypress:server:appdata path: /Users/leosvel/Library/Application Support/Cypress/cy/production/browsers
2024-02-21T15:41:44.175Z cypress:server:cypress starting cypress with argv [ '/Users/leosvel/Library/Caches/Cypress/13.6.5/Cypress.app/Contents/MacOS/Cypress', '--no-sandbox', '--smoke-test', '--ping=397' ]
2024-02-21T15:41:44.175Z cypress:server:args argv array: [ '/Users/leosvel/Library/Caches/Cypress/13.6.5/Cypress.app/Contents/MacOS/Cypress', '--no-sandbox', '--smoke-test', '--ping=397' ]
2024-02-21T15:41:44.176Z cypress:server:args parsed argv options { options: { _: [ '/Users/leosvel/Library/Caches/Cypress/13.6.5/Cypress.app/Contents/MacOS/Cypress' ], sandbox: false, 'smoke-test': true, smokeTest: true, ping: 397 } }
2024-02-21T15:41:44.177Z cypress:server:args argv parsed: { _: [ '/Users/leosvel/Library/Caches/Cypress/13.6.5/Cypress.app/Contents/MacOS/Cypress' ], sandbox: false, smokeTest: true, ping: 397, invokedFromCli: false, cwd: '/Users/leosvel/code/playground/baz/apps/app1-e2e' }
2024-02-21T15:41:44.178Z cypress:server:util:proxy found proxy environment variables {}
2024-02-21T15:41:44.179Z cypress:server:args options { _: [ '/Users/leosvel/Library/Caches/Cypress/13.6.5/Cypress.app/Contents/MacOS/Cypress' ], sandbox: false, smokeTest: true, ping: 397, invokedFromCli: false, cwd: '/Users/leosvel/code/playground/baz/apps/app1-e2e', config: {} }
2024-02-21T15:41:44.179Z cypress:server:args argv options: { _: [ '/Users/leosvel/Library/Caches/Cypress/13.6.5/Cypress.app/Contents/MacOS/Cypress' ], sandbox: false, smokeTest: true, ping: 397, invokedFromCli: false, cwd: '/Users/leosvel/code/playground/baz/apps/app1-e2e', config: {}, pong: 397 }
2024-02-21T15:41:44.179Z cypress:server:cypress from argv [ '/Users/leosvel/Library/Caches/Cypress/13.6.5/Cypress.app/Contents/MacOS/Cypress', '--no-sandbox', '--smoke-test', '--ping=397' ] got options { _: [ '/Users/leosvel/Library/Caches/Cypress/13.6.5/Cypress.app/Contents/MacOS/Cypress' ], sandbox: false, smokeTest: true, ping: 397, invokedFromCli: false, cwd: '/Users/leosvel/code/playground/baz/apps/app1-e2e', config: {}, pong: 397 }
2024-02-21T15:41:44.192Z cypress:server:appdata path: /Users/leosvel/Library/Application Support/Cypress/cy/production

DevTools listening on ws://127.0.0.1:60453/devtools/browser/523fde03-4c63-4b10-ad8c-177fcf420250
2024-02-21 16:41:44.205 Cypress[65346:36315567] WARNING: Secure coding is not enabled for restorable state! Enable secure coding by implementing NSApplicationDelegate.applicationSupportsSecureRestorableState: and returning YES.
2024-02-21T15:41:44.215Z cypress:server:cypress starting in mode smokeTest with options { _: [ '/Users/leosvel/Library/Caches/Cypress/13.6.5/Cypress.app/Contents/MacOS/Cypress' ], sandbox: false, smokeTest: true, ping: 397, invokedFromCli: false, cwd: '/Users/leosvel/code/playground/baz/apps/app1-e2e', config: {}, pong: 397 }
2024-02-21T15:41:44.217Z cypress:server:cypress running Electron currently
2024-02-21T15:41:44.220Z cypress:server:cypress about to exit with code 0
2024-02-21T15:41:44.220Z cypress:server:browsers browsers.kill called with no active instance

----------

Platform: darwin-arm64 (23.2.0)
Cypress Version: 13.6.5
Warning: command "cypress run" exited with non-zero status code
 ————————————————————————————————————————————————————————————————————————————————————————————————————————————————————————————————————————————————————————————————————————

 >  NX   Ran target e2e for project app1-e2e (4s)

    ✖    1/1 failed
    ✔    0/1 succeeded [0 read from cache]

@jennifer-shehane
Copy link
Member

We have an example of this failing in one of our pipelines using NX, so that seems to be one of the key identified factors. If you're experiencing this issue without use of NX, that'd be good info to have.

@jennifer-shehane jennifer-shehane changed the title "Cypress verification failed" after upgrading to 13.6.5 "Cypress verification failed" after upgrading to 13.6.5 with use of NX Feb 21, 2024
@jennifer-shehane jennifer-shehane added stage: investigating Someone from Cypress is looking into this and removed stage: needs information Not enough info to reproduce the issue labels Feb 21, 2024
@mshima
Copy link

mshima commented Feb 21, 2024

BTW every JHipster workflows is failing with 3.6.5.
jhipster/generator-jhipster#25282

Version 3.6.4 is working as expected at main branch.
Not using NX.

@jennifer-shehane
Copy link
Member

@mshima We're working on identifying the issue to get a fix out asap. For now, we suggest downgrading to 13.6.4 for NX users.

@jennifer-shehane
Copy link
Member

We've identified a possible solution on our side and will work on getting a patch fix out.

Unfortunately, there doesn't seem to be a workaround that users of NX can do in the meantime in order to use Cypress 13.6.5.

@PodStuart
Copy link

We have the same issue on an Nx repository. Confident it is not cache related as we cache using a has of package.json and package-lock.json.

@jennifer-shehane
Copy link
Member

Yeah, it's not cache related and won't be fixed by clearing the cache unfortunately. You'll have to downgrade to 13.6.4.

This issue has some relation to how NX handles ansi colors in the CLI (somewhat relevant thread here explaining how they override some things: nrwl/nx#8051)

In 13.6.4, the random output after the binary warning is not ansi colored. (See 532 number)

Screenshot 2024-02-21 at 12 32 56 PM

In 13.6.5, the random output after the binary warning is ansi colored yellow. (See 781 number)

Screenshot 2024-02-21 at 12 07 21 PM

When we attempt to compare this random number during verification, since it's wrapped in ansi coloration - the verification fails. I can't say this was the most elegant way to code the verification to begin with, but that's where we are.

This issue was introduced in the Electron 27 upgrade in 13.6.5: #28792 We still have no idea why that change had an effect on this.

We plan to try to remove colors completely during the verification step to see if that will resolve the issue. Passing an env var to turn off colors from the parent process has no effect, so it isn't available as a workaround.

swouf added a commit to graasp/graasp-app-collaborative-ideation that referenced this issue Feb 22, 2024
swouf added a commit to graasp/graasp-app-collaborative-ideation that referenced this issue Feb 22, 2024
make rating empty by default
and remove hover effect

test: downgrade cypress
    see cypress-io/cypress#28982
@cypress-bot
Copy link
Contributor

cypress-bot bot commented Feb 22, 2024

Released in 13.6.6.

This comment thread has been locked. If you are still experiencing this issue after upgrading to
Cypress v13.6.6, please open a new issue.

@cypress-bot cypress-bot bot removed the stage: investigating Someone from Cypress is looking into this label Feb 22, 2024
@cypress-bot cypress-bot bot locked as resolved and limited conversation to collaborators Feb 22, 2024
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Projects
Status: Generally Available
Development

Successfully merging a pull request may close this issue.

9 participants