Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Failing test: Security Solution Cypress.x-pack/plugins/security_solution/public/management/cypress/e2e/endpoint_list/endpoints·cy·ts - Endpoints page "before all" hook for "Shows endpoint on the list" "before all" hook for "Shows endpoint on the list" #168284

Closed
kibanamachine opened this issue Oct 6, 2023 · 53 comments · Fixed by #179743, #181655 or #183534
Closed

Failing test: Security Solution Cypress.x-pack/plugins/security_solution/public/management/cypress/e2e/endpoint_list/endpoints·cy·ts - Endpoints page "before all" hook for "Shows endpoint on the list" "before all" hook for "Shows endpoint on the list" #168284

kibanamachine opened this issue Oct 6, 2023 · 53 comments · Fixed by #179743, #181655 or #183534
Assignees
@joeypoon
Labels
failed-test A test failure on a tracked branch, potentially flaky-test Team:Defend Workflows “EDR Workflows” sub-team of Security Solution

Comments

@kibanamachine
Copy link
Contributor

kibanamachine commented Oct 6, 2023 •
edited

A test failed on a tracked branch

CypressError: `cy.task('createEndpointHost')` timed out after waiting `600000ms`.

https://on.cypress.io/api/task

Because this error occurred during a `before all` hook we are skipping the remaining tests in the current suite: `Endpoints page`

Although you have test retries enabled, we do not retry tests when `before all` or `after all` hooks fail
    at <unknown> (http://localhost:5689/__cypress/runner/cypress_runner.js:135256:70)
    at tryCatcher (http://localhost:5689/__cypress/runner/cypress_runner.js:1807:23)
    at <unknown> (http://localhost:5689/__cypress/runner/cypress_runner.js:4186:41)
    at tryCatcher (http://localhost:5689/__cypress/runner/cypress_runner.js:1807:23)
    at Promise._settlePromiseFromHandler (http://localhost:5689/__cypress/runner/cypress_runner.js:1519:31)
    at Promise._settlePromise (http://localhost:5689/__cypress/runner/cypress_runner.js:1576:18)
    at Promise._settlePromise0 (http://localhost:5689/__cypress/runner/cypress_runner.js:1621:10)
    at Promise._settlePromises (http://localhost:5689/__cypress/runner/cypress_runner.js:1697:18)
    at _drainQueueStep (http://localhost:5689/__cypress/runner/cypress_runner.js:2407:12)
    at _drainQueue (http://localhost:5689/__cypress/runner/cypress_runner.js:2400:9)
    at Async._drainQueues (http://localhost:5689/__cypress/runner/cypress_runner.js:2416:5)
    at Async.drainQueues (http://localhost:5689/__cypress/runner/cypress_runner.js:2286:14)
From Your Spec Code:
    at createEndpointHost (webpack:///./tasks/create_endpoint_host.ts:15:12)
    at Context.eval (webpack:///./e2e/endpoint_list/endpoints.cy.ts:48:36)

First failure: CI Build - main
@kibanamachine kibanamachine added the failed-test A test failure on a tracked branch, potentially flaky-test label Oct 6, 2023
@botelastic botelastic bot added the needs-team Issues missing a team label label Oct 6, 2023
@kibanamachine kibanamachine added the Team:Defend Workflows “EDR Workflows” sub-team of Security Solution label Oct 6, 2023
@elasticmachine
Copy link
Contributor

Pinging @elastic/security-defend-workflows (Team:Defend Workflows)

@botelastic botelastic bot removed the needs-team Issues missing a team label label Oct 6, 2023
@kibanamachine
Copy link
Contributor Author

New failure: CI Build - main

mistic added a commit that referenced this issue Oct 12, 2023
@mistic
skip flaky suite (#168284)
a07fa0f
@mistic
Copy link
Member

mistic commented Oct 12, 2023

Skipped.

main: a07fa0f

dej611 pushed a commit to dej611/kibana that referenced this issue Oct 17, 2023
@mistic @dej611
skip flaky suite (elastic#168284)
aeb97df
benakansara pushed a commit to benakansara/kibana that referenced this issue Oct 22, 2023
@mistic @benakansara
skip flaky suite (elastic#168284)
145cdf0
benakansara pushed a commit to benakansara/kibana that referenced this issue Oct 22, 2023
@mistic @benakansara
skip flaky suite (elastic#168284)
39661ea
@szwarckonrad szwarckonrad mentioned this issue Oct 25, 2023
Merged
@kibanamachine kibanamachine reopened this Oct 26, 2023
@kibanamachine
Copy link
Contributor Author

New failure: CI Build - main

@szwarckonrad
Copy link
Contributor

Last failure


> Command failed with exit code 1: vagrant ssh -- cd elastic-agent-8.12.0-SNAPSHOT-linux-x86_64 && sudo ./elastic-agent install --insecure --force --url https://10.128.0.242:8236 --enrollment-token enNJN2E0c0JBRUVzb3JwdG1MMl86RjUzNzlqNzNSa2lYMWd2OV9QMzlUdw==
--
  | {"log.level":"warn","@timestamp":"2023-10-26T09:12:03.090Z","log.logger":"tls","log.origin":{"file.name":"tlscommon/tls_config.go","file.line":107},"message":"SSL/TLS verifications disabled.","ecs.version":"1.6.0"}
  | {"log.level":"info","@timestamp":"2023-10-26T09:12:03.203Z","log.origin":{"file.name":"cmd/enroll_cmd.go","file.line":479},"message":"Starting enrollment to URL: https://10.128.0.242:8236/","ecs.version":"1.6.0"}
  | {"log.level":"warn","@timestamp":"2023-10-26T09:12:03.468Z","log.logger":"tls","log.origin":{"file.name":"tlscommon/tls_config.go","file.line":107},"message":"SSL/TLS verifications disabled.","ecs.version":"1.6.0"}
  | Error: fail to enroll: fail to execute request to fleet-server: dial tcp 10.128.0.242:8236: connect: connection refused
  | For help, please see our troubleshooting guide at https://www.elastic.co/guide/en/fleet/8.12/fleet-troubleshooting.html
  | Error: enroll command failed for unknown reason: exit status 1
  | For help, please see our troubleshooting guide at https://www.elastic.co/guide/en/fleet/8.12/fleet-troubleshooting.html

@kevinlog
Copy link
Contributor

@szwarckonrad I'm sure you already noted this, but just to document that this failure and the ones like it are failing specifically on Serverless.

The fixes you merged yesterday for the normal runs seem to be running quiet so far.

Image

@kevinlog kevinlog assigned joeypoon and unassigned patrykkopycinski Nov 6, 2023
@joeypoon
Copy link
Member

joeypoon commented Mar 9, 2024

fixed in: #174977

@joeypoon joeypoon closed this as completed Mar 9, 2024
@kibanamachine
Copy link
Contributor Author

New failure: CI Build - main

1 similar comment
@kibanamachine
Copy link
Contributor Author

New failure: CI Build - main

@kibanamachine
Copy link
Contributor Author

New failure: CI Build - main

1 similar comment
@kibanamachine
Copy link
Contributor Author

New failure: CI Build - main

@kibanamachine
Copy link
Contributor Author

New failure: CI Build - main

1 similar comment
@kibanamachine
Copy link
Contributor Author

New failure: CI Build - main

@kibanamachine
Copy link
Contributor Author

New failure: CI Build - main

1 similar comment
@kibanamachine
Copy link
Contributor Author

New failure: CI Build - main

@kibanamachine
Copy link
Contributor Author

New failure: CI Build - main

1 similar comment
@kibanamachine
Copy link
Contributor Author

New failure: CI Build - main

@kibanamachine
Copy link
Contributor Author

New failure: CI Build - main

1 similar comment
@kibanamachine
Copy link
Contributor Author

New failure: CI Build - main

@kibanamachine
Copy link
Contributor Author

New failure: CI Build - main

1 similar comment
@kibanamachine
Copy link
Contributor Author

New failure: CI Build - main

@kibanamachine
Copy link
Contributor Author

New failure: CI Build - main

1 similar comment
@kibanamachine
Copy link
Contributor Author

New failure: CI Build - main

@kibanamachine
Copy link
Contributor Author

New failure: CI Build - main

1 similar comment
@kibanamachine
Copy link
Contributor Author

New failure: CI Build - main

@kibanamachine
Copy link
Contributor Author

New failure: kibana-on-merge - main

mistic added a commit that referenced this issue May 15, 2024
@mistic
skip flaky suite (#168284)
421205f
@mistic
Copy link
Member

mistic commented May 15, 2024

Skipped.

main: 421205f

@joeypoon joeypoon mentioned this issue May 15, 2024
Merged
3 tasks
joeypoon added a commit that referenced this issue May 16, 2024
@joeypoon
[Security Solution] unskip endpoint cypress tests (#183534)
7d6f2d4 
## Summary

`vagrant up` was [occasionally timing
out](#168284 (comment)).
bumped the `config.vm.boot_timeout` to mitigate flakiness from this.

flaky test run:
https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/5998
(50x ✅ )

fixes #168284

### Checklist

- [x] [Unit or functional
tests](https://www.elastic.co/guide/en/kibana/master/development-tests.html)
were updated or added to match the most common scenarios
- [x] [Flaky Test
Runner](https://ci-stats.kibana.dev/trigger_flaky_test_runner/1) was
used on any tests changed


### For maintainers

- [x] This was checked for breaking API changes and was [labeled
appropriately](https://www.elastic.co/guide/en/kibana/master/contributing.html#kibana-release-notes-process)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@joeypoon joeypoon

Labels
failed-test A test failure on a tracked branch, potentially flaky-test Team:Defend Workflows “EDR Workflows” sub-team of Security Solution
Projects
None yet
Milestone
No milestone
8 participants
@jbudz @mistic @patrykkopycinski @joeypoon @elasticmachine @szwarckonrad @kibanamachine @kevinlog