Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Failing test: Security Solution Cypress.x-pack/plugins/security_solution/public/management/cypress/e2e/endpoint_list/endpoints·cy·ts - Endpoints page "after all" hook for "Shows endpoint on the list" "after all" hook for "Shows endpoint on the list" #168719

Closed
kibanamachine opened this issue Oct 12, 2023 · 152 comments · Fixed by #186073
Closed

Failing test: Security Solution Cypress.x-pack/plugins/security_solution/public/management/cypress/e2e/endpoint_list/endpoints·cy·ts - Endpoints page "after all" hook for "Shows endpoint on the list" "after all" hook for "Shows endpoint on the list" #168719

kibanamachine opened this issue Oct 12, 2023 · 152 comments · Fixed by #186073
Assignees
@szwarckonrad
Labels
failed-test A test failure on a tracked branch, potentially flaky-test Team:Defend Workflows “EDR Workflows” sub-team of Security Solution

Comments

@kibanamachine
Copy link
Contributor

kibanamachine commented Oct 12, 2023 •
edited
Loading

A test failed on a tracked branch

CypressError: `cy.task('deleteIndexedFleetEndpointPolicies')` failed with the following error:

> Request failed with status code 500

https://on.cypress.io/api/task

Because this error occurred during a `after all` hook we are skipping the remaining tests in the current suite: `Endpoints page`

Although you have test retries enabled, we do not retry tests when `before all` or `after all` hooks fail
    at <unknown> (http://localhost:5696/__cypress/runner/cypress_runner.js:135296:70)
    at tryCatcher (http://localhost:5696/__cypress/runner/cypress_runner.js:1807:23)
    at Promise._settlePromiseFromHandler (http://localhost:5696/__cypress/runner/cypress_runner.js:1519:31)
    at Promise._settlePromise (http://localhost:5696/__cypress/runner/cypress_runner.js:1576:18)
    at Promise._settlePromise0 (http://localhost:5696/__cypress/runner/cypress_runner.js:1621:10)
    at Promise._settlePromises (http://localhost:5696/__cypress/runner/cypress_runner.js:1697:18)
    at _drainQueueStep (http://localhost:5696/__cypress/runner/cypress_runner.js:2407:12)
    at _drainQueue (http://localhost:5696/__cypress/runner/cypress_runner.js:2400:9)
    at Async._drainQueues (http://localhost:5696/__cypress/runner/cypress_runner.js:2416:5)
    at Async.drainQueues (http://localhost:5696/__cypress/runner/cypress_runner.js:2286:14)
From Your Spec Code:
    at Context.eval (webpack:///./e2e/endpoint_list/endpoints.cy.ts:62:9)

From Node.js Internals:
  Error: Request failed with status code 500
      at wrapErrorIfNeeded (/opt/local-ssd/buildkite/builds/kb-n2-4-virt-dd47435bc569fd54/elastic/kibana-on-merge/kibana/x-pack/plugins/security_solution/common/endpoint/data_loaders/utils.ts:25:7)
      at wrapErrorAndRejectPromise (/opt/local-ssd/buildkite/builds/kb-n2-4-virt-dd47435bc569fd54/elastic/kibana-on-merge/kibana/x-pack/plugins/security_solution/common/endpoint/data_loaders/utils.ts:28:92)
      at processTicksAndRejections (node:internal/process/task_queues:95:5)
      at async deleteIndexedFleetEndpointPolicies (/opt/local-ssd/buildkite/builds/kb-n2-4-virt-dd47435bc569fd54/elastic/kibana-on-merge/kibana/x-pack/plugins/security_solution/common/endpoint/data_loaders/index_fleet_endpoint_policy.ts:166:12)

First failure: CI Build - main
@kibanamachine kibanamachine added the failed-test A test failure on a tracked branch, potentially flaky-test label Oct 12, 2023
@botelastic botelastic bot added the needs-team Issues missing a team label label Oct 12, 2023
@kibanamachine kibanamachine added the Team:Defend Workflows “EDR Workflows” sub-team of Security Solution label Oct 12, 2023
@elasticmachine
Copy link
Contributor

Pinging @elastic/security-defend-workflows (Team:Defend Workflows)

@botelastic botelastic bot removed the needs-team Issues missing a team label label Oct 12, 2023
@szwarckonrad szwarckonrad mentioned this issue Oct 25, 2023
Merged
szwarckonrad added a commit that referenced this issue Oct 25, 2023
@szwarckonrad @patrykkopycinski
[EDR Workflows][E2E] Recreate agent on createEndpointHost task fail (#…
1fdcb41 
…169092)

Restart vagrant vm on error during `beforeAll` task `createEndpointHost`

Defend Workflows Cypress suite ran 300 times through flaky test runner:
1. 100x
https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/3699
2. 50x
https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/3707
3. 50x
https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/3708
4. 50x
https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/3709
5. 50x
https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/3710


Flaky test runner runs with `createEndpointHost` task failure with
successful recovery:
1.
https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/3710#018b62fd-9ae9-4988-b1e0-ab0f04d8efdc
2.
https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/3710#018b62fd-9ae6-4340-992b-1474ee0f114b
3.
https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/3708#018b62fd-578e-4817-ae1c-8c58e8774eec
4.
https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/3708#018b62fd-5787-4245-85a6-cb446e42bc73
5.
https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/3707#018b62fc-fc17-407e-88de-d0b43b6b1d44
(failed due to unrelated issue)
6.
https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/3699#018b61d9-d2c3-430c-b3e3-72b9fbb22d24
7.
https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/3699#018b61d9-d2c6-4315-b828-b3218a70f209
8.
https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/3699#018b61d9-d2c7-4ff7-9a70-7354f90179e0
9.
https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/3699#018b61d9-d2d7-418f-b043-049e5effb26f
10.
https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/3699#018b61d9-d2da-47cc-b4ea-a4d4de3ba0a0

New errors not spotted before that got to do with env set up:

1. `vagrant up` failed:
1.1
https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/3708#018b62fd-5787-4245-85a6-cb446e42bc73
1.2
https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/3699#018b61d9-d2d0-4a52-87d9-34caa8927465

2. `CypressError: `cy.task('indexFleetEndpointPolicy')` timed out after
waiting `60000ms`.:
2.1
https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/3707#018b62fc-fc04-40d4-b155-46f094681edb
2.2
https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/3699#018b61d9-d2c9-4ebb-9174-eb9d79d04d02
2.3
https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/3699#018b61d9-d2dc-438f-94b0-9f94ae95701c
    

Closes:
#168284
#169343
#169468
#169469
#169467
#169465
#169466
#169157
#168719
#168427
#168359
#168340
#169689

---------

Co-authored-by: Patryk Kopyciński <contact@patrykkopycinski.com>
@kibanamachine kibanamachine reopened this Jun 8, 2024
@kibanamachine
Copy link
Contributor Author

New failure: kibana-elasticsearch-serverless-verify-and-promote - main

1 similar comment
@kibanamachine
Copy link
Contributor Author

New failure: kibana-elasticsearch-serverless-verify-and-promote - main

@kibanamachine
Copy link
Contributor Author

New failure: kibana-on-merge - main

1 similar comment
@kibanamachine
Copy link
Contributor Author

New failure: kibana-on-merge - main

@kibanamachine
Copy link
Contributor Author

New failure: kibana-on-merge - main

1 similar comment
@kibanamachine
Copy link
Contributor Author

New failure: kibana-on-merge - main

@kibanamachine
Copy link
Contributor Author

New failure: kibana-on-merge - main

1 similar comment
@kibanamachine
Copy link
Contributor Author

New failure: kibana-on-merge - main

@kibanamachine
Copy link
Contributor Author

New failure: kibana-on-merge - main

1 similar comment
@kibanamachine
Copy link
Contributor Author

New failure: kibana-on-merge - main

@kibanamachine
Copy link
Contributor Author

New failure: kibana-on-merge - main

1 similar comment
@kibanamachine
Copy link
Contributor Author

New failure: kibana-on-merge - main

@kibanamachine
Copy link
Contributor Author

New failure: kibana-on-merge - main

1 similar comment
@kibanamachine
Copy link
Contributor Author

New failure: kibana-on-merge - main

@kibanamachine
Copy link
Contributor Author

New failure: kibana-elasticsearch-serverless-verify-and-promote - main

1 similar comment
@kibanamachine
Copy link
Contributor Author

New failure: kibana-elasticsearch-serverless-verify-and-promote - main

@kibanamachine
Copy link
Contributor Author

New failure: kibana-on-merge - main

1 similar comment
@kibanamachine
Copy link
Contributor Author

New failure: kibana-on-merge - main

@kibanamachine
Copy link
Contributor Author

New failure: kibana-on-merge - main

1 similar comment
@kibanamachine
Copy link
Contributor Author

New failure: kibana-on-merge - main

@kibanamachine
Copy link
Contributor Author

New failure: kibana-on-merge - main

@kibanamachine
Copy link
Contributor Author

New failure: kibana-on-merge - main

1 similar comment
@kibanamachine
Copy link
Contributor Author

New failure: kibana-on-merge - main

@kibanamachine
Copy link
Contributor Author

New failure: kibana-on-merge - main

1 similar comment
@kibanamachine
Copy link
Contributor Author

New failure: kibana-on-merge - main

@kibanamachine
Copy link
Contributor Author

New failure: kibana-on-merge - main

1 similar comment
@kibanamachine
Copy link
Contributor Author

New failure: kibana-on-merge - main

@kibanamachine
Copy link
Contributor Author

New failure: kibana-on-merge - main

1 similar comment
@kibanamachine
Copy link
Contributor Author

New failure: kibana-on-merge - main

@kibanamachine
Copy link
Contributor Author

New failure: kibana-on-merge - main

1 similar comment
@kibanamachine
Copy link
Contributor Author

New failure: kibana-on-merge - main

@kibanamachine
Copy link
Contributor Author

New failure: kibana-on-merge - main

1 similar comment
@kibanamachine
Copy link
Contributor Author

New failure: kibana-on-merge - main

@kibanamachine
Copy link
Contributor Author

New failure: kibana-on-merge - main

1 similar comment
@kibanamachine
Copy link
Contributor Author

New failure: kibana-on-merge - main

@kibanamachine
Copy link
Contributor Author

New failure: kibana-on-merge - main

1 similar comment
@kibanamachine
Copy link
Contributor Author

New failure: kibana-on-merge - main

kibanamachine added a commit that referenced this issue Jun 11, 2024
@kibanamachine
skip failing test suite (#168719)
7bab98a
@kibanamachine
Copy link
Contributor Author

Skipped

main: 7bab98a

ashokaditya added a commit to ashokaditya/kibana that referenced this issue Jun 12, 2024
@ashokaditya
Update endpoints.cy.ts
102f490 
closes elastic/issues/168719
closes elastic/issues/168284
@ashokaditya ashokaditya mentioned this issue Jun 12, 2024
Merged
2 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@szwarckonrad szwarckonrad

Labels
failed-test A test failure on a tracked branch, potentially flaky-test Team:Defend Workflows “EDR Workflows” sub-team of Security Solution
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

[SecuritySolution][Endpoint] Re-enable several skipped tests ashokaditya/kibana
3 participants
@elasticmachine @szwarckonrad @kibanamachine