Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Failing test: Jest Integration Tests.x-pack/plugins/fleet/server/integration_tests - Fleet preconfiguration reset Preconfigred cloud policy Create correct .fleet-policies #127076

Closed
kibanamachine opened this issue Mar 7, 2022 · 12 comments · Fixed by #127296 or #128973
Closed

Failing test: Jest Integration Tests.x-pack/plugins/fleet/server/integration_tests - Fleet preconfiguration reset Preconfigred cloud policy Create correct .fleet-policies #127076

kibanamachine opened this issue Mar 7, 2022 · 12 comments · Fixed by #127296 or #128973
Assignees
@nchaulet
Labels
failed-test A test failure on a tracked branch, potentially flaky-test Team:Fleet Team label for Observability Data Collection Fleet team

Comments

@kibanamachine
Copy link
Contributor

kibanamachine commented Mar 7, 2022 •
edited
Loading

A test failed on a tracked branch

Error: Setup failed: {"level":"available","summary":"Fleet setup failed","meta":{"error":"[Elastic Cloud agent policy] could not be added. [fleet_server] could not be installed due to error: [RegistryResponseError: '502 Bad Gateway' error response from package registry at https://epr-snapshot.elastic.co/package/fleet_server/1.1.1]"}}
    at isFleetSetupRunning (/opt/local-ssd/buildkite/builds/kb-n2-4-79e94f24dd9ec626/elastic/kibana-hourly/kibana/x-pack/plugins/fleet/server/integration_tests/helpers/index.ts:23:13)
    at runMicrotasks (<anonymous>)
    at processTicksAndRejections (node:internal/process/task_queues:96:5)
    at waitForFleetSetup (/opt/local-ssd/buildkite/builds/kb-n2-4-79e94f24dd9ec626/elastic/kibana-hourly/kibana/x-pack/plugins/fleet/server/integration_tests/helpers/index.ts:29:10)
    at startServers (/opt/local-ssd/buildkite/builds/kb-n2-4-79e94f24dd9ec626/elastic/kibana-hourly/kibana/x-pack/plugins/fleet/server/integration_tests/cloud_preconfiguration.test.ts:81:5)
    at /opt/local-ssd/buildkite/builds/kb-n2-4-79e94f24dd9ec626/elastic/kibana-hourly/kibana/x-pack/plugins/fleet/server/integration_tests/cloud_preconfiguration.test.ts:98:5
    at _callCircusHook (/opt/local-ssd/buildkite/builds/kb-n2-4-79e94f24dd9ec626/elastic/kibana-hourly/kibana/node_modules/jest-circus/build/run.js:175:5)
    at _runTestsForDescribeBlock (/opt/local-ssd/buildkite/builds/kb-n2-4-79e94f24dd9ec626/elastic/kibana-hourly/kibana/node_modules/jest-circus/build/run.js:45:5)
    at _runTestsForDescribeBlock (/opt/local-ssd/buildkite/builds/kb-n2-4-79e94f24dd9ec626/elastic/kibana-hourly/kibana/node_modules/jest-circus/build/run.js:57:9)
    at run (/opt/local-ssd/buildkite/builds/kb-n2-4-79e94f24dd9ec626/elastic/kibana-hourly/kibana/node_modules/jest-circus/build/run.js:25:3)
    at runAndTransformResultsToJestFormat (/opt/local-ssd/buildkite/builds/kb-n2-4-79e94f24dd9ec626/elastic/kibana-hourly/kibana/node_modules/jest-circus/build/legacy-code-todo-rewrite/jestAdapterInit.js:176:21)
    at jestAdapter (/opt/local-ssd/buildkite/builds/kb-n2-4-79e94f24dd9ec626/elastic/kibana-hourly/kibana/node_modules/jest-circus/build/legacy-code-todo-rewrite/jestAdapter.js:109:19)
    at runTestInternal (/opt/local-ssd/buildkite/builds/kb-n2-4-79e94f24dd9ec626/elastic/kibana-hourly/kibana/node_modules/jest-runner/build/runTest.js:380:16)
    at runTest (/opt/local-ssd/buildkite/builds/kb-n2-4-79e94f24dd9ec626/elastic/kibana-hourly/kibana/node_modules/jest-runner/build/runTest.js:472:34)

First failure: CI Build - main
@kibanamachine kibanamachine added the failed-test A test failure on a tracked branch, potentially flaky-test label Mar 7, 2022
@botelastic botelastic bot added the needs-team Issues missing a team label label Mar 7, 2022
@kertal kertal added the Team:Fleet Team label for Observability Data Collection Fleet team label Mar 9, 2022
@elasticmachine
Copy link
Contributor

Pinging @elastic/fleet (Team:Fleet)

@botelastic botelastic bot removed the needs-team Issues missing a team label label Mar 9, 2022
spalger pushed a commit that referenced this issue Mar 9, 2022
skip failing test (#127076)
5217b9a
@spalger
Copy link
Contributor

spalger commented Mar 9, 2022 •
edited
Loading

Had to skip this test in main as it was consistently failing.

5217b9a

@nchaulet looks like you added this test in #126605 8 days ago. The test seems to include details from the remote service in the snapshot, which makes them fail when packages are updated. Please try to avoid ever including details from a remote service in snapshots like this.

Example failure: https://buildkite.com/organizations/elastic/pipelines/kibana-pull-request/builds/28804/jobs/0b9068b9-08c9-4007-8957-0cae661e081c/artifacts/1ccd6acb-f5c3-4ca3-97d9-e436fe5c7a41

Error: expect(received).toMatchSnapshot()

Snapshot name: `Fleet preconfiguration reset Preconfigred cloud policy Create correct .fleet-policies 1`

- Snapshot  - 1
+ Received  + 1

@@ -110,11 +110,11 @@
        },
        "id": "elastic-cloud-apm",
        "meta": Object {
          "package": Object {
            "name": "apm",
-           "version": "8.2.0-dev3",
+           "version": "8.2.0-dev4",
          },
        },
        "name": "Elastic APM",
        "revision": 1,
        "type": "apm",
    at Object.<anonymous> (/opt/local-ssd/buildkite/builds/kb-n2-4-a7dae73aa4146e89/elastic/kibana-pull-request/kibana/x-pack/plugins/fleet/server/integration_tests/cloud_preconfiguration.test.ts:128:55)
    at runMicrotasks (<anonymous>)
    at processTicksAndRejections (node:internal/process/task_queues:96:5)
    at _callCircusTest (/opt/local-ssd/buildkite/builds/kb-n2-4-a7dae73aa4146e89/elastic/kibana-pull-request/kibana/node_modules/jest-circus/build/run.js:212:5)
    at _runTest (/opt/local-ssd/buildkite/builds/kb-n2-4-a7dae73aa4146e89/elastic/kibana-pull-request/kibana/node_modules/jest-circus/build/run.js:149:3)
    at _runTestsForDescribeBlock (/opt/local-ssd/buildkite/builds/kb-n2-4-a7dae73aa4146e89/elastic/kibana-pull-request/kibana/node_modules/jest-circus/build/run.js:63:9)
    at _runTestsForDescribeBlock (/opt/local-ssd/buildkite/builds/kb-n2-4-a7dae73aa4146e89/elastic/kibana-pull-request/kibana/node_modules/jest-circus/build/run.js:57:9)
    at _runTestsForDescribeBlock (/opt/local-ssd/buildkite/builds/kb-n2-4-a7dae73aa4146e89/elastic/kibana-pull-request/kibana/node_modules/jest-circus/build/run.js:57:9)
    at run (/opt/local-ssd/buildkite/builds/kb-n2-4-a7dae73aa4146e89/elastic/kibana-pull-request/kibana/node_modules/jest-circus/build/run.js:25:3)
    at runAndTransformResultsToJestFormat (/opt/local-ssd/buildkite/builds/kb-n2-4-a7dae73aa4146e89/elastic/kibana-pull-request/kibana/node_modules/jest-circus/build/legacy-code-todo-rewrite/jestAdapterInit.js:176:21)
    at jestAdapter (/opt/local-ssd/buildkite/builds/kb-n2-4-a7dae73aa4146e89/elastic/kibana-pull-request/kibana/node_modules/jest-circus/build/legacy-code-todo-rewrite/jestAdapter.js:109:19)
    at runTestInternal (/opt/local-ssd/buildkite/builds/kb-n2-4-a7dae73aa4146e89/elastic/kibana-pull-request/kibana/node_modules/jest-runner/build/runTest.js:380:16)
    at runTest (/opt/local-ssd/buildkite/builds/kb-n2-4-a7dae73aa4146e89/elastic/kibana-pull-request/kibana/node_modules/jest-runner/build/runTest.js:472:34)

@nchaulet nchaulet self-assigned this Mar 9, 2022
@nchaulet
Copy link
Member

nchaulet commented Mar 9, 2022

Normally we should use a docker registry for these tests and have a fixed version of the packages but looks it not working, I need to investigate more.

@nchaulet nchaulet mentioned this issue Mar 9, 2022
Merged
@spalger
Copy link
Contributor

spalger commented Mar 9, 2022

Thanks for taking care of this so quickly!

@kibanamachine
Copy link
Contributor Author

New failure: CI Build - main

@kibanamachine kibanamachine reopened this Mar 26, 2022
@kibanamachine
Copy link
Contributor Author

New failure: CI Build - main

@kibanamachine
Copy link
Contributor Author

New failure: CI Build - main

@kibanamachine
Copy link
Contributor Author

New failure: CI Build - main

@kibanamachine
Copy link
Contributor Author

New failure: CI Build - main

@kibanamachine
Copy link
Contributor Author

New failure: CI Build - main

@kibanamachine
Copy link
Contributor Author

New failure: CI Build - main

jbudz added a commit that referenced this issue Mar 27, 2022
@jbudz
skip flaky suite. #127076
805d7cf
@jbudz
Copy link
Member

jbudz commented Mar 27, 2022

skipped

main: 805d7cf

@jbudz jbudz added the v8.2.0 label Mar 27, 2022
@nchaulet nchaulet mentioned this issue Mar 30, 2022
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@nchaulet nchaulet

Labels
failed-test A test failure on a tracked branch, potentially flaky-test Team:Fleet Team label for Observability Data Collection Fleet team
Projects
None yet
Milestone
No milestone
6 participants
@kertal @spalger @nchaulet @jbudz @elasticmachine @kibanamachine