Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Flaky test: kbn-pm bootstrap #79891

Closed
spalger opened this issue Oct 7, 2020 · 4 comments
Closed

Flaky test: kbn-pm bootstrap #79891

spalger opened this issue Oct 7, 2020 · 4 comments
Labels
blocker failed-test A test failure on a tracked branch, potentially flaky-test skipped-test Team:Operations Team label for Operations Team v7.10.0

Comments

@spalger
Copy link
Contributor

spalger commented Oct 7, 2020

There is a flaky test in the @kbn/pm bootstrap suite that causes two failures.

First failure:

Kibana Pipeline / kibana-intake-agent / Jest Tests.packages/kbn-pm/src/commands.handles dependencies of dependencies

: Timeout - Async callback was not invoked within the 5000 ms timeout specified by jest.setTimeout.Timeout - Async callback was not invoked within the 5000 ms timeout specified by jest.setTimeout.Error: 
    at new Spec (/dev/shm/workspace/kibana/node_modules/jest-jasmine2/build/jasmine/Spec.js:116:22)
    at new Spec (/dev/shm/workspace/kibana/node_modules/jest-jasmine2/build/setup_jest_globals.js:78:9)
    at specFactory (/dev/shm/workspace/kibana/node_modules/jest-jasmine2/build/jasmine/Env.js:523:24)
    at Env.it (/dev/shm/workspace/kibana/node_modules/jest-jasmine2/build/jasmine/Env.js:592:24)
    at Env.it (/dev/shm/workspace/kibana/node_modules/jest-jasmine2/build/jasmineAsyncInstall.js:134:23)
    at test (/dev/shm/workspace/kibana/node_modules/jest-jasmine2/build/jasmine/jasmineLight.js:100:21)
    at Object.<anonymous> (/dev/shm/workspace/kibana/packages/kbn-pm/src/commands/bootstrap.test.ts:78:1)
    at Runtime._execModule (/dev/shm/workspace/kibana/node_modules/jest-runtime/build/index.js:1217:24)
    at Runtime._loadModule (/dev/shm/workspace/kibana/node_modules/jest-runtime/build/index.js:828:12)
    at Runtime.requireModule (/dev/shm/workspace/kibana/node_modules/jest-runtime/build/index.js:679:10)
    at jasmine2 (/dev/shm/workspace/kibana/node_modules/jest-jasmine2/build/index.js:230:13)
    at runTestInternal (/dev/shm/workspace/kibana/node_modules/jest-runner/build/runTest.js:372:22)
    at process._tickCallback (internal/process/next_tick.js:68:7)

Recent failure: https://kibana-ci.elastic.co/job/elasticsearch+snapshots+verify/1545/testReport/junit/Jest%20Tests/packages_kbn-pm_src_commands/Kibana_Pipeline___kibana_intake_agent___handles_dependencies_of_dependencies/

Second failure:

Kibana Pipeline / kibana-intake-agent / Jest Tests.packages/kbn-pm/src/commands.does not run installer if no deps in package

Error: expect(received).toMatchInlineSnapshot(snapshot)

Snapshot name: `does not run installer if no deps in package 1`

- Snapshot  - 6
+ Received  + 0

  Array [
     info [kibana] running yarn,
    "",
    "",
-    info [bar] running yarn,
-   "",
-   "",
-    info [foo] running yarn,
-   "",
-   "",
  ]
    at Object.<anonymous>.test (/dev/shm/workspace/kibana/packages/kbn-pm/src/commands/bootstrap.test.ts:129:30)
    at process._tickCallback (internal/process/next_tick.js:68:7)

Recent failure: https://kibana-ci.elastic.co/job/elasticsearch+snapshots+verify/1545/testReport/junit/Jest%20Tests/packages_kbn-pm_src_commands/Kibana_Pipeline___kibana_intake_agent___does_not_run_installer_if_no_deps_in_package/

These are happening pretty frequently in the current snapshot verification builds, which don't use tasks and therefore have slightly different performance characteristics than mainline and PR jobs, which might account for why we're getting timeouts there but not on mainline builds.
@spalger spalger added Team:Operations Team label for Operations Team failed-test A test failure on a tracked branch, potentially flaky-test labels Oct 7, 2020
@elasticmachine
Copy link
Contributor

Pinging @elastic/kibana-operations (Team:Operations)

@elasticmachine
Copy link
Contributor

Pinging @elastic/kibana-test-triage (failed-test)

spalger added a commit that referenced this issue Oct 7, 2020
@spalger
skip flaky tests (#79891)
6ee48d8
spalger added a commit that referenced this issue Oct 7, 2020
@spalger
skip flaky tests (#79891)
ff36a03 
(cherry picked from commit 6ee48d8)
spalger added a commit that referenced this issue Oct 7, 2020
@spalger
skip flaky tests (#79891)
b6cff76 
(cherry picked from commit 6ee48d8)
@spalger
Copy link
Contributor Author

spalger commented Oct 7, 2020 •
edited
Loading

Skipping

master: 6ee48d8 + 37f9db4 + 4ce3e1c
7.x/7.11: ff36a03 + 988e488 + c115b52
7.10: b6cff76 + f010d05 + 59d1599

gmmorris added a commit to gmmorris/kibana that referenced this issue Oct 8, 2020
@gmmorris
Merge branch 'master' into task-manager/health
2f12de5 
* master: (217 commits)
  Fix dashboard "snapshot share" is not sharing panel state in view mode (elastic#79837)
  fix can't edit a scripted field with special char (elastic#79842)
  [ML] clear selection action (elastic#79834)
  [TSVB] Show tooltip on external pointer events (elastic#77306)
  Fixes bug where the same index was being passed in (elastic#79949)
  Adds date time query and return fields for timestamps and overrides (elastic#79911)
  [Security Solution][Detections] Reverts rules table tag filter to use AND operator (elastic#79920)
  add the correct class to truncate the names (elastic#79921)
  [kbn/optimizer] report limits with ci metrics (elastic#78205)
  [release notes] extract "dev docs" comment too (elastic#79351)
  Revert "skips test failing promotion (elastic#79777)" (elastic#79904)
  share tslib across bundles (elastic#79915)
  remove entire suite as partial skips aren't doing the trick
  skip flaky suite (elastic#78689)
  Skip failing suite (elastic#79522)
  skip flaky suite (elastic#79910)
  [es/mappings] remove doc_values from text fields (elastic#79869)
  remove skipped snapshots
  skip flaky tests (elastic#79891)
  chore(NA): add missing branches into backportrc configuration file (elastic#79848)
  ...
@jbudz
Copy link
Member

jbudz commented Aug 16, 2021

This is managed by bazel now, so these tests are no longer relevant. The commits mentioned above removed the tests already. Closing this out

@jbudz jbudz closed this as completed Aug 16, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
blocker failed-test A test failure on a tracked branch, potentially flaky-test skipped-test Team:Operations Team label for Operations Team v7.10.0
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@spalger @jbudz @elasticmachine