Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[test-failed]: X-Pack Reporting API Integration Tests1.x-pack/test/reporting_api_integration/reporting_and_security/ilm_migration_apis·ts - Reporting APIs ILM policy migration APIs detects when no migration is needed #109456

Closed
liza-mae opened this issue Aug 20, 2021 · 9 comments · Fixed by #117003
Closed

[test-failed]: X-Pack Reporting API Integration Tests1.x-pack/test/reporting_api_integration/reporting_and_security/ilm_migration_apis·ts - Reporting APIs ILM policy migration APIs detects when no migration is needed #109456

liza-mae opened this issue Aug 20, 2021 · 9 comments · Fixed by #117003
Assignees
@tsullivan
Labels
failed-test A test failure on a tracked branch, potentially flaky-test impact:low Addressing this issue will have a low level of impact on the quality/strength of our product. loe:small Small Level of Effort test-cloud test-failure-flaky v7.15.0

Comments

@liza-mae
Copy link
Contributor

Version: 7.15.0
Class: X-Pack Reporting API Integration Tests1.x-pack/test/reporting_api_integration/reporting_and_security/ilm_migration_apis·ts
Stack Trace:

Error: expected 'policy-not-found' to sort of equal 'ok'
   at Assertion.assert (/var/lib/jenkins/workspace/elastic+estf-cloud-kibana-tests/JOB/xpackExtGrp1/TASK/saas_run_kibana_tests/node/ess-testing/ci/cloud/common/build/kibana/node_modules/@kbn/expect/expect.js:100:11)
   at Assertion.eql (/var/lib/jenkins/workspace/elastic+estf-cloud-kibana-tests/JOB/xpackExtGrp1/TASK/saas_run_kibana_tests/node/ess-testing/ci/cloud/common/build/kibana/node_modules/@kbn/expect/expect.js:244:8)
   at Context.<anonymous> (test/reporting_api_integration/reporting_and_security/ilm_migration_apis.ts:40:63)
   at runMicrotasks (<anonymous>)
   at processTicksAndRejections (internal/process/task_queues.js:95:5)
   at Object.apply (/var/lib/jenkins/workspace/elastic+estf-cloud-kibana-tests/JOB/xpackExtGrp1/TASK/saas_run_kibana_tests/node/ess-testing/ci/cloud/common/build/kibana/node_modules/@kbn/test/target_node/functional_test_runner/lib/mocha/wrap_function.js:87:16) {
 actual: 'policy-not-found',
 expected: 'ok',
 showDiff: true
}

Other test failures:

Test Report: https://internal-ci.elastic.co/view/Stack%20Tests/job/elastic+estf-cloud-kibana-tests/2193/testReport/
@liza-mae liza-mae added failed-test A test failure on a tracked branch, potentially flaky-test test-cloud labels Aug 20, 2021
@botelastic botelastic bot added the needs-team Issues missing a team label label Aug 20, 2021
@liza-mae liza-mae added the Team:Kibana Management Dev Tools, Index Management, Upgrade Assistant, ILM, Ingest Node Pipelines, and more label Aug 20, 2021
@elasticmachine
Copy link
Contributor

Pinging @elastic/kibana-stack-management (Team:Stack Management)

@botelastic botelastic bot removed the needs-team Issues missing a team label label Aug 20, 2021
@elasticmachine
Copy link
Contributor

Pinging @elastic/kibana-app-services (Team:AppServices)

@elasticmachine
Copy link
Contributor

Pinging @elastic/kibana-reporting-services (Team:Reporting Services)

@cjcenizal cjcenizal removed the Team:Kibana Management Dev Tools, Index Management, Upgrade Assistant, ILM, Ingest Node Pipelines, and more label Aug 20, 2021
@cjcenizal
Copy link
Contributor

Based on the test file history, this is owned by App Services and Reporting.

@exalate-issue-sync exalate-issue-sync bot added impact:low Addressing this issue will have a low level of impact on the quality/strength of our product. loe:small Small Level of Effort labels Aug 23, 2021
@LeeDr LeeDr added the v7.15.0 label Aug 23, 2021
@exalate-issue-sync exalate-issue-sync bot added impact:medium Addressing this issue will have a medium level of impact on the quality/strength of our product. loe:medium Medium Level of Effort and removed loe:small Small Level of Effort impact:low Addressing this issue will have a low level of impact on the quality/strength of our product. labels Aug 23, 2021
@tsullivan
Copy link
Member

This could be related to #110483 but I'm not so sure since this failure was identified in 7.15

@exalate-issue-sync exalate-issue-sync bot added loe:small Small Level of Effort and removed loe:medium Medium Level of Effort labels Sep 3, 2021
@liza-mae
Copy link
Contributor Author

liza-mae commented Sep 8, 2021

Version: 7.15.0
Class: X-Pack Reporting API Integration Tests1.x-pack/test/reporting_api_integration/reporting_and_security/ilm_migration_apis·ts
Stack Trace:

Error: expected 'policy-not-found' to sort of equal 'ok'
   at Assertion.assert (/var/lib/jenkins/workspace/elastic+estf-cloud-kibana-tests/JOB/xpackExtGrp1/TASK/saas_run_kibana_tests/node/ess-testing/ci/cloud/common/build/kibana/node_modules/@kbn/expect/expect.js:100:11)
   at Assertion.eql (/var/lib/jenkins/workspace/elastic+estf-cloud-kibana-tests/JOB/xpackExtGrp1/TASK/saas_run_kibana_tests/node/ess-testing/ci/cloud/common/build/kibana/node_modules/@kbn/expect/expect.js:244:8)
   at Context.<anonymous> (test/reporting_api_integration/reporting_and_security/ilm_migration_apis.ts:40:63)
   at processTicksAndRejections (internal/process/task_queues.js:95:5)
   at Object.apply (/var/lib/jenkins/workspace/elastic+estf-cloud-kibana-tests/JOB/xpackExtGrp1/TASK/saas_run_kibana_tests/node/ess-testing/ci/cloud/common/build/kibana/node_modules/@kbn/test/target_node/functional_test_runner/lib/mocha/wrap_function.js:87:16) {
 actual: 'policy-not-found',
 expected: 'ok',
 showDiff: true
}

Other test failures:

Test Report: https://internal-ci.elastic.co/view/Stack%20Tests/job/elastic+estf-cloud-kibana-tests/2305/testReport/

@tsullivan
Copy link
Member

The failures are probably coming from another test deleting this policy before this one is run. I think that could be the case based on the purpose of this test, which is to check that the default ILM policies exist.

The bug is in the test itself which should ensure the correct setup in ES. The elastic+estf-cloud-kibana-tests runner changes the order that tests run.

@liza-mae
Copy link
Contributor Author

Version: 7.15.0
Class: X-Pack Reporting API Integration Tests1.x-pack/test/reporting_api_integration/reporting_and_security/ilm_migration_apis·ts
Stack Trace:

Error: expected 'policy-not-found' to sort of equal 'ok'
   at Assertion.assert (/var/lib/jenkins/workspace/elastic+estf-cloud-kibana-tests/JOB/xpackExtGrp1/TASK/saas_run_kibana_tests/node/ess-testing/ci/cloud/common/build/kibana/node_modules/@kbn/expect/expect.js:100:11)
   at Assertion.eql (/var/lib/jenkins/workspace/elastic+estf-cloud-kibana-tests/JOB/xpackExtGrp1/TASK/saas_run_kibana_tests/node/ess-testing/ci/cloud/common/build/kibana/node_modules/@kbn/expect/expect.js:244:8)
   at Context.<anonymous> (test/reporting_api_integration/reporting_and_security/ilm_migration_apis.ts:40:63)
   at runMicrotasks (<anonymous>)
   at processTicksAndRejections (internal/process/task_queues.js:95:5)
   at Object.apply (/var/lib/jenkins/workspace/elastic+estf-cloud-kibana-tests/JOB/xpackExtGrp1/TASK/saas_run_kibana_tests/node/ess-testing/ci/cloud/common/build/kibana/node_modules/@kbn/test/target_node/functional_test_runner/lib/mocha/wrap_function.js:87:16) {
 actual: 'policy-not-found',
 expected: 'ok',
 showDiff: true
}

Other test failures:

Test Report: https://internal-ci.elastic.co/view/Stack%20Tests/job/elastic+estf-cloud-kibana-tests/2352/testReport/

@exalate-issue-sync exalate-issue-sync bot added impact:low Addressing this issue will have a low level of impact on the quality/strength of our product. impact:medium Addressing this issue will have a medium level of impact on the quality/strength of our product. and removed impact:medium Addressing this issue will have a medium level of impact on the quality/strength of our product. impact:low Addressing this issue will have a low level of impact on the quality/strength of our product. labels Sep 27, 2021
@exalate-issue-sync exalate-issue-sync bot added impact:low Addressing this issue will have a low level of impact on the quality/strength of our product. and removed impact:medium Addressing this issue will have a medium level of impact on the quality/strength of our product. labels Oct 27, 2021
@tsullivan tsullivan self-assigned this Nov 1, 2021
tsullivan added a commit to tsullivan/kibana that referenced this issue Nov 1, 2021
@tsullivan
[Reporting] Stabilize ILM test for Cloud
372f8dc 
Closes elastic#109456
@tsullivan tsullivan mentioned this issue Nov 1, 2021
Merged
@tsullivan
Copy link
Member

PR in flight: #117003

tsullivan added a commit that referenced this issue Nov 2, 2021
@tsullivan
[Reporting] Stabilize ILM test for Cloud (#117003)
2a1eaad 
Closes #109456
tsullivan added a commit to tsullivan/kibana that referenced this issue Nov 2, 2021
@tsullivan
[Reporting] Stabilize ILM test for Cloud (elastic#117003)
a0cb821 
Closes elastic#109456
tsullivan added a commit to tsullivan/kibana that referenced this issue Nov 2, 2021
@tsullivan
[Reporting] Stabilize ILM test for Cloud (elastic#117003)
2f16db8 
Closes elastic#109456
tsullivan added a commit to tsullivan/kibana that referenced this issue Nov 2, 2021
@tsullivan
[Reporting] Stabilize ILM test for Cloud (elastic#117003)
f88d1c4 
Closes elastic#109456
tsullivan added a commit that referenced this issue Nov 2, 2021
@tsullivan
[Reporting] Stabilize ILM test for Cloud (#117003) (#117212)
88fa43f 
Closes #109456
tsullivan added a commit that referenced this issue Nov 2, 2021
@tsullivan
[Reporting] Stabilize ILM test for Cloud (#117003) (#117211)
3652661 
Closes #109456
tsullivan added a commit that referenced this issue Nov 2, 2021
@tsullivan
[Reporting] Stabilize ILM test for Cloud (#117003) (#117213)
c3e0c6c 
Closes #109456
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@tsullivan tsullivan

Labels
failed-test A test failure on a tracked branch, potentially flaky-test impact:low Addressing this issue will have a low level of impact on the quality/strength of our product. loe:small Small Level of Effort test-cloud test-failure-flaky v7.15.0
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

[Reporting] Stabilize ILM test for Cloud tsullivan/kibana
6 participants
@tsullivan @cjcenizal @sophiec20 @LeeDr @elasticmachine @liza-mae