Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Failing test: Detection Engine - Rule Execution Logic Integration Tests - ESS Env - Trial License.x-pack/test/security_solution_api_integration/test_suites/detections_response/detection_engine/rule_execution_logic/trial_license_complete_tier/execution_logic/eql·ts - Rule execution logic API Detection Engine - Execution logic @ess @serverless EQL type rules classifies verification_exception errors as user errors #180641

Open
kibanamachine opened this issue Apr 11, 2024 · 3 comments
Open

Failing test: Detection Engine - Rule Execution Logic Integration Tests - ESS Env - Trial License.x-pack/test/security_solution_api_integration/test_suites/detections_response/detection_engine/rule_execution_logic/trial_license_complete_tier/execution_logic/eql·ts - Rule execution logic API Detection Engine - Execution logic @ess @serverless EQL type rules classifies verification_exception errors as user errors #180641

kibanamachine opened this issue Apr 11, 2024 · 3 comments
Assignees
@marshallmain
Labels
blocker failed-test A test failure on a tracked branch, potentially flaky-test skipped-test Team:Detection Engine Security Solution Detection Engine Area v8.14.0

Comments

@kibanamachine
Copy link
Contributor

kibanamachine commented Apr 11, 2024 •
edited

A test failed on a tracked branch

Error: expected 0 to sort of equal 1
    at Assertion.assert (expect.js:100:11)
    at Assertion.eql (expect.js:244:8)
    at Context.<anonymous> (eql.ts:240:9)
    at processTicksAndRejections (node:internal/process/task_queues:95:5)
    at Object.apply (wrap_function.js:73:16) {
  actual: '0',
  expected: '1',
  showDiff: true
}

First failure: CI Build - main
@kibanamachine kibanamachine added the failed-test A test failure on a tracked branch, potentially flaky-test label Apr 11, 2024
@botelastic botelastic bot added the needs-team Issues missing a team label label Apr 11, 2024
@kibanamachine kibanamachine added the Team:Detection Engine Security Solution Detection Engine Area label Apr 11, 2024
@elasticmachine
Copy link
Contributor

Pinging @elastic/security-detection-engine (Team:Detection Engine)

@botelastic botelastic bot removed the needs-team Issues missing a team label label Apr 11, 2024
@marshallmain marshallmain mentioned this issue Apr 12, 2024
Merged
marshallmain added a commit that referenced this issue Apr 15, 2024
@marshallmain @kibanamachine
[Security Solution] Add retry to getMetrics to reduce flake (#180704)
59055c6 
## Summary

API integration tests added in #180094 fail occasionally on main, but
pass consistently locally and in the flaky test runner. This PR adds a
retry to the `getMetrics` request in hopes of removing the flakiness.

Flake issues:
#180530
#180641

---------

Co-authored-by: kibanamachine <42973632+kibanamachine@users.noreply.github.com>
@kibanamachine
Copy link
Contributor Author

New failure: CI Build - main

mistic added a commit that referenced this issue Apr 16, 2024
@mistic
skip flaky suite (#180641)
b773680
@mistic
Copy link
Member

mistic commented Apr 16, 2024

Skipped.

main: b773680

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@marshallmain marshallmain

Labels
blocker failed-test A test failure on a tracked branch, potentially flaky-test skipped-test Team:Detection Engine Security Solution Detection Engine Area v8.14.0
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
4 participants
@mistic @elasticmachine @kibanamachine @marshallmain