Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Cases] Wait for the configuration page to appear before starting the tests #168465

Merged
merged 9 commits into from
Oct 14, 2023

Conversation

cnasikas
Copy link
Member

@cnasikas cnasikas commented Oct 10, 2023

Summary

This PR intends (I hope for the last time 😄 ) to fix the tests on the configuration page. Seldomly, the navigation is not complete, and the tests start running before navigating to the configuration page.

Fixes: #166469, #167869
Flaky test runner: https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/3463, https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/3484, https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/3496

Checklist

Delete any items that are not applicable to this PR.

For maintainers

@cnasikas cnasikas added release_note:skip Skip the PR/issue when compiling release notes Team:ResponseOps Label for the ResponseOps team (formerly the Cases and Alerting teams) Feature:Cases Cases feature labels Oct 10, 2023
@cnasikas
Copy link
Member Author

@elasticmachine merge upstream

@cnasikas cnasikas changed the title [Cases] Unskip flaky tests for the configuration page in Serverless [Cases] Wait for the configuration page to appear before starting the tests Oct 12, 2023
@cnasikas cnasikas marked this pull request as ready for review October 13, 2023 07:40
@cnasikas cnasikas requested a review from a team as a code owner October 13, 2023 07:40
@elasticmachine
Copy link
Contributor

Pinging @elastic/response-ops (Team:ResponseOps)

@elasticmachine
Copy link
Contributor

Pinging @elastic/response-ops-cases (Feature:Cases)

Copy link
Member

@pheyos pheyos left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@cnasikas
Copy link
Member Author

@elasticmachine merge upstream

@@ -26,8 +26,18 @@ export default ({ getPageObject, getService }: FtrProviderContext) => {
await svlCommonPage.login();
await svlSecNavigation.navigateToLandingPage();
await testSubjects.click('solutionSideNavItemLink-cases');
await header.waitUntilLoadingHasFinished();

await retry.waitFor('configure-case-button exist', async () => {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

maybe I'm confused but isn't this the same as
await retry.waitFor('configure-case-button exist', testSubjects.exists('configure-case-button'));
?

Copy link
Member Author

@cnasikas cnasikas Oct 13, 2023

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Probably yes 🙂. I never thought about it tbh. I will keep it in mind for the next time. Thanks!

@kibana-ci
Copy link
Collaborator

💛 Build succeeded, but was flaky

Failed CI Steps

Test Failures

  • [job] [logs] FTR Configs #37 / serverless observability UI Observability ML Anomaly detection jobs list "after all" hook in "Anomaly detection jobs list"
  • [job] [logs] FTR Configs #30 / Uptime app with real-world data overview page pagination is cleared when filter criteria changes

Metrics [docs]

✅ unchanged

History

To update your PR or re-run it, just comment with:
@elasticmachine merge upstream

@cnasikas cnasikas merged commit dea2b03 into elastic:main Oct 14, 2023
36 checks passed
@cnasikas cnasikas deleted the fix_conf_flaky_test_2 branch October 14, 2023 07:54
@kibanamachine kibanamachine added the backport:skip This commit does not require backporting label Oct 14, 2023
dej611 pushed a commit to dej611/kibana that referenced this pull request Oct 17, 2023
… tests (elastic#168465)

Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>
benakansara pushed a commit to benakansara/kibana that referenced this pull request Oct 22, 2023
… tests (elastic#168465)

Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>
benakansara pushed a commit to benakansara/kibana that referenced this pull request Oct 22, 2023
… tests (elastic#168465)

Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
backport:skip This commit does not require backporting Feature:Cases Cases feature release_note:skip Skip the PR/issue when compiling release notes Team:ResponseOps Label for the ResponseOps team (formerly the Cases and Alerting teams) v8.12.0
Projects
None yet
6 participants