Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add functional tests for creating alerts / SLOs #178744

Closed

Conversation

thomheymann
Copy link
Contributor

@thomheymann thomheymann commented Mar 14, 2024

Summary

Functional tests for #175777 and #176024

@apmmachine
Copy link
Contributor

🤖 GitHub comments

Expand to view the GitHub comments

Just comment with:

  • /oblt-deploy : Deploy a Kibana instance using the Observability test environments.
  • /oblt-deploy-serverless : Deploy a serverless Kibana instance using the Observability test environments.
  • run elasticsearch-ci/docs : Re-trigger the docs validation. (use unformatted text in the comment!)

@thomheymann thomheymann added release_note:skip Skip the PR/issue when compiling release notes Team:obs-ux-logs Observability Logs User Experience Team labels Mar 14, 2024
@thomheymann thomheymann marked this pull request as ready for review March 14, 2024 16:38
@thomheymann thomheymann requested a review from a team as a code owner March 14, 2024 16:38
@elasticmachine
Copy link
Contributor

Pinging @elastic/obs-ux-logs-team (Team:obs-ux-logs)

@tonyghiani
Copy link
Contributor

Although is almost duplicated code, could you also add the same tests for the serverless test suite please?

@@ -30,7 +30,8 @@ export default function ({ getService, getPageObjects }: FtrProviderContext) {
expect(toastTitle).toMatch(/created/i);
});

it('should create SLO successfully', async () => {
// Flaky test
it.skip('should create SLO successfully', async () => {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

question: why is this test marked as flaky? Does it make sense to keep it implemented if will be disabled from the beginning?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

There's an intermittent issue where the good query field does not get populated which stops the form from getting submitted

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is there anything we can do about this case? Having a flaky test disabled since the beginning doesn't bring additional value, you may consider directly removing it if it's not possible to stabilize it.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Keeping skipped tests preserves their intention, a link to the original PR and failing builds in a very visible way directly in the codebase so it can be picked up again in the future. I think there's value in that.

@kibana-ci
Copy link
Collaborator

💚 Build Succeeded

Metrics [docs]

Async chunks

Total size of all lazy-loaded chunks that will be downloaded as the user navigates the app

id before after diff
observabilityLogsExplorer 153.0KB 153.2KB +191.0B

History

To update your PR or re-run it, just comment with:
@elasticmachine merge upstream

@tonyghiani
Copy link
Contributor

Is there any reason for Remove serverless test change back?

@thomheymann
Copy link
Contributor Author

Is there any reason for Remove serverless test change back?

Serverless does not expose internal APIs so there is no programmatic way of deleting the created rules.

Functional tests are not isolated so leaving these rules in breaks other tests.

Closing this PR to focus on more pressing issues.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
release_note:skip Skip the PR/issue when compiling release notes Team:obs-ux-logs Observability Logs User Experience Team
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

5 participants