Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Observability AI Assistant] Add smoke tests for serverless projects #180925

Open
miltonhultgren opened this issue Apr 16, 2024 · 1 comment
Open
Labels
Team:obs-knowledge Observability Experience Knowledge team
Milestone

Comments

@miltonhultgren
Copy link
Contributor

miltonhultgren commented Apr 16, 2024

Summary

With most of our features being available in serverless Observability projects we should have some test automation in place to make sure it doesn't break without us noticing.

Adding tests for serverless is the same as adding tests for stateful but in a different folder xpack/test_serverless/functional/test_suites/observability but these test suites cannot rely on any test tools available in stateful tests.

So we need to decide on either duplicating all of our setup and helper code or extract that code into packages and refactor the existing stateful tests to use those packages instead before adding serverless tests.

Notes

While testing ELSER (TINY_ELSER) in a Serverless project, we need to call await ml.api.assureMlStatsIndexExists(); before importing the model, not after as the other (non-serverless) ML tests show.

@miltonhultgren miltonhultgren added the Team:obs-knowledge Observability Experience Knowledge team label Apr 16, 2024
@elasticmachine
Copy link
Contributor

Pinging @elastic/obs-knowledge-team (Team:obs-knowledge)

@emma-raffenne emma-raffenne added this to the 8.15 milestone Apr 18, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Team:obs-knowledge Observability Experience Knowledge team
Projects
None yet
Development

No branches or pull requests

3 participants