Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Remove scripted metric aggregations from APM #181790

Open
smith opened this issue Apr 26, 2024 · 4 comments
Open

Remove scripted metric aggregations from APM #181790

smith opened this issue Apr 26, 2024 · 4 comments
Assignees
Labels
apm:critical-path apm:serverless apm:service-maps Service Map feature in APM apm needs-refinement A reason and acceptance criteria need to be defined for this issue Team:obs-ux-infra_services Observability Infrastructure & Services User Experience Team technical debt Improvement of the software architecture and operational architecture

Comments

@smith
Copy link
Contributor

smith commented Apr 26, 2024

The APM service map and APM critical path feature use the Scripted metrics aggregation.

See:

We've recently been in communication with the Elasticsearch team, who has notified us:

The Elasticsearch team has come to the conclusion that we need to disable the scripted metric aggregation in our serverless offering. It's a fundamentally unscalable feature and no optimizations we do could really help with the fundamental problems with it. Similar to our reasons for disabling plugins (in serverless), we can’t continue to allow users this power if we hope to be able to manage memory in serverless (or future multi-tenant environments). Not only is the memory concern a motivating factor to disabling this - but with the move of ES|QL onto serverless, our users could start using ESQL and get better performance.

We have known issues of problems stemming from this issue in serverless, for example #178892.

We could disable these features in serverless, but our long-term plans for solving this would take significant effort and time. The service map is a GA feature. Critical path is tech preview.

We should discuss with the ES team about any other available options that could let us use ship features in serverless in a scalable way.

Make a decision about how we should handle this and update the acceptance criteria.

✅ Acceptance criteria

TBD

@smith smith added technical debt Improvement of the software architecture and operational architecture apm:service-maps Service Map feature in APM apm needs-refinement A reason and acceptance criteria need to be defined for this issue Synthetics apm:critical-path Team:obs-ux-infra_services Observability Infrastructure & Services User Experience Team labels Apr 26, 2024
@elasticmachine
Copy link
Contributor

Pinging @elastic/obs-ux-infra_services-team (Team:obs-ux-infra_services)

@chrisdistasio
Copy link

related issue from the past: #75366

@smith smith added Team:obs-ux-management Observability Management User Experience Team and removed Team:obs-ux-infra_services Observability Infrastructure & Services User Experience Team labels Jul 8, 2024
@elasticmachine
Copy link
Contributor

Pinging @elastic/obs-ux-management-team (Team:obs-ux-management)

@paulb-elastic
Copy link
Contributor

@smith I think this got mis-relabelled

@paulb-elastic paulb-elastic added Team:obs-ux-infra_services Observability Infrastructure & Services User Experience Team and removed Synthetics Team:obs-ux-management Observability Management User Experience Team labels Jul 9, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
apm:critical-path apm:serverless apm:service-maps Service Map feature in APM apm needs-refinement A reason and acceptance criteria need to be defined for this issue Team:obs-ux-infra_services Observability Infrastructure & Services User Experience Team technical debt Improvement of the software architecture and operational architecture
Projects
None yet
Development

No branches or pull requests

4 participants