Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[ES|QL] High accuracy cardinality aggregation #107231

Open
wchaparro opened this issue Apr 8, 2024 · 1 comment
Open

[ES|QL] High accuracy cardinality aggregation #107231

wchaparro opened this issue Apr 8, 2024 · 1 comment
Labels
:Analytics/ES|QL AKA ESQL >enhancement Team:Analytics Meta label for analytical engine team (ESQL/Aggs/Geo)

Comments

@wchaparro
Copy link
Contributor

Description

Use case: financial services users need to use ES (Kibana) for precise high cardinality counts (millions of accounts) for daily reporting needs. While the current cardinality aggregation works fast and supports very large datasets it is not precise.
It would be very useful if ES|QL supported a precise cardinality calculation via a new aggregation. In the past we have closed requests for this kind of functionality due to our policy that all features that we implement need to work and scale in a distributed environment. ES|QL opens new opportunities for potentially solving this because We can support long running queries via async_search and we have a way to store intermediate results via ES|QL which means the memory risk is much lower.

See elastic/kibana#179934, related: #60149

@elasticsearchmachine elasticsearchmachine added the Team:Analytics Meta label for analytical engine team (ESQL/Aggs/Geo) label Apr 8, 2024
@elasticsearchmachine
Copy link
Collaborator

Pinging @elastic/es-analytical-engine (Team:Analytics)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
:Analytics/ES|QL AKA ESQL >enhancement Team:Analytics Meta label for analytical engine team (ESQL/Aggs/Geo)
Projects
None yet
Development

No branches or pull requests

2 participants