Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add "histogram" to the possible aggregations of a Transform #81917

Open
romainneutron opened this issue Dec 20, 2021 · 2 comments
Open

Add "histogram" to the possible aggregations of a Transform #81917

romainneutron opened this issue Dec 20, 2021 · 2 comments
Labels
>enhancement :ml/Transform Transform Team:ML Meta label for the ML team

Comments

@romainneutron
Copy link

Hello,

Given the Transform API documentation, we can not yet create a transform using Histogram as a pivot.aggregations.
This would be quite useful to store a Histogram value using histogram field type as a result of a transform.

Why?

When aggregating data, we can already compute percentiles for each result of the transform. However, If we need to compute a percentile aggregation on multiple lines of the transform-aggregated data, it's impossible because we need the data distribution to compute a percentile. Histograms are perfect for that.

Adding Histogram Transform aggregation would allow this using the value of the histogram field type.

Thanks

@romainneutron romainneutron added >enhancement needs:triage Requires assignment of a team area label labels Dec 20, 2021
@astefan astefan added the :ml/Transform Transform label Dec 22, 2021
@elasticmachine elasticmachine added the Team:ML Meta label for the ML team label Dec 22, 2021
@elasticmachine
Copy link
Collaborator

Pinging @elastic/ml-core (Team:ML)

@astefan astefan removed the needs:triage Requires assignment of a team area label label Dec 22, 2021
@hendrikmuhs
Copy link
Contributor

Thanks for the feedback. I agree the histogram field type would be the way to go as output of a histogram aggregation in a transform, because for ordinary mappings we need to know the buckets in advance.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
>enhancement :ml/Transform Transform Team:ML Meta label for the ML team
Projects
None yet
Development

No branches or pull requests

4 participants