-
Notifications
You must be signed in to change notification settings - Fork 34
Description
Currently in the extract/aggregate stage we group entries by some field and apply an aggregate function on the group.
We support sum, min, max, avg and count
But, there are cases where we are interested in grouping entries without applying the aggregate function (nop - no operation).
We want to retain the original value of the entries.
One example for such case is histograms in prometheus. We need the original values so we could put it in the right buckets.
Actually, counters in promethues needs this too because their API accepts only deltas and not the final count/sum.
The current implementation saves the original value of the entries in the recentRawValues field.
flowlogs-pipeline/pkg/pipeline/extract/aggregate/aggregate.go
Lines 176 to 177 in cbf2c93
| "value": fmt.Sprintf("%f", group.value), | |
| "recentRawValues": group.RecentRawValues, |
Adding nop will allow us to merge the recentRawValues field into the value field.