New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support bucket script pipeline aggregations #5968

Closed
obernal opened this Issue Sep 5, 2016 · 48 comments

Comments

Projects
None yet
@obernal
Copy link

obernal commented Sep 5, 2016

It would be great to be able to do custom aggregations using scripts. This is achieved through bucket script aggregations. For example we need to be able to do something like this:

screen shot 2016-08-27 at 4 51 25 pm

Where I can take the difference between two fields and plot it or show it in a table panel.

For reference: https://www.elastic.co/guide/en/elasticsearch/reference/current/search-aggregations-pipeline-bucket-script-aggregation.html

@jisaitua

This comment has been minimized.

Copy link

jisaitua commented Sep 9, 2016

+1

1 similar comment
@mekalz

This comment has been minimized.

Copy link
Contributor

mekalz commented Sep 11, 2016

+1

@obernal

This comment has been minimized.

Copy link
Author

obernal commented Sep 11, 2016

There's a PR I submitted, waiting to be reviewed for some time now. #5918 Not sure why there hasn't been any response yet. Hopefully the maintainers will get to it soon.

@id3a

This comment has been minimized.

Copy link

id3a commented Feb 1, 2017

We need support to this type of pipeline aggregations asap!
Is this feature on the roadmap?

@jisaitua

This comment has been minimized.

Copy link

jisaitua commented Mar 1, 2017

This is a much needed feature for elasticsearch. What is needed to get #5918 accepted?

@markuslindberg

This comment has been minimized.

Copy link

markuslindberg commented Apr 28, 2017

This is exactly what I'm looking for! A much needed feature for the elasticsearch datasource.

@skywalker-gk

This comment has been minimized.

Copy link

skywalker-gk commented Jul 7, 2017

+1.
This is a much needed feature for elasticsearch.

@bela0av

This comment has been minimized.

Copy link

bela0av commented Sep 18, 2017

+1

3 similar comments
@mgatien

This comment has been minimized.

Copy link

mgatien commented Dec 7, 2017

+1

@mmatson

This comment has been minimized.

Copy link

mmatson commented Dec 31, 2017

+1

@vnikitov

This comment has been minimized.

Copy link

vnikitov commented Jan 24, 2018

+1

@marcusianlevine

This comment has been minimized.

Copy link

marcusianlevine commented Jan 30, 2018

+1 please re-open the PR #5918 !!! this would be great for latency calculation, current workaround requires additional epoch time fields...

@PeterWeiler

This comment has been minimized.

Copy link

PeterWeiler commented Feb 5, 2018

+1

Without an ability to directly input queries, as is possible with the "toggle edit mode" of the InfluxDB data source, there isn't a way to make this work in Grafana.

@erouvin

This comment has been minimized.

Copy link

erouvin commented Feb 7, 2018

+1

Definitely needed for Singlestat panel to display percentage combining several fields.

@Toyto

This comment has been minimized.

Copy link

Toyto commented Mar 5, 2018

+1

6 similar comments
@jkristensen

This comment has been minimized.

Copy link

jkristensen commented Mar 5, 2018

+1

@nielslerches

This comment has been minimized.

Copy link

nielslerches commented Mar 5, 2018

+1

@Emillos

This comment has been minimized.

Copy link

Emillos commented Mar 5, 2018

+1

@fjgal

This comment has been minimized.

Copy link

fjgal commented Mar 5, 2018

+1

@grantjosh

This comment has been minimized.

Copy link

grantjosh commented Mar 9, 2018

+1

@usrlocalsbin

This comment has been minimized.

Copy link

usrlocalsbin commented Mar 9, 2018

+1

@konradkonrad

This comment has been minimized.

Copy link

konradkonrad commented Mar 14, 2018

I definitely have the need for custom aggregations -- ideally as free form json.
I want to aggregate based on a nested filter, i.e.

nested -> filter -> TERMS -> reverse_nested -> nested -> filter -> STATS

I don't see how this could be supported just through forms...

@bartebor

This comment has been minimized.

Copy link

bartebor commented Mar 16, 2018

This is very useful feature. We are drawing numerous ratios in kubernetes clusters, for example CPU usage to CPU request. ElasticSearch support in grafana lacks free-form queries like i.e InfluxDB limiting available options drastically. This FR gets the job done for most cases and I personally think it should be merged in (alternatively there could be a possibility of enabling raw ES queries for graphs/stats).

@Jordiherrero

This comment has been minimized.

Copy link

Jordiherrero commented Mar 21, 2018

+1

@tamsl

This comment has been minimized.

Copy link

tamsl commented Apr 12, 2018

I need this too, would be great!

@a3mar

This comment has been minimized.

Copy link

a3mar commented Jul 2, 2018

+1

@mailo84

This comment has been minimized.

Copy link

mailo84 commented Jul 2, 2018

+1 plz!

@zhka

This comment has been minimized.

Copy link

zhka commented Jul 2, 2018

+1

1 similar comment
@sijver

This comment has been minimized.

Copy link

sijver commented Jul 5, 2018

+1

@apobbati

This comment has been minimized.

Copy link

apobbati commented Jul 9, 2018

Has there been any effort on getting the PR merged?

@Haurau

This comment has been minimized.

Copy link

Haurau commented Aug 18, 2018

+1

@marefr marefr added this to the 5.4 milestone Aug 28, 2018

@unvaluedcustomer

This comment has been minimized.

Copy link

unvaluedcustomer commented Sep 19, 2018

+1

@DvirM

This comment has been minimized.

Copy link

DvirM commented Oct 11, 2018

+1 - being able to sum 2 fields is something we definitely can use. thanks!

@melrom

This comment has been minimized.

Copy link

melrom commented Oct 22, 2018

+1 - we need this SO MUCH.

@saadsarfrazz

This comment has been minimized.

Copy link

saadsarfrazz commented Oct 31, 2018

+1

@saadsarfrazz

This comment has been minimized.

Copy link

saadsarfrazz commented Nov 2, 2018

+1 - being able to sum 2 fields is something we definitely can use. thanks!

This could be useful if it is not pipeline aggregation I think.
https://community.grafana.com/t/basic-elastic-search-query/1543/18

@pathikmehta

This comment has been minimized.

Copy link

pathikmehta commented Nov 6, 2018

+1 - It can a very useful feature.

@faxm0dem

This comment has been minimized.

Copy link

faxm0dem commented Nov 9, 2018

please implement this!

@bergquist bergquist modified the milestones: 5.4-beta1, 5.5 Nov 12, 2018

@yanivroz

This comment has been minimized.

Copy link

yanivroz commented Dec 5, 2018

+1

2 similar comments
@xuxiaohu

This comment has been minimized.

Copy link

xuxiaohu commented Dec 12, 2018

+1

@bmfmsd

This comment has been minimized.

Copy link

bmfmsd commented Dec 18, 2018

+1

@marefr marefr modified the milestones: 5.5, 6.0 Dec 20, 2018

@marefr marefr changed the title Support for Bucket Script Pipeline aggregations (ElasticSearch) Support Bucket Script Pipeline aggregations Dec 20, 2018

@marefr marefr changed the title Support Bucket Script Pipeline aggregations Support bucket script pipeline aggregations Dec 20, 2018

@marefr marefr modified the milestones: 6.0, 6.0-beta1 Jan 14, 2019

marefr added a commit that referenced this issue Jan 14, 2019

ryantxu added a commit to NatelEnergy/grafana that referenced this issue Jan 14, 2019

Merge remote-tracking branch 'grafana/master'
* grafana/master:
  changelog
  Fixed Syntax for folder permission's JSON
  changelog: add notes about closing grafana#5968
  Moved panel editing components to it's own folder
  removed old unused angular stuff, rename
  Move panel width/height calculation to PanelChrome
  Updated singlestat to use new value format function syntax and capitalized unit categories, fixes grafana#12871
  build: build specific enterprise version when releasing.
  Fixed Gauge being cropped when resizing panel
  units: adds back velocity units. Fixes grafana#14851
  Fix bug tls renegociation problem in Notification channel (webhook) grafana#14800
  Fix Error 500 on unexisting /api/alert-notification/<id>
  updated snapshot
  Minor renames and other fixes
  panel option section moved to grafana-ui and new panel option grid component
  elasticsearch: support bucket script pipeline aggregations
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment