New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Aggregator plugins: Support historical data #1992

Open
sparrc opened this Issue Nov 4, 2016 · 3 comments

Comments

Projects
None yet
3 participants
@sparrc
Contributor

sparrc commented Nov 4, 2016

Currently aggregator plugins only support aggregating data with "current" timestamps.

We should try to support a single stream of historical data in the aggregator plugins, as this likely could be a common use-case when parsing a logfile.

see #1989

from that issue:

One "easy" workaround might be to create a single "historical window" which would have it's period started on the timestamp of the first "historical" metric that arrives. This would cover your use-case where you have a single stream of historical and ordered metrics arriving (ordered is the crucial point). I imagine that when dealing with historical data, this would be the most common use-case, especially when dealing with logfile parsing.

@ghost

This comment has been minimized.

Show comment
Hide comment
@ghost

ghost Apr 6, 2017

Is there [[aggregator.mean]] plugin available in telegraf ? I am searching through but couldn't find if there is any aggregator plugin other than [[aggregator.minmax]].

ghost commented Apr 6, 2017

Is there [[aggregator.mean]] plugin available in telegraf ? I am searching through but couldn't find if there is any aggregator plugin other than [[aggregator.minmax]].

@danielnelson

This comment has been minimized.

Show comment
Hide comment
@danielnelson

danielnelson Apr 6, 2017

Contributor

@ghost Not currently but there is one in the works for 1.3.0 #2167

Contributor

danielnelson commented Apr 6, 2017

@ghost Not currently but there is one in the works for 1.3.0 #2167

@bolek2000

This comment has been minimized.

Show comment
Hide comment
@bolek2000

bolek2000 Sep 28, 2017

we are testing log parsing with telegraf and plan to import older logfiles into the DB. It will be handy if we can use the aggregator for historical data too.

bolek2000 commented Sep 28, 2017

we are testing log parsing with telegraf and plan to import older logfiles into the DB. It will be handy if we can use the aggregator for historical data too.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment