New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

New Input Plugin: CloudWatch #3437

Closed
jrgns opened this Issue Jun 14, 2015 · 11 comments

Comments

Projects
None yet
10 participants
@jrgns

jrgns commented Jun 14, 2015

I created a CloudWatch plugin to pull AWS metrics into Logstash: https://github.com/EagerELK/logstash-input-cloudwatch

A sample config:

input {
  cloudwatch {
    # Required Parameters
    tag_name => "Monitored" # Use tag_name and tag_values to track multiple instances
    tag_values => "Yes"
    instances => [ 'i-1234567' ] # Alternatively hardcode instance ID's to track
    region => "eu-west-1"
    # Optional Parameters
    interval => 900 # How often to pull the metrics. Defaults to 900 (15 minutes)
    period => 60 # The granularity of the returned datapoints. Defaults to 60
    namespace => 'AWS/EC2' # The type of metrics to pull (EC2, EBS or SNS). Defaults to EC2
    metrics => [ 'CPUUtilization' ] # The metrics to gather
    statistics => [ ' Minimum', 'Maximum' ] # The statistics to gather for each metric
  }
}

The code is fully documented, but it needs tests.

Guidance on if this is something useful and on what tests to add are welcome.

@tbragin tbragin added the new plugin label Jun 18, 2015

@madAndroid

This comment has been minimized.

madAndroid commented Jul 2, 2015

This is something we would find very useful 👍

@jaimalchohan

This comment has been minimized.

jaimalchohan commented Jul 6, 2015

+1

@arabold

This comment has been minimized.

arabold commented Jul 26, 2015

I'm using this in production now and am very happy with it. Together with the CloudWatch Monitoring Script from Amazon, this turns Logstash into a server monitor which makes it incredibly easy to correlate server logs and other relevant events with metrics such as CPU and memory usage. So definitely a +1 on adding this to the official repository.

@theherk

This comment has been minimized.

theherk commented Oct 8, 2015

I'm going go use this, but it would be great if it were added to the official plugins list. +1

@jrgns

This comment has been minimized.

jrgns commented Dec 4, 2015

I've updated the plugin. See this post for more info: http://blog.eagerelk.com/logstash-cloudwatch-input-plugin-updated/

@veewee

This comment has been minimized.

veewee commented Dec 21, 2015

+1

1 similar comment
@AndreasStokholm

This comment has been minimized.

AndreasStokholm commented Jan 24, 2016

+1

@jrgns

This comment has been minimized.

jrgns commented Jan 24, 2016

Hi guys. Thanx for the support so far. Elastic has contact me about adding this to the official repo. Hopefully this will happen in the not too distant future 😄

@suyograo

This comment has been minimized.

Member

suyograo commented Jan 25, 2016

@jrgns thanks for your patience. I created a new repo in logstash-plugins org: https://github.com/logstash-plugins/logstash-input-cloudwatch

Can you please create an initial PR there with your code? We'll get it reviewed, and published.

@jrgns

This comment has been minimized.

jrgns commented Jan 25, 2016

@suyograo

This comment has been minimized.

Member

suyograo commented Feb 9, 2016

v1.1.0 has been published and moved to https://github.com/logstash-plugins/logstash-input-cloudwatch. Thanks a ton @jrgns

@suyograo suyograo closed this Feb 9, 2016

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment