New Input Plugin: CloudWatch

[jrgns]

I created a CloudWatch plugin to pull AWS metrics into Logstash: https://github.com/EagerELK/logstash-input-cloudwatch

A sample config:

input {
  cloudwatch {
    # Required Parameters
    tag_name => "Monitored" # Use tag_name and tag_values to track multiple instances
    tag_values => "Yes"
    instances => [ 'i-1234567' ] # Alternatively hardcode instance ID's to track
    region => "eu-west-1"
    # Optional Parameters
    interval => 900 # How often to pull the metrics. Defaults to 900 (15 minutes)
    period => 60 # The granularity of the returned datapoints. Defaults to 60
    namespace => 'AWS/EC2' # The type of metrics to pull (EC2, EBS or SNS). Defaults to EC2
    metrics => [ 'CPUUtilization' ] # The metrics to gather
    statistics => [ ' Minimum', 'Maximum' ] # The statistics to gather for each metric
  }
}

The code is fully documented, but it needs tests.

Guidance on if this is something useful and on what tests to add are welcome.

[madAndroid]

This is something we would find very useful 👍

[jaimalchohan]

+1

[arabold]

I'm using this in production now and am very happy with it. Together with the CloudWatch Monitoring Script from Amazon, this turns Logstash into a server monitor which makes it incredibly easy to correlate server logs and other relevant events with metrics such as CPU and memory usage. So definitely a +1 on adding this to the official repository.

[theherk]

I'm going go use this, but it would be great if it were added to the official plugins list. +1

[jrgns]

I've updated the plugin. See this post for more info: http://blog.eagerelk.com/logstash-cloudwatch-input-plugin-updated/

[veewee]

+1

[AndreasStokholm]

+1

[jrgns]

Hi guys. Thanx for the support so far. Elastic has contact me about adding this to the official repo. Hopefully this will happen in the not too distant future 😄

[suyograo]

@jrgns thanks for your patience. I created a new repo in logstash-plugins org: https://github.com/logstash-plugins/logstash-input-cloudwatch

Can you please create an initial PR there with your code? We'll get it reviewed, and published.

[jrgns]

No worries 😄

Done: logstash-plugins/logstash-input-cloudwatch#1

[suyograo]

v1.1.0 has been published and moved to https://github.com/logstash-plugins/logstash-input-cloudwatch. Thanks a ton @jrgns