mutator-influxdb-line-protocol.rb #32

ssirobertreilly · 2017-06-20T19:52:34Z

when using the udp line protocol, this my handler

{
  "handlers": {
    "influxdb_udp": {
      "type": "udp",
      "socket": {
        "host": "localhost",
        "port": 8089
      },
      "mutator": "influxdb_line_protocol"
    }
  }
}

but file is named mutator-influxdb-line-protocol.rb,
in the log i get

{"timestamp":"2017-06-20T15:49:15.566043-0400","level":"error","message":"unknown handler","handler_name":"influxdb_udp"}

sensu 0.29
influxdb 1.2.4

The text was updated successfully, but these errors were encountered:

majormoses · 2017-06-24T23:10:07Z

Can you validate it is installed as an extension? extensions require a bit more setup than normal plugins: https://sensuapp.org/docs/0.29/reference/extensions.html#installing-sensu-extensions

ssirobertreilly · 2017-07-05T17:22:42Z

ok so i found it is installed correctly because of the following error
https://pastebin.com/7QiUzJwe

ssirobertreilly · 2017-07-05T17:29:06Z

gem env

RubyGems Environment:
  - RUBYGEMS VERSION: 2.6.10
  - RUBY VERSION: 2.4.1 (2017-03-22 patchlevel 111) [x86_64-linux]
  - INSTALLATION DIRECTORY: /opt/sensu/embedded/lib/ruby/gems/2.4.0
  - USER INSTALLATION DIRECTORY: /root/.gem/ruby/2.4.0
  - RUBY EXECUTABLE: /opt/sensu/embedded/bin/ruby
  - EXECUTABLE DIRECTORY: /opt/sensu/embedded/bin
  - SPEC CACHE DIRECTORY: /root/.gem/specs
  - SYSTEM CONFIGURATION DIRECTORY: /opt/sensu/embedded/etc
  - RUBYGEMS PLATFORMS:
    - ruby
    - x86_64-linux
  - GEM PATHS:
     - /opt/sensu/embedded/lib/ruby/gems/2.4.0
     - /root/.gem/ruby/2.4.0
  - GEM CONFIGURATION:
     - :update_sources => true
     - :verbose => true
     - :backtrace => false
     - :bulk_threshold => 1000
  - REMOTE SOURCES:
     - https://rubygems.org/
  - SHELL PATH:
     - /usr/local/sbin
     - /usr/local/bin
     - /usr/sbin
     - /usr/bin
     - /root/bin

majormoses · 2017-07-05T17:47:19Z

@ssirobertreilly ok thanks I will take a look in a bit when I have some time just to make sure can you validate /etc/sensu/extensions/mutator-influxdb-line-protocol.rb exists?

ssirobertreilly · 2017-07-05T18:26:08Z

ls -al /etc/sensu/extensions/mutator-influxdb-line-protocol.rb
-rwxr-xr-x 1 root root 552 Jul 5 13:09 /etc/sensu/extensions/mutator-influxdb-line-protocol.rb

ssirobertreilly · 2017-07-05T18:28:24Z

I changed the perms on it to rule that out still get long stack and this error
{"timestamp":"2017-07-05T14:27:23.333719-0400","level":"warn","message":"ignoring extension","file":"/etc/sensu/extensions/mutator-influxdb-line-protocol.rb"}

ssirobertreilly · 2017-07-05T18:43:10Z

also, when i attempt to use the influxdb check i get the same message.

ssirobertreilly · 2017-07-05T19:43:46Z

at this point it looks like it is missing the gem 'cause', yet it is installed
./gem list |grep -i cause
cause (0.1)

majormoses · 2017-07-05T19:52:45Z

Can you verify in /etc/default/sensu that you are using the embedded ruby?

ssirobertreilly · 2017-07-05T22:22:11Z

cat /etc/default/sensu
EMBEDDED_RUBY=true

majormoses · 2017-07-05T22:53:54Z

Strange, I validated that that is an indirect dependency from influxdb gem and assuming the relative path you are giving me from sensu is what I expect this should work just fine. As a side note (not saying we cant fix or work around) I see this: InfluxCommunity/influxdb-ruby@6d8918a so maybe once they release we can bump the version and then this goes away?

majormoses · 2017-07-05T23:10:06Z

Here is the running theory I have and need some validation on your end, what version are you testing?

Some things that seem related:
In 1.1.0 (should have been a major version) we removed ruby 1.9 support: eec7387.

Here is a full list of changes: 1.0.0...1.1.0.

If you are using prior to these issues makes sense to me why its broken: InfluxCommunity/influxdb-ruby#151 and InfluxCommunity/influxdb-ruby#148

ssirobertreilly · 2017-07-05T23:16:56Z

sensu 0.29
ruby 2.4.1p111 (2017-03-22 revision 58053) [x86_64-linux]
influxdb-1.2.4-1.x86_64
gems
influxdb (0.3.13)
sensu-plugins-influxdb (1.2.0)

eheydrick · 2017-07-06T00:14:39Z

In 1.1.0 (should have been a major version) we removed ruby 1.9 support: eec7387.

@majormoses That was in 1.0.0

@ssirobertreilly thanks for all the info. i'm going to try to repro your issue and see what's going on.

majormoses · 2017-07-06T00:24:48Z

my bad, github UI confuses me again...I need to stop using the UI...

eheydrick · 2017-07-06T06:32:26Z

Hey @ssirobertreilly, I got this working. Can you run through an installation and compare with the output I got. It looks like you're doing everything right but there could be something subtly different.

1. Install the plugin:

$ sudo /opt/sensu/embedded/bin/gem install sensu-plugins-influxdb -v 1.2.0 --no-rdoc --no-ri
Fetching: dentaku-2.0.9.gem (100%)
Successfully installed dentaku-2.0.9
Fetching: cause-0.1.gem (100%)
Successfully installed cause-0.1
Fetching: influxdb-0.3.13.gem (100%)
Successfully installed influxdb-0.3.13
Fetching: multi_json-1.12.1.gem (100%)
Successfully installed multi_json-1.12.1
Fetching: jsonpath-0.5.8.gem (100%)
Successfully installed jsonpath-0.5.8
Fetching: sensu-plugins-influxdb-1.2.0.gem (100%)
You can use the embedded Ruby by setting EMBEDDED_RUBY=true in /etc/default/sensu
Successfully installed sensu-plugins-influxdb-1.2.0
6 gems installed

2. Verify the `influxdb` gem loads

$ /opt/sensu/embedded/bin/irb
/opt/sensu/embedded/lib/ruby/gems/2.4.0/gems/rb-readline-0.5.3/lib/rbreadline.rb:13: warning: constant ::Fixnum is deprecated
irb(main):001:0> require 'influxdb'
=> true

3. Link the extension in the extensions dir

$ ln -s /opt/sensu/embedded/bin/mutator-influxdb-line-protocol.rb /etc/sensu/extensions/mutator-influxdb-line-protocol.rb

4. Create the handler configuration. /etc/sensu/conf.d/handlers/influxdb_udp.json:

{
  "handlers": {
    "influxdb_udp": {
      "type": "udp",
      "mutator": "influxdb_line_protocol",
      "socket": {
        "host": "influxdb.my.site",
        "port": 8089
      }
    }
  }
}

5. Configure metrics checks to use the `influxdb_udp` handler

6. Restart sensu-server

There was also a bit of setup on the influxdb end for UDP - https://github.com/influxdata/influxdb/blob/master/services/udp/README.md

ssirobertreilly · 2017-07-07T14:27:13Z

@eheydrick I will remove and re run through the setup, I did do the prework of enabling udp for influxdb.

ssirobertreilly · 2017-07-07T14:42:26Z

sudo /opt/sensu/embedded/bin/gem install sensu-plugins-influxdb -v 1.2.0 --no-rdoc --no-ri
Fetching: influxdb-0.3.13.gem (100%)
Successfully installed influxdb-0.3.13
You can use the embedded Ruby by setting EMBEDDED_RUBY=true in /etc/default/sensu
Successfully installed sensu-plugins-influxdb-1.2.0
2 gems installed

/opt/sensu/embedded/bin/irb
/opt/sensu/embedded/lib/ruby/gems/2.4.0/gems/rb-readline-0.5.3/lib/rbreadline.rb:13: warning: constant ::Fixnum is deprecated
irb(main):001:0> require 'influxdb'
=> true
irb(main):002:0>

ls -al /etc/sensu/extensions/
total 0
drwxr-xr-x 2 sensu sensu 46 Jul  7 10:30 .
drwxr-xr-x 6 sensu sensu 86 Jul  5 10:30 ..
lrwxrwxrwx 1 root  root  57 Jul  7 10:30 mutator-influxdb-line-protocol.rb -> /opt/sensu/embedded/bin/mutator-influxdb-line-protocol.rb

I was running influx udp on 8090 but for the sake of this test i changed it to 8089
Started listening on UDP: :8089 service=udp

handlers.json

{
   "influxdb_udp": {
      "type": "udp",
      "mutator": "influxdb_line_protocol",
      "socket": {
        "host": "localhost",
        "port": 8089
      }
    }
 }

still get the error complaining about "cause" not being found ... ¯\_(ツ)_/¯ . I am going to clean the system of sensu and all gems and try again, I really appreciate your help and will post an update.

ssirobertreilly · 2017-07-07T14:51:42Z

strange even though /etc/default/sensu is EMBEDDED_RUBY=true when i install plugins is says You can use the embedded Ruby by setting EMBEDDED_RUBY=true in /etc/default/sensu maybe sensu is not seeing /etc/defaylt/sensu ?

ssirobertreilly · 2017-07-07T15:04:50Z

whaaat ?
{"timestamp":"2017-07-07T11:03:26.080895-0400","level":"warn","message":"loaded extension","type":"mutator","name":"influxdb_line_protocol","description":"returns check output formatted for InfluxDB's line protocol"}

i will give it some time and validate i am getting data, must have been a bad gem dep when i installed influxdb using gem vs sensu-install. that is only thing I did differently

ssirobertreilly · 2017-07-07T15:10:09Z

womp

{"timestamp":"2017-07-07T11:08:51.020539-0400","level":"error","message":"unknown handler","handler_name":"influxdb_udp"}

ssirobertreilly · 2017-07-07T15:40:56Z

ok, I got it working once i reinstalled and got rid the ruby dep error, I must have had a typo in the hander. it works now. thanks again for your time.

eheydrick · 2017-07-07T17:07:55Z

@ssirobertreilly glad it's working for you. Regarding the EMBEDDED_RUBY message on installation - that's output whether you have it enabled already or not. We should probably stop outputting that since it's on by default since 0.21.

majormoses added the Feedback Requested label Jun 24, 2017

ssirobertreilly closed this as completed Jul 7, 2017

eheydrick mentioned this issue Jul 11, 2017

Update post install message sensu-plugins/community#32

Open

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

mutator-influxdb-line-protocol.rb #32

mutator-influxdb-line-protocol.rb #32

ssirobertreilly commented Jun 20, 2017 •

edited

majormoses commented Jun 24, 2017

ssirobertreilly commented Jul 5, 2017 •

edited

ssirobertreilly commented Jul 5, 2017 •

edited

majormoses commented Jul 5, 2017

ssirobertreilly commented Jul 5, 2017 •

edited

ssirobertreilly commented Jul 5, 2017

ssirobertreilly commented Jul 5, 2017 •

edited

ssirobertreilly commented Jul 5, 2017

majormoses commented Jul 5, 2017 •

edited

ssirobertreilly commented Jul 5, 2017 •

edited

majormoses commented Jul 5, 2017

majormoses commented Jul 5, 2017

ssirobertreilly commented Jul 5, 2017

eheydrick commented Jul 6, 2017

majormoses commented Jul 6, 2017

eheydrick commented Jul 6, 2017

ssirobertreilly commented Jul 7, 2017

ssirobertreilly commented Jul 7, 2017 •

edited

ssirobertreilly commented Jul 7, 2017

ssirobertreilly commented Jul 7, 2017 •

edited

ssirobertreilly commented Jul 7, 2017

ssirobertreilly commented Jul 7, 2017

eheydrick commented Jul 7, 2017

mutator-influxdb-line-protocol.rb #32

mutator-influxdb-line-protocol.rb #32

Comments

ssirobertreilly commented Jun 20, 2017 • edited

majormoses commented Jun 24, 2017

ssirobertreilly commented Jul 5, 2017 • edited

ssirobertreilly commented Jul 5, 2017 • edited

majormoses commented Jul 5, 2017

ssirobertreilly commented Jul 5, 2017 • edited

ssirobertreilly commented Jul 5, 2017

ssirobertreilly commented Jul 5, 2017 • edited

ssirobertreilly commented Jul 5, 2017

majormoses commented Jul 5, 2017 • edited

ssirobertreilly commented Jul 5, 2017 • edited

majormoses commented Jul 5, 2017

majormoses commented Jul 5, 2017

ssirobertreilly commented Jul 5, 2017

eheydrick commented Jul 6, 2017

majormoses commented Jul 6, 2017

eheydrick commented Jul 6, 2017

1. Install the plugin:

2. Verify the influxdb gem loads

3. Link the extension in the extensions dir

4. Create the handler configuration. /etc/sensu/conf.d/handlers/influxdb_udp.json:

5. Configure metrics checks to use the influxdb_udp handler

6. Restart sensu-server

ssirobertreilly commented Jul 7, 2017

ssirobertreilly commented Jul 7, 2017 • edited

ssirobertreilly commented Jul 7, 2017

ssirobertreilly commented Jul 7, 2017 • edited

ssirobertreilly commented Jul 7, 2017

ssirobertreilly commented Jul 7, 2017

eheydrick commented Jul 7, 2017

ssirobertreilly commented Jun 20, 2017 •

edited

ssirobertreilly commented Jul 5, 2017 •

edited

ssirobertreilly commented Jul 5, 2017 •

edited

ssirobertreilly commented Jul 5, 2017 •

edited

ssirobertreilly commented Jul 5, 2017 •

edited

majormoses commented Jul 5, 2017 •

edited

ssirobertreilly commented Jul 5, 2017 •

edited

2. Verify the `influxdb` gem loads

5. Configure metrics checks to use the `influxdb_udp` handler

ssirobertreilly commented Jul 7, 2017 •

edited

ssirobertreilly commented Jul 7, 2017 •

edited