This project is a Zenoss extension (ZenPack) that allows for monitoring of RabbitMQ. See the Usage section for details on what is monitored. You can watch the Monitoring RabbitMQ video for a quick introduction that covers most of the details below.
There already exist at least two community Zenpacks that provide monitoring for RabbitMQ.
- ZenPacks.dnalley.AMQPEventMonitor by David Nalley: Very different functionality than what's provided by this ZenPack. It allows you to pull messages from a defined queue and automatically turn them into Zenoss events.
- ZenPacks.community.RabbitMQ by Greg Guthe: More similar to this ZenPack in its functionality. Global metrics for queued messages and rates. It appears to require that the HTTP management API plugin be installed into your RabbitMQ instances, and that a Net-SNMP extension also written by Greg Guthe be installed.
The major differences between the ZenPacks.community.RabbitMQ and this pack are that this pack simply runs various rabbitmqctl commands over SSH both to model the node, vhosts, exchanges and queues; as well as to monitor connection, channel and per-queue metrics. So you don't need to install anything extra on your RabbitMQ server, and you get more granularity on the monitoring.
In the future this pack might be extended to also support RabbitMQ's HTTP management API plugin in addition to the SSH method.
This ZenPack has no special installation considerations. You should install the most recent version of the ZenPack for the version of Zenoss you're running.
The ZenPack can be downloaded from http://zenpacks.zenoss.com/.
To install the ZenPack you must copy the
.egg file to your Zenoss master
server and run the following command as the
zenpack --install <filename.egg>
After installing you must restart Zenoss by running the following command as
zenoss user on your master Zenoss server:
If you have distributed collectors you must also update them after installing the ZenPack.
Installing the ZenPack will add the following objects to your Zenoss system.
- Modeling Plugins
- Monitoring Templates
- RabbitMQNode in /Devices
- RabbitMQQueue in /Devices
- Event Classes
- Command Parsers
These monitoring templates should not be bound directly to any devices in the system.
To start monitoring your RabbitMQ server you will need to setup SSH access so
that your Zenoss collector server will be able to SSH into your RabbitMQ
server(s) as a user who has permission to run the
rabbitmqctl command. This
almost always means the root user. See the Using a Non-Root User section
below for instructions on allowing non-root users to run
rabbitmqctl. To do
this you need to set the following zProperties for the RabbitMQ devices or
their device class in Zenoss.
The zCommandUsername property must be set. To use public key authentication you must verify that the public portion of the key referenced in zKeyPath is installed in the ~/.ssh/authorized_keys file for the appropriate user on the RabbitMQ server. If this key has a passphrase you should set it in the zCommandPassword property. If you'd rather use password authentication than setup keys, simply put the user's password in the zCommandPassword property.
You should then add the zenoss.ssh.RabbitMQ modeler plugin to the device, or device class containing your RabbitMQ servers and remodel the device(s). This will automatically find the node, vhosts, exchanges and queues and begin monitoring them immediately for the following metrics.
- Node Values
- Status - Running or not? Generates event on failure.
- Open Connections & Channels
- Sent & Received Bytes Rate
- Sent & Received Messages Rate
- Depth of Send Queue
- Unacknowledged & Uncommitted Messages
- Queue Values
- Ready, Unacknowledged & Total Messages
- Memory Usage
There is a default threshold of 1,000,000 messages per queue. This is almost certainly an absurdly high threshold that shouldn't trip in normal systems. However, by clicking into the details of any individual queue you can set the per-queue threshold to a more reasonable value that makes sense for a given queue.
Using a Non-Root User
This ZenPack requires the ability to run the
rabbitmqctl command remotely
on your RabbitMQ server(s) using SSH. By default, the
is only allowed to be run by the root and rabbitmq users. Furthermore, this
ZenPack expects the
rabbitmqctl command be in the user's path. Normally
this is only true for the root user.
There's a very good reason for this restriction. Once a user is allowed to
rabbitmqctl command, they are able to perform the following
- Stop, Start or Reset RabbitMQ
- Control a RabbitMQ Cluster
- Close Open Connections
- Manage Users and Security
- Manage VHosts
In a nutshell, this means that any user with permission to run
rabbitmqctl can wreak total havoc on your RabbitMQ server if they had
the intent to do so.
Assuming that you've created a user named zenmonitor on your RabbitMQ servers
for monitoring purposes, you can follow these steps to allow the zenmonitor
user to run
Install the sudo package on your server.
Make sudo not require a TTY. This allows sudo to be run via ssh.
- Find a line containing
Defaults requirettyand comment it out by prefixing the line with a
:wqto save the sudo configuration.
Allow the zenmonitor user to run rabbitmqctl.
Add the following line to the bottom of the file.
zenmonitor ALL=(ALL) NOPASSWD: /usr/sbin/rabbitmqctl
:wqto save the sudo configuration.
Alias rabbitmqctl for the zenmonitor user.
Add the following lines to
shopt -s expand_aliases alias rabbitmqctl="sudo /usr/sbin/rabbitmqctl"
- (ZEN-5533) /Status/RabbitMQ for queues don't auto-clear when resolved
- (ZEN-3526) RabbitMQ: No data returned for command