Consider supporting RabbitMQ for queuing/HA

[martinb3]

Let redis capture all logs, then any logstash server can pick them up and index them. See http://logstash.net/docs/1.4.2/inputs/redis and http://blog.lusis.org/blog/2012/01/31/load-balancing-logstash-with-redis/.

[martinb3]

Apparently the current 'best' way of doing this is with RabbitMQ as the central point for logstash to push and pull work from. There's a cookbook already for it, too: https://github.com/kennonkwok/rabbitmq.

And here's a blog post about it from the author of much of the chef work for logstash and kibana, http://blog.lusis.org/blog/2012/01/31/load-balancing-logstash-with-amqp/.