Join GitHub today
GitHub is home to over 36 million developers working together to host and review code, manage projects, and build software together.Sign up
Support Redis cluster in input and output plugins #10
When I set an output to a node in redis-cluster(Redis 3.0.0),it can not direct to other nodes in redis-cluster automatically.Port 7000 to 7005 are used by redis cluster.
referenced this issue
May 18, 2015
Just thought I would share a little bit of an experiement with cluster support.
Heres the hacked together plugin (https://github.com/splitice/logstash-input-redis), do not even think of running this is in production. Its just some early exploration of what would be needed (and some fiddling in ruby as I have never touched the language before). After I get our log producer to support redis-cluster I'll do some more work.
Only the queue/list based method has been tested.
Please do not keep adding +1 type comments. I (we, the Logstash team) are not yet able to code for Redis Clustering at the moment. We are in the process of defining the Java Plugin mechanism and selecting suitable plugins to move to Java - this plugin is one candidate - its just not a high priority one at the moment.
@guyboertje Redis-rb is looking like it's close to adding support for Redis Cluster. I'm not sure if this is directly portable to jruby for use in the logstash Redis plugins; but it sounded promising so I thought I'd add the ref here: redis/redis-rb#716
I've been blowing off the dust, getting this https://github.com/berglh/logstash-filter-redis plugin working for use as a dynamic look-up/write-out table as an alternative to the jdbc and translate filters. I've been testing this plugin against a Redis cluster only to find the Redis client didn't seem to like writes being redirected to other Redis server instances.
I'll keep an eye on that PR and figure out if it's possible to use it for logtash Redis plugins.