Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Vendor the Ruby binding #20

Merged
merged 1 commit into from Sep 7, 2012
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Jump to
Jump to file
Failed to load files.
Diff view
Diff view
4 changes: 4 additions & 0 deletions bindings/ruby/CHANGELOG.rdoc
@@ -0,0 +1,4 @@
= Changelog

== 0.1 ( September 06, 2012)
* Initial public release
5 changes: 5 additions & 0 deletions bindings/ruby/Gemfile
@@ -0,0 +1,5 @@
source :rubygems

gemspec

gem 'rake'
19 changes: 19 additions & 0 deletions bindings/ruby/Gemfile.lock
@@ -0,0 +1,19 @@
PATH
remote: .
specs:
majordomo (0.1)

GEM
remote: http://rubygems.org/
specs:
rake (0.9.2.2)
rake-compiler (0.8.1)
rake

PLATFORMS
ruby

DEPENDENCIES
majordomo!
rake
rake-compiler (~> 0.8.0)
158 changes: 158 additions & 0 deletions bindings/ruby/README.rdoc
@@ -0,0 +1,158 @@
= Majordomo - A Ruby binding for libmdp (Majordomo implementation in C)

(c) 2012 Lourens Naudé (methodmissing), with README guidance and content from the Majordomo Protocol 0.2 spec (http://rfc.zeromq.org/spec:18)

http://github.com/methodmissing/majordomo_ruby

== What is Majordomo ?

The Majordomo Protocol (MDP) defines a reliable service-oriented request-reply dialog between :

* a set of clients
* a broker
* a set of workers

MDP covers presence, heartbeating and service-oriented request-reply processing. This extension implements MDP version 0.2, which adds support for multiple replies for a single request (http://rfc.zeromq.org/spec:18).

== Why should I use it ?

The goals of MDP are to:

* Allow requests to be routed to workers on the basis of abstract service names.
* Allow both peers to detect disconnection of the other peer, through the use of heartbeating.
* Allow the broker to implement a "least recently used" pattern for task distribution to workers for a given service.
* Allow the broker to recover from dead or disconnected workers by resending requests to other workers.

== What are clients and workers ?

Clients are applications that issue requests. Workers process them and are idempotent, thus it is safe to execute the same request more than once. Workers will handle at most one request a time, and will issue exactly one reply for each successful request.

== Reliability

The Majordomo pattern is designed to extend the basic ØMQ request-reply pattern with the ability to detect and recover from a specific set of failures:

* Worker applications which crash, run too slowly, or freeze.
* Worker applications that are disconnected from the network (temporarily or permanently).
* Client applications that are temporarily disconnected from the network.
* A queue broker that crashes and is restarted.
* A queue broker that suffers a permanent failure.
* Requests or replies that are lost due to any of these failures.

== Scalability and Performance

Majordomo is designed to be scalable to large numbers (thousands) of workers and clients, limited only by system resources on the broker. Partitioning of workers by service allows for multiple applications to share the same broker infrastructure.

== Usage

==== Start the broker

Lourenss-MacBook-Air:src lourens$ mdp_broker -v
12-09-06 02:05:06 I: MDP broker/0.2.0 is active at tcp://*:5555

==== Start a worker

2.0.0dev :001 > require 'majordomo'
=> true
2.0.0dev :002 > w = Majordomo::Worker.new("tcp://localhost:5555", "service", true)
12-09-06 02:02:45 I: connecting to broker at tcp://localhost:5555...
12-09-06 02:02:45 I: sending READY to broker
--------------------------------------
[000]
[006] MDPW0X
[001] 01
[007] service
=> #<Majordomo::Worker:0x007fc533927840>
2.0.0dev :003 > w.recv
12-09-06 02:03:06 I: received message from broker:
--------------------------------------
[000]
[006] MDPW0X
[001] 04
12-09-06 02:03:06 I: sending HEARTBEAT to broker
--------------------------------------
[000]
[006] MDPW0X
[001] 04
12-09-06 02:03:06 I: received message from broker:
--------------------------------------
[000]
[006] MDPW0X
[001] 04
12-09-06 02:03:06 I: received message from broker:
--------------------------------------
[000]
[006] MDPW0X
[001] 04
12-09-06 02:03:06 I: received message from broker:
--------------------------------------
[000]
[006] MDPW0X
[001] 05
12-09-06 02:03:06 I: connecting to broker at tcp://localhost:5555...
12-09-06 02:03:06 I: sending READY to broker
--------------------------------------
[000]
[006] MDPW0X
[001] 01
[007] service

==== Start a client

2.0.0dev :001 > require 'majordomo'
=> true
2.0.0dev :002 > c = Majordomo::Client.new("tcp://localhost:5555", true)
12-09-06 02:00:11 I: connecting to broker at tcp://localhost:5555...
=> #<Majordomo::Client:0x007ffc738d71c0>
2.0.0dev :003 > c.send("service", "message")
12-09-06 02:00:26 I: send request to 'service' service:
--------------------------------------
[000]
[006] MDPC0X
[007] service
[007] message
=> true

See the test/ folder for further use cases - runnable examples forthcoming.

== Resources

* ZeroMQ - http://www.zeromq.org/community
* CZMQ - http://czmq.zeromq.org/
* The Majordomo pattern - http://zguide.zeromq.org/page:all#Service-Oriented-Reliable-Queuing-Majordomo-Pattern
* Majordomo protocol - http://rfc.zeromq.org/spec:7
* Majordomo protocol 0.2 - http://rfc.zeromq.org/spec:18

== Requirements

* A POSIX compliant OS, known to work well on Linux, BSD variants and Mac OS X
* Ruby MRI 1.8, 1.9, 2.x or Rubinius (JRuby capi support is deprecated)
* A C compiler
* ZeroMQ - http://www.zeromq.org/intro:get-the-software
* CZMQ - http://czmq.zeromq.org/
* libmdp - https://github.com/zeromq/majordomo

== Installation

Rubygems installation

gem install mdp

Building from source

git clone git@github.com:methodmissing/majordomo_ruby
rake

Running tests

rake test

OS X notes:

If you are installing ZeroMQ and CZMQ on a new Mac ensure you have libtool and autoconf installed.
You can get those with the brew packaging system:

brew install libtool autoconf automake

== Contact, feedback and bugs

Please log bugs and suggestions at https://github.com/methodmissing/majordomo_ruby/issues
47 changes: 47 additions & 0 deletions bindings/ruby/Rakefile
@@ -0,0 +1,47 @@
# encoding: utf-8

require 'rubygems' unless defined?(Gem)
require 'rake' unless defined?(Rake)

# Prefer compiled Rubinius bytecode in .rbx/
ENV["RBXOPT"] = "-Xrbc.db"

require 'rake/extensiontask'
require 'rake/testtask'

begin
require 'rdoc/task'
rescue LoadError # fallback to older 1.8.7 rubies
require 'rake/rdoctask'
end

gemspec = eval(IO.read('mdp.gemspec'))

Gem::PackageTask.new(gemspec) do |pkg|
end

Rake::ExtensionTask.new('majordomo', gemspec) do |ext|
ext.name = 'majordomo_ext'
ext.ext_dir = 'ext/majordomo'

CLEAN.include 'lib/**/majordomo_ext.*'
end

desc 'Run Majordomo tests'
Rake::TestTask.new(:test) do |t|
t.test_files = Dir.glob("test/**/test_*.rb")
t.verbose = true
t.warning = true
end

Rake::RDocTask.new do |rd|
files = FileList["README.rdoc", "ext/majordomo/*.c"]
rd.title = "A Ruby binding for libmd (Majordomo implementation in C)"
rd.main = "README.rdoc"
rd.rdoc_dir = "doc"
rd.options << "--promiscuous"
rd.rdoc_files.include(files)
end

task :test => :compile
task :default => :test