aeden edited this page Sep 13, 2010 · 6 revisions
Clone this wiki locally

Refinery provides a framework for building workers that can process data in a distributed fashion using Amazon’s web services. It uses the Amazon Simple Queue Service for all messaging requirements and can integrate with S3 easily to access shared data.


Install refinery with:

sudo gem install refinery


To run the refinery processor use:

refinery -c path-to-config.yml -w path-to-workers-directory

Please note that if you do not include a configuration file Refinery will run but nothing will execute.


Find the RDocs at http://rdoc.info/projects/aeden/refinery


  • Refinery Tutorial 1 – This tutorial provides an introduction to Refinery and walks through the process of creating a worker that processes images. It covers how to use SQS to communicate with the worker and uses an HTTP callback to provide notification when the worker has completed.