public
Description: Fast and easy task runner for Rails. Got work?
Homepage: http://www.movesonrails.com
Clone URL: git://github.com/barttenbrinke/worker_queue.git
Click here to lend your support to: worker_queue and make a donation at www.pledgie.com !
worker_queue / USAGE
100644 98 lines (78 sloc) 3.796 kb
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
As workerqueue is very flexible, there are many ways to use it.
Below we have some examples on how to could be used.
 
--------------------------------------------------------------------------------
> How can I handle file uploads that need to be processed? --------------------------------------------------------------------------------
We start by creating a ImportersController, which will handle the files.
  ruby script/generate controller importers
 
Open /app/controllers/importers_controller.rb
  Class ImportersController < ApplicationController
    # POST /importers
    def create
      if !params['upload']
        render :text => 'No file was uploaded!', :status => 400
        return
      end
    
      begin
        wq = WorkerQueue::WorkerQueueItem.new
        wq.task_group = 'file_importer'
        wq.class_name = 'Importer'
        wq.method_name = 'parse'
        wq.task_name = params['upload']['file'].original_filename
        wq.data = params['upload']['file'].read
        wq.argument_hash = { :original_filename =>
                                param['upload']['file'].original_filename
                              }
        work.skip_on_error = false
        wq.save!
 
        render :text => "OK", :status => 200
      rescue Exception => e
        render :text => "ERROR", :status => 500
      end
    end
  end
 
 
If a file is posted to /importers, it is placed into the database.
When WorkerQueue.work is run, it executes the following command:
  Importer.parse( :original_filename => 'file1.xml',
                  :data => '<xml><a>somedata</a></xml>')
 
Because of the task group, WorkerQueue will only execute 1 parse task at the
time. If files may be handled in parallel, remove the task_group line.
 
When a parse task fails, it will continue to store files in the database,
but stop processing them. If you do not want this, you can remove the
skip_after_error line.
 
 
--------------------------------------------------------------------------------
> Can I use WorkerQueue to generate reports in the background?
--------------------------------------------------------------------------------
 
Add the following code to the report controller:
 
  wq = WorkerQueue::WorkerQueueItem.new
  wq.task_group = User.current_user
  wq.task_name = params['report_type']
  wq.class_name = 'ReportGenerator'
  wq.method_name = 'generate'
  wq.argument_hash = {
                        :report_type => params['report_type'],
                        :period => params['period'],
                        :user => User.current_user
                      }
  wq.save!
 
When WorkerQueue.work is run, it executes the following command:
  ReportGenerator.generate( :report_type => :billing,
                            :period => '2008-10', :user => @bob)
 
With the task_group being the name of the user, the WorkerQueue will handle the report generation requests of user Bob
one after the other.
 
 
--------------------------------------------------------------------------------
> Can I autmatically clear unused sessions in my database?
--------------------------------------------------------------------------------
First we start by generating a sweep sessions loader.
ruby script/generate worker_queue_item_loader SweepSessions
 
Open up /lib/worker_queue/sweep_sessions_loader.rb and change it to the
following:
 
  Class SweepSessionsLoader < WorkerQueue::WorkerQueueItemLoader
    def self.prepare
      work.class_name = 'Session'
      work.method_name = 'sweep'
      work.argument_hash = '20m'
    end
  end
 
If you change cron to call load and work, instead of just work WorkerQueue will
automatically sweep your sessions for you.
 
  rake workerqueue:load_and_work