Skip to content

HTTPS clone URL

Subversion checkout URL

You can clone with
or
.
Download ZIP
Newer
Older
100644 93 lines (63 sloc) 4.083 kB
6f66c10 @jashkenas Version 0.1.0 -- first real release
jashkenas authored
1 =
6df8e48 @jashkenas mo README
jashkenas authored
2 _ _
3 ( ` )_
4 ( ) `)
5 (_ (_ . _) _)
6 _
7 ( )
8 _ . ( ` ) . )
9 ( _ )_ (_, _( ,_)_)
10 (_ _(_ ,)
11
12 _ _ ___ _ _ ___ _
13 ( ` )_ / __| |___ _ _ __| |/ __|_ _ _____ __ ____| |
14 ( ) `) | (__| / _ \ || / _` | (__| '_/ _ \ V V / _` |
15 (_ (_ . _) _) \___|_\___/\_,_\__,_|\___|_| \___/\_/\_/\__,_|
16
17 _
18 ( )
19 _, _ . ( ` ) . )
20 ( ( _ )_ (_, _( ,_)_)
21 (_(_ _(_ ,)
22
23
24
0c78356 @jashkenas remove tabs without mercy -- how'd they sneak in?
jashkenas authored
25 ~ CloudCrowd ~
8f411d4 @jashkenas initial rails project for houdini 2.0
jashkenas authored
26
a9102ec @jashkenas changing tagline
jashkenas authored
27 * Parallel processing for the rest of us
0c78356 @jashkenas remove tabs without mercy -- how'd they sneak in?
jashkenas authored
28 * Write your scripts in Ruby
e50f41b @jashkenas updating the README with up-to-date getting started instructions
jashkenas authored
29 * Works with Amazon EC2 and S3
0c78356 @jashkenas remove tabs without mercy -- how'd they sneak in?
jashkenas authored
30 * split -> process -> merge
31 * As easy as `gem install cloud-crowd`
05ab2b7 @jashkenas getting started and architecture wiki + readme
jashkenas authored
32
3c27363 @jashkenas removing tabs from readme
jashkenas authored
33 Well-suited for:
34
35 * Generating or resizing images.
36 * Encoding video.
37 * Running text extraction or OCR on PDFs.
38 * Migrating a large file set or database.
39 * Web scraping.
0c78356 @jashkenas remove tabs without mercy -- how'd they sneak in?
jashkenas authored
40
41
6f66c10 @jashkenas Version 0.1.0 -- first real release
jashkenas authored
42 ~ Documentation ~
0c78356 @jashkenas remove tabs without mercy -- how'd they sneak in?
jashkenas authored
43
6f66c10 @jashkenas Version 0.1.0 -- first real release
jashkenas authored
44 Wiki: http://wiki.github.com/documentcloud/cloud-crowd
3c27363 @jashkenas removing tabs from readme
jashkenas authored
45 Rdoc: http://rdoc.info/projects/documentcloud/cloud-crowd
0c78356 @jashkenas remove tabs without mercy -- how'd they sneak in?
jashkenas authored
46
47
48 ~ Getting started ~
49
50 # Install the gem.
51
52 >> sudo gem install cloud-crowd
53
54 # Install the CloudCrowd configuration files to a location of your choosing.
55
56 >> crowd install ~/config/cloud-crowd
57
58 # Now, you can use the full complement of `crowd` commands from inside of
59 # this configuration directory. To see the available commands:
60
61 >> crowd --help
62
63 # Edit the configuration files to your satisfaction, add AWS credentials,
64 # and then load the CloudCrowd schema into your configured database.
65
9ec696b @jashkenas an exorcism of tabs
jashkenas authored
66 >> cd ~/config/cloud-crowd
e50f41b @jashkenas updating the README with up-to-date getting started instructions
jashkenas authored
67 >> mate config.yml
68 >> mate database.yml
9ec696b @jashkenas an exorcism of tabs
jashkenas authored
69 >> [create the database you just configured...]
0c78356 @jashkenas remove tabs without mercy -- how'd they sneak in?
jashkenas authored
70 >> crowd load_schema
71
72 # Write your actions, and install them into the 'actions' subdirectory.
e50f41b @jashkenas updating the README with up-to-date getting started instructions
jashkenas authored
73 # CloudCrowd comes with a few default actions as an example.
0c78356 @jashkenas remove tabs without mercy -- how'd they sneak in?
jashkenas authored
74
75 # To launch the central server (make sure that you include its location
e50f41b @jashkenas updating the README with up-to-date getting started instructions
jashkenas authored
76 # in config.yml):
0c78356 @jashkenas remove tabs without mercy -- how'd they sneak in?
jashkenas authored
77
78 >> crowd server
79
e50f41b @jashkenas updating the README with up-to-date getting started instructions
jashkenas authored
80 # The configuration folder also includes 'config.ru', which can be used by
9ec696b @jashkenas an exorcism of tabs
jashkenas authored
81 # any Rack-compliant webserver to run your central server.
0c78356 @jashkenas remove tabs without mercy -- how'd they sneak in?
jashkenas authored
82
e50f41b @jashkenas updating the README with up-to-date getting started instructions
jashkenas authored
83 # Then, to launch a node of workers:
0c78356 @jashkenas remove tabs without mercy -- how'd they sneak in?
jashkenas authored
84
e50f41b @jashkenas updating the README with up-to-date getting started instructions
jashkenas authored
85 >> crowd node
0c78356 @jashkenas remove tabs without mercy -- how'd they sneak in?
jashkenas authored
86
e50f41b @jashkenas updating the README with up-to-date getting started instructions
jashkenas authored
87 # To spin up remote nodes, install the 'cloud-crowd' gem and copy over
88 # your configuration directory. Run `crowd node`, and the remote machines
9ec696b @jashkenas an exorcism of tabs
jashkenas authored
89 # will register with the central server, becoming available for processing.
0c78356 @jashkenas remove tabs without mercy -- how'd they sneak in?
jashkenas authored
90
e50f41b @jashkenas updating the README with up-to-date getting started instructions
jashkenas authored
91 # At this point you can visit your Operations Center at localhost:9173 to
92 # view all of your nodes, ready for action.
0c78356 @jashkenas remove tabs without mercy -- how'd they sneak in?
jashkenas authored
93
Something went wrong with that request. Please try again.