bootstrap scripts for getting a micro ec2 instance piping gardenhose to s3
Shell
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Failed to load latest commit information.
README
bootstrap.sh
process_yesterday.sh
start.sh

README

simple set of scripts for slurping twitter gardenhose and uploading to s3 daily

restarts curl from gardenhose hourly to ensure dropped connections are reestablished from time to time

requires a s3 bucket to be created beforehand (should really roll into the script)

start a micro instance and ssh on and run...
$ yum install git
$ git clone git://github.com/matpalm/gardenhose-microslurp.git
$ cp gardenhose-microslurp/* .
$ ./bootstrap.sh

bootstrap sets some env vars (in ~/env_vars) for twitter uid, 
s3 creds and sets up some cron jobs