Switch to Celery

[keithamoss]

Let's use Celery, not our hacked together queueing solution.

• Deploy django-celery with RabbitMQ
• Have a single Celery task start-up with the stack, stop the previous task, and begin streaming
• Deal with the edge case of two workers streaming at once and log a warning (duplicate pkeys)
• Reconnect on getting a 420
• How can frontend know if we're running? Inspect the task queue for running tasks?
• What causes the Connection reset by peer errors?
• Why is guest still showing up in the logs?
• Filling in missing tweets doesn't seem to entirely work
• Move DB logging stuff to logger?

Twitter API Documentation

Standard search API
Using the standard search endpoint
Standard streaming API request parameters
Streaming tweets: Reconnecting best practice