Skip to content
This repository

HTTPS clone URL

Subversion checkout URL

You can clone with HTTPS or Subversion.

Download ZIP
Browse code

v0.7.1 doc update, also forgot to commit the version info on the last…

… commit
  • Loading branch information...
commit 2d19ed00f9c56bc700613cbea933e438de211e6c 1 parent 62497bd
Dave McLain authored November 20, 2012
35  README.md
Source Rendered
... ...
@@ -1,4 +1,35 @@
1  
-A package to assist with running scrapy on heroku. Mainly provides a scrapyd script that respects
2  
-PORT and a ISpiderQueue implementation that uses heroku's postgres implementation
  1
+Scrapy-Heroku
  2
+=============
  3
+
  4
+A package to assist with running scrapy on heroku. This is accomplished by providing
  5
+a custom application configuration at ``scrapy_heroku.app.application`` that launches
  6
+the scrapyd web service using the PORT environment variable and a multi-process work
  7
+queue implemented on a Postgres database specified by the DATABASE_URL environment
  8
+variable.
  9
+
  10
+Configuration
  11
+-------------
  12
+
  13
+Create a git repo that has a scrapy project at the root (scrapy.cfg should be at the
  14
+top level). Edit your scrapy.cfg to include the following::
  15
+
  16
+    [scrapyd]
  17
+    application = scrapy_heroku.app.application
  18
+
  19
+    [deploy]
  20
+    url = http://<YOUR_HEROKU_APP_NAME>.herokuapp.com:80/
  21
+    project = <YOUR_PROJECT_NAME>
  22
+    username = <A_USER_NAME>
  23
+    password = <A_PASSWORD>
  24
+
  25
+Add a requirements.txt file that includes ``scrapy-heroku`` in it. It is strongly
  26
+recommended that you version pin scrapy-heroku as well as the version of scrapy that
  27
+your project is developed against (pip freeze > requirements.txt). Finally create a
  28
+Procfile that consists of::
  29
+
  30
+    web: scrapy server
  31
+
  32
+Make sure you have a postgres database that has been promoted to DATABASE_URL
  33
+
3 34
 
4 35
 * Project page: <http://github.com/dmclain/scrapy-heroku>
2  scrapy_heroku/__init__.py
... ...
@@ -1,2 +1,2 @@
1 1
 
2  
-__version__ = (0, 6, 0)
  2
+__version__ = (0, 7, 1)

0 notes on commit 2d19ed0

Please sign in to comment.
Something went wrong with that request. Please try again.