planet-Express

planet-express is the crawling module of Planet express project, It's works with scrapy, rabbitmq and redis.

Installation

We install the python libraries from requiriments.txt with pip, we use python3

pip install -r requirements.txt

For development purposes you can use koalacorp/planet-express-charts

Usage

Go to a scrapy folder a run it.

cd src/ceuta/ceuta && scrapy crawl bocce

Contributing

Pull requests are welcome. For major changes, please open an issue first to discuss what you would like to change.

Please make sure to update tests as appropriate.

License

GNU GENERAL PUBLIC LICENSE Version 3, 29 June 2007