smth_coupons_crawler

This README would normally document whatever steps are necessary to get your webcrawl up and running.

What is this repository for?

*the webcrawl is for catch amazon deals and coupon messages of newsmth.

How do I get set up?

• Dependencies python 2.7 + node 4.x:
  sudo apt-get install python2.7 python2.7-dev python-pip
  sudo apt-get install libxml2-dev libxml2 libxslt1.1 libxslt1-dev zlib1g-dev zlib1g phantomjs pip install w3lib lxml cssselect twisted selenium bs4 pymongo
  pip install pydispatch pydispacher
  pip install scrapy

• Database configuration apt-get install mongodb

• How to run tests cd webcrewl scrapy crawl amz> ./amzlog.txt

• Deployment instructions

Who do I talk to?

• JoannaWang 14907232@qq.com

Support on Beerpay

Hey dude! Help me out for a couple of 🍻!