JDSpider

install scarpy component

• install python virtual enironment
  1. #pip install virtualenv
  2. create your virtual python env #virtualenv $env_dirname
  3. active your env, for windows #cd $env_dirname and #Scripts\activate.bat
  4. if you get any problem you will see virtualenv problem
• install scrapy
  1. #pip install scrapy

run JDSpider

1. #git clone https://github.com/zt900403/spider.git JDSpider
2. #cd JDSpider
3. #scrapy crawl JDSpider --nolog