- Install scrapy
- Use scrapy shell to confirm if it's successfully installed.
- scrapy startproject projectname
- cd projectname
- scrapy genspider [-t] [templatename, eg.csvFeedSpider] spidername Add contents by programing
- scrapy crawl toscrapy-css -o toscrapy-css.json etc.
$ scrapy list
toscrape-css
toscrape-xpath
I didn't upload crawling result file toscrapy-css.json and other json files, they are too large, U can just try this applications.