Basic setup with random user agents and IP addresses for Python Scrapy Framework.
-
Updated
Dec 19, 2017 - Python
Basic setup with random user agents and IP addresses for Python Scrapy Framework.
The repository "bookscraper" contains web-scraping and web-crawling projects using the Python Scrapy framework. It scrapes and crawls data from several websites and saves the data in JSON, CSV, and XML formats. For more details, you can check the [README file](https://github.com/demamano/bookscraper/blob/c372021ff5b80db635d4551757c010b7a9f8c028/RE
Add a description, image, and links to the python-scrapy-framework topic page so that developers can more easily learn about it.
To associate your repository with the python-scrapy-framework topic, visit your repo's landing page and select "manage topics."