Test scrapers

How to run this scripts?

1. cd to folder with interesting scraper;
2. scrapy crawl <scraper-name> for getting data from spider.

Scrapers

• ajax_pagination - for https://www.webscraper.io/test-sites/e-commerce/ajax
• simple_ecommerce - for https://scrapingclub.com/exercise/list_basic/

Used libraries

• bs4 also known as BeautifulSoup
• scrapy
• selenium
• requests
• sqlalchemy