Popular repositories

1. scrapy-splash scrapy-splash Public

   Scrapy+Splash for JavaScript integration

   Python 3.1k 447

2. scrapy-playwright scrapy-playwright Public

   🎭 Playwright integration for Scrapy

   Python 826 93

3. scrapy-djangoitem scrapy-djangoitem Public

   Scrapy extension to write scraped items using Django models

   Python 498 87

4. scrapy-zyte-smartproxy scrapy-zyte-smartproxy Public

   Zyte Smart Proxy Manager (formerly Crawlera) middleware for Scrapy

   Python 348 88

5. scrapy-jsonrpc scrapy-jsonrpc Public

   Scrapy extension to control spiders using JSON-RPC

   Python 297 71

6. scrapy-deltafetch scrapy-deltafetch Public

   Scrapy spider middleware to ignore requests to pages containing items seen in previous crawls

   Python 266 48