Popular repositories Loading

1. scrapy-splash scrapy-splash Public

   Scrapy+Splash for JavaScript integration

   Python 3.2k 456

2. scrapy-playwright scrapy-playwright Public

   🎭 Playwright integration for Scrapy

   Python 1.1k 128

3. scrapy-djangoitem scrapy-djangoitem Public

   Scrapy extension to write scraped items using Django models

   Python 501 87

4. scrapy-zyte-smartproxy scrapy-zyte-smartproxy Public

   Zyte Smart Proxy Manager (formerly Crawlera) middleware for Scrapy

   Python 364 89

5. scrapy-jsonrpc scrapy-jsonrpc Public

   Scrapy extension to control spiders using JSON-RPC

   Python 297 71

6. scrapy-deltafetch scrapy-deltafetch Public

   Scrapy spider middleware to ignore requests to pages containing items seen in previous crawls

   Python 270 49