scrapy-selenium-middleware usage example Demo project to explain how to use scrapy-selenium-middleware package setup pip install -r requirements.txt to debug run file test_spider.py as main change settings.py values to use a proxy , user agent and other settings