Scrapy Do is a daemon that provides a convenient way to run Scrapy spiders. It can either do it once - immediately; or it can run them periodically, at specified time intervals. It's been inspired by scrapyd but written from scratch. It comes with a REST API, a command line client, and an interactive web interface.
- Homepage: https://jany.st/scrapy-do.html
- The code: https://github.com/ljanyst/scrapy-do
quick-start basic-concepts installation server-configuration commandline-client webgui rest-api source-docs
genindexmodindexsearch