Spidermon is a framework to build monitors for Scrapy spiders. It offers the following features:
- It can check the output data produced by Scrapy (or other sources) and verify it against a schema or model that defines the expected structure, data types and value restrictions. It supports data validation based on two external libraries:
- jsonschema: https://github.com/Julian/jsonschema
- Schematics: https://github.com/schematics/schematics
- It allows you to define conditions that should trigger an alert based on Scrapy stats.
- It supports notifications via email, Slack and Telegram.
- It can generate custom reports.
installation getting-started monitors item-validation expression-monitors settings howto/index actions/index changelog