Creepermon is an app for monitoring websites in a really stupid way. It doesn't do alerting. It just curls your websites and creates graphs.
Creepermon takes a yaml file that defines a list. Each item in the list is a url and html xpath. We log each scrape to Keen.io and build a nice dashboard to show you all of your sites.
Each scrape collects:
- Status code
- Scrape time
- Value to xpath target
The value of the xpath target is turned into an integer before storage.
sites.yml, push to heroku.
Set Heroku config:
heroku config:set KEEN_PROJECT_ID=aaaaaaaaaaaaaaaaaaaaaaaa KEEN_READ_KEY=eeeeeeeeeeeeeeeeeeeeeeee KEEN_WRITE_KEY=ffffffffffffffffffffffff heroku config:set LANG=en_US.UTF-8 heroku config:set RACK_ENV=production
Add the Heroku Scheduler
heroku addons:create scheduler:standard
rake cron to run every ten minutes