Home
Andy Jackson edited this page May 14, 2015
·
18 revisions
monitrix is a monitoring/analytics frontend for the Heritrix Web crawler.
This second prototype takes a different tack, using a generic log file analysis system to monitor crawls and visualise what's going on. It's probably still tricky to scale, but it's much easier to maintain.
The first version of Monitrix was built as a dedicated web application. This worked reasonably well, but proved difficult to scale and maintain.