Tools for local crawl development
Sibling directories should include a few things. User-created:
- crawlout for binary outputs
- local-crawl-data for local dev server logging/saves
- crawl-data for local docker server logging/saves
Github repos:
- crawl
- crawl-docker
- crawl-web-config