Multi FTP crawler and file search. Written for CCC events.
torture exists of two seperate components: The crawler and the frontend. Both are interconnected via the Elasticsearch backend.
It is always a good idea to setup a GOPATH.
Dependencies are managed using dep.
- Install and setup Elasticsearch
- Go into
crawler/and rungo build - Go into
frontend/and rungo build
- Run the frontend
Setting up elasticsearch, crawler and frontend is significantly easier using Docker:
cp crawler/config.json .
docker-compose up -d
Reload the crawler's config:
docker-compose kill -s USR1 crawler
See AUTHORS. Do not forget to add yourself!
See LICENSE