/torture

FTP search based on Go! and ElasticSearch for the 31. Chaos Communication Congress
  1. Go 96.0%
  2. CSS 3.8%
  3. JavaScript 0.2%
Go CSS JavaScript
Find file
Latest commit 3afb621 Dec 30, 2015 @barnslig Use simple_query_string. Related to cf8975f and issue #17
Permalink
Failed to load latest commit information.
crawler Crawler: Fix analyzers. Related to #6 Dec 26, 2015
frontend Use simple_query_string. Related to cf8975f and issue #17 Dec 30, 2015
lib/elastic Add filter option to boost large files a bit. Finally resolves #2 Dec 24, 2015
.editorconfig Initial commit Dec 23, 2014
.gitignore Use gopm for dependency version management. Resolves #14. Relates to #13 Jul 28, 2015
AUTHORS Add legal herp-derp Jan 3, 2015
LICENSE Add legal herp-derp Jan 3, 2015
README.md Replace elastigo by a simple REST client + Support ElasticSearch 2.x Dec 23, 2015

README.md

torture

Multi FTP crawler and file search. Written for CCC events.

torture exists of two seperate components: The crawler and the frontend. Both are interconnected via the Elasticsearch backend.

Setup

It is always a good idea to setup a GOPATH.

For dependency version management, gopm is used. Please install gopm before continuing!

General

  1. Install and setup Elasticsearch
  2. Go into crawler/ and run gopm get; gopm build
  3. Go into frontend/ and run gopm get; gopm build

Crawler

  1. Create a servers.txt somewhere. Example is given inside crawler/.
  2. You need to add script.engine.groovy.inline.update: true to your elasticsearch.yml
  3. Run the crawler

Frontend

  1. Run the frontend

Authors

See AUTHORS. Do not forget to add yourself!

License

See LICENSE