Skip to content

Latest commit

 

History

History

setup

Folders and files

NameName
Last commit message
Last commit date

parent directory

..
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Setup

This folder contains the docker-compose files and some setup scripts to ease the setup process of the system. Install docker-compose on your system following the guidelines at: https://docs.docker.com/compose/install/. Under Ubuntu 14.04, the script setup_machine.sh can install all requirements.

All-in-one setup

The folder all-in-one contains two examples of image index you can build from publicly available datasets just by running a single command. This is intended to be used as a testbed and to get you familiar with the tool. Check the README.md in that folder for more details.

Components setup

In a production environment, each component (ingestion, processing, search) would be better run on separate machines and relying on real cluster instances of Kafka/Kinesis and HBase. The folders in components provide docker-compose files and sample environments files for that purpose. You might need to adjust some parameters (number of workers, number of threads etc.) to the hardware you use, to optimize the computation or avoid overloading the machines you are using. Default release parameters are somewhat optimized to the expected hardware and computation load required for each component for the MEMEX transition.

More details are available in each sub-folder's README.md file.

Configuration generation

The configuration generation scripts in ConfGenerator are called automatically when starting the docker containers with the provided docker-compose files.

Docker build

The folder DockerBuild contains the script and Docker file that were used to build the image that was pushed to the docker repository and that is pulled when starting up the docker containers using the provided docker-compose files.