Deploying Sparkler Crawl Environment

The easiest, if not the most scalable way to get going. Docker Compose is pretty straight forward. Checkout or copy and paste the docker-compose.yaml file from the sparkler repo.

Once downloaded run:

docker network create sparkler && \
docker-compose up

from the same directory your file is in. When it starts in another terminal run:

docker ps

and ensure you have 6 running containers. The API requires the database to be up and running and very rarely it starts ahead of the database its waiting for, if this is the case, for now just stop the cluster using Ctrl-C or docker-compose down and restart it, it should end up starting in the correct order.

To access the platform, visit http://localhost:8080/explorer and you should be greated with the home page.