List the required images and dependencies

Before starting to construct our whole system we must think about the pieces that will form it. This is the time to reflect on which services we want to have running and the relationships between them. Also, one could think upfront which services to log (http logging).

For example, after prior preparation, we know we want to have a Spark instance running, but supercharged with all the nice features (http log, db log).

Hence, for that we will need the images:

• Two docker-spark images, one for the Spark Master and for the Spark Worker.
• The tenforce/virtuoso database to store our data.
• The mu-swarm-logger-service image for logging docker container events)
• The images needed for HTTP logging: event-query, docker-watcher & har-transformation.

---

Implementing Pilot on BDE Stack

1. List the required images and dependencies
2. Add support for the init daemon
3. Build a pipeline flow
4. Create a configuration for the Integrator UI
5. Construct a docker-compose.yml file