druid-docker

Docker for setting up single machine Druid Cluster

To setup docker refer : Install Docker

Download and launch the docker image

docker pull abhi195/druid-cluster
docker run --rm -i -p 9001:9001 -p 8090:8090 -p 8083:8083  -p 8082:8082 -p 8081:8081 abhi195/druid-cluster

Getting the cluster up may take some time, wait for few minutes.

Web interfaces for the cluster

• Supervisor status : http://localhost:9001

• Druid Coordinator Console : http://localhost:8081/#/

• Druid Overlord Console : http://localhost:8090/console.html

Build Druid Docker Image

To build the docker image yourself

git clone https://github.com/abhi195/druid-docker.git
docker build -t druid-cluster druid-docker

Logging

Supervisor logs are configured at /var/log/druid/

Druid's logs are at its default path.

Following steps are for logging into the container, then you can see the log files :

• List running containers using docker ps
• Note container-id of container running druid-cluster
• Execute docker exec -it container-id /bin/bash
• For more info on logging into container look at docker exec

Troubleshooting

Latest image abhi195/druid-cluster is tested on OSX with 4GB of RAM and 2CPUs assigned to Docker.

XX:MaxDirectMemorySize error when using OSX

If you are running docker on OSX you might get XX:MaxDirectMemorySize error because on OSX the Docker environment runs within HyperKit hypervisor.

Driud configurations inside conf folder of this repository already includes some changes in properties to fix this error.

To fix this you can take following steps:

• Tweak memory/cache/processing/threads related properties
• Increase the CPUs and RAM allocated to the Docker running on you machine