Docker Essentials

cd docker_for_data_engineers - local Dockerfile for which the custom image based off of.

1. Build our image

docker compose build spark-master

2. start containers

docker compose up --build -d --scale spark-worker=2

3. See list of running docker containers and their settings

docker ps

4. To stop containers

docker compose down

5. dfvf

6. fvbg