Docker deployment does not launch runs

[sburkulemb]

Hey guys using this for deploying using docker. I have made some changes to the docker-compose file, see attached. Im getting this error, could someone help me out with this?

Error:

docker_example_webserver   | 2023-12-06 17:20:47 +0000 - dagster-webserver - INFO - Serving dagster-webserver on http://0.0.0.0:3000 in process 1
docker_example_daemon      | 2023-12-06 17:21:02 +0000 - dagster.daemon.QueuedRunCoordinatorDaemon - INFO - Retrieved 1 queued runs, checking limits.
docker_example_daemon      | 2023-12-06 17:21:03 +0000 - dagster.daemon.QueuedRunCoordinatorDaemon - ERROR - Caught an unrecoverable error while dequeuing the run. Marking the run as failed and dropping it from the queue: Exception: No docker image specified by the instance config or repository
docker_example_daemon      | 
docker_example_daemon      | Stack Trace:
docker_example_daemon      |   File "/usr/local/lib/python3.10/site-packages/dagster/_daemon/run_coordinator/queued_run_coordinator_daemon.py", line 333, in _dequeue_run
docker_example_daemon      |     instance.run_launcher.launch_run(LaunchRunContext(dagster_run=run, workspace=workspace))
docker_example_daemon      |   File "/usr/local/lib/python3.10/site-packages/dagster_docker/docker_run_launcher.py", line 148, in launch_run
docker_example_daemon      |     docker_image = self._get_docker_image(job_code_origin)
docker_example_daemon      |   File "/usr/local/lib/python3.10/site-packages/dagster_docker/docker_run_launcher.py", line 94, in _get_docker_image
docker_example_daemon      |     raise Exception("No docker image specified by the instance config or repository")

docker-compose.yml:

version: "3.7"

services:
  # This service runs the postgres DB used by dagster for run storage, schedule storage,
  # and event log storage.
  docker_example_postgresql:
    image: postgres:11
    container_name: docker_example_postgresql
    environment:
      POSTGRES_USER: "postgres_user"
      POSTGRES_PASSWORD: "postgres_password"
      POSTGRES_DB: "postgres_db"
    networks:
      - docker_example_network

  # This service runs the gRPC server that loads your user code, in both dagster-webserver
  # and dagster-daemon. By setting DAGSTER_CURRENT_IMAGE to its own image, we tell the
  # run launcher to use this same image when launching runs in a new container as well.
  # Multiple containers like this can be deployed separately - each just needs to run on
  # its own port, and have its own entry in the workspace.yaml file that's loaded by the
      # webserver.
#  docker_example_user_code:
#    build:
#      context: .
#      dockerfile: ./Dockerfile_user_code
#    container_name: docker_example_user_code
#    image: docker_example_user_code_image
#    restart: always
#    environment:
#      DAGSTER_POSTGRES_USER: "postgres_user"
#      DAGSTER_POSTGRES_PASSWORD: "postgres_password"
#      DAGSTER_POSTGRES_DB: "postgres_db"
#      DAGSTER_CURRENT_IMAGE: "docker_example_user_code_image"
#    volumes:
#      - ./:/opt/dagster/dagster_home/
#    networks:
#      - docker_example_network

  # This service runs dagster-webserver, which loads your user code from the user code container.
  # Since our instance uses the QueuedRunCoordinator, any runs submitted from the webserver will be put on
  # a queue and later dequeued and launched by dagster-daemon.
  docker_example_webserver:
    build:
      context: .
      dockerfile: Dockerfile
    entrypoint:
      - dagster-webserver
      - -h
      - "0.0.0.0"
      - -p
      - "3000"
      - -w
      - workspace.yaml
    container_name: docker_example_webserver
    expose:
      - "3000"
    ports:
      - "3000:3000"
    environment:
      DAGSTER_POSTGRES_USER: "postgres_user"
      DAGSTER_POSTGRES_PASSWORD: "postgres_password"
      DAGSTER_POSTGRES_DB: "postgres_db"
    volumes: # Make docker client accessible so we can terminate containers from the webserver
      - /var/run/docker.sock:/var/run/docker.sock
      - /tmp/io_manager_storage:/tmp/io_manager_storage
      - ./:/opt/dagster/dagster_home/
    networks:
      - docker_example_network
    depends_on:
      - docker_example_postgresql
#      - docker_example_user_code

  # This service runs the dagster-daemon process, which is responsible for taking runs
  # off of the queue and launching them, as well as creating runs from schedules or sensors.
  docker_example_daemon:
    build:
      context: .
      dockerfile: Dockerfile
    entrypoint:
      - dagster-daemon
      - run
    container_name: docker_example_daemon
    restart: on-failure
    environment:
      DAGSTER_POSTGRES_USER: "postgres_user"
      DAGSTER_POSTGRES_PASSWORD: "postgres_password"
      DAGSTER_POSTGRES_DB: "postgres_db"
    volumes: # Make docker client accessible so we can launch containers using host docker
      - /var/run/docker.sock:/var/run/docker.sock
      - /tmp/io_manager_storage:/tmp/io_manager_storage
      - ./:/opt/dagster/dagster_home/
    networks:
      - docker_example_network
    depends_on:
      - docker_example_postgresql
#      - docker_example_user_code

networks:
  docker_example_network:
    driver: bridge
    name: docker_example_network

[arniwesth]

I had the same issue. In my case, it was because

DAGSTER_CURRENT_IMAGE: "docker_example_user_code_image"

was missing from docker_example_user_code. In OP's case docker_example_user_code is commented out which seems to cause the same error message.