Skip to content
Docker images for dask
Branch: master
Clone or download
jcrist Shrink Docker Image (#47)
* Shrink Docker Image

This does a few cleanups after a conda install to reduce image size. In
order of importance:
- Remove `*.pyc` files
- Remove static libraries
- Remove package cache
- Remove `*.js.map` files (more important with jupyter-lab extensions)

Overall this drops the image size from `834 MB` to `616 MB`.

* A few more updates

- Use --freeze-installed to not update base images
- Use tini in dask base image instead of dumb-init
- Reduce image size of notebook image as well.

* Don't update conda in notebook image

* Remove vim

* Remove unneeded js files

- Remove unminified bokeh js
- Cleanup jupyterlab staging files

* Final nit

Make prepare.sh scripts match.
Latest commit ea6c8c5 May 29, 2019
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
base Shrink Docker Image (#47) May 29, 2019
notebook Shrink Docker Image (#47) May 29, 2019
README.md Add support for environment.yml and helper notebook container (#3) Jul 29, 2017
docker-compose.yml add environment variable to docker-compose Nov 27, 2018

README.md

Dask docker images

Docker images for dask-distributed.

  1. Base image to use for dask scheduler and workers
  2. Jupyter Notebook image to use as helper entrypoint

This images are built primarily for the dask-distributed Helm Chart but they should work for more use cases.

How to use / test

A helper docker-compose file is provided to test functionality.

docker-compose up

Open the notebook using the URL that is printed by the output so it has the token.

On a new notebook run:

from dask.distributed import Client
client = Client('scheduler:8786')
client.ncores()

It should output something like this:

{'tcp://172.23.0.4:41269': 4}

Building images

Docker compose provides an easy way to building all the images with the right context

docker-compose build

# Just build one image e.g. notebook
docker-compose build notebook
You can’t perform that action at this time.