Skip to content

Latest commit

 

History

History
104 lines (75 loc) · 4.54 KB

README.md

File metadata and controls

104 lines (75 loc) · 4.54 KB

Dask Docker image for Coffea Columnar Object Framework For Effective Analysis

CI/CD status GitHub issues GitHub pull requests

Latest DockerHub Images: https://hub.docker.com/orgs/coffeateam/repositories

Image Description Size Pulls Version
coffea-dask Debian Dask Coffea image with latest XrootD and CA certicates
coffea-dask-cc7 Centos7 Dask Coffea image with latest XrootD and CA certicates
coffea-dask-cc7-gateway Centos7 Dask Gateway Coffea image with latest XrootD and CA certicates (FNAL)

TL;DR

$ docker run -it --name docker-coffea-dask coffeateam/coffea-dask
$ docker run -it --name docker-coffea-dask-cc7 coffeateam/coffea-dask-cc7
$ docker run -it --name docker-coffea-dask-cc7-gateway coffeateam/coffea-dask-cc7-gateway

or, if using singularity and CVMFS is available,

$ singularity shell -B ${PWD}:/work /cvmfs/unpacked.cern.ch/registry.hub.docker.com/coffeateam/coffea-dask:latest
$ singularity shell -B ${PWD}:/work /cvmfs/unpacked.cern.ch/registry.hub.docker.com/coffeateam/coffea-dask-cc7:latest
$ singularity shell -B ${PWD}:/work /cvmfs/unpacked.cern.ch/registry.hub.docker.com/coffeateam/coffea-dask-cc7-gateway:latest

Get this image

The recommended way to get the Coffea Dask Docker image is to pull the prebuilt image from the Docker Hub Registry or Docker Hub Registry or Docker Hub Registry.

$ docker pull coffeateam/coffea-dask:latest
$ docker pull coffeateam/coffea-dask-cc7:latest
$ docker pull coffeateam/coffea-dask-cc7-gateway:latest

To use a specific version, you can pull a versioned tag. You can view the list of available versions in the Docker Hub Registry.

$ docker pull coffeateam/coffea-dask:[TAG]
$ docker pull coffeateam/coffea-dask-cc7:[TAG]
$ docker pull coffeateam/coffea-dask-cc7-gateway:[TAG]

The latest image is also distributed as a singularity image on the unpacked.cern.ch service:

/cvmfs/unpacked.cern.ch/registry.hub.docker.com/coffeateam/coffea-dask:latest
/cvmfs/unpacked.cern.ch/registry.hub.docker.com/coffeateam/coffea-dask-cc7:latest
/cvmfs/unpacked.cern.ch/registry.hub.docker.com/coffeateam/coffea-dask-cc7-gateway:latest

If you wish, you can also build the image yourself.

$ sudo docker build -t coffeateam/coffea-dask dask
$ sudo docker build -t coffeateam/coffea-dask-cc7 dask-cc7
$ sudo docker build -t coffeateam/coffea-dask-cc7-gateway dask-cc7-gateway

Releasing

Building and releasing new image versions is done automatically via Github CI.

When new commits are pushed to the master branch, images with the recent Coffea and Dask/Distributed tag and as well with latest tag are built and pushed to Docker Hub.

How it work: when a new version of Dask/Distributed is released a PR should be raised to bump the versions in the Dockerfiles and then once that has been merged a new tag matching the Coffea version should be pushed.