deeplab-voc-2012

pytorch scripts training DeeplabV3 (trained from scratch) on the PASCAL VOC 2012 Segmentation dataset for 20 epochs. The model architecture and data are taken from the PyTorch pretrained models and example data, respectively (torchvision.models.segmentation.deeplabv3_resnet101 and torchvision.datasets.VOCSegmentation). This training script is useful for benchmarking large-scale CNN training jobs.

To run on Spell:

spell run --machine-type v100 \
  --github-url https://github.com/spellml/deeplab-voc-2012.git \
  --tensorboard-dir /spell/tensorboards/model_1/ \
  "python models/1_initial_model.py"

spell run --machine-type v100x4 \
  --github-url https://github.com/spellml/deeplab-voc-2012.git \
  --tensorboard-dir /spell/tensorboards/model_2/ \
  "python models/2_pytorch_distributed_model.py"

spell run --machine-type v100x8 \
  --github-url https://github.com/spellml/deeplab-voc-2012.git \
  --tensorboard-dir /spell/tensorboards/model_2/ \
  "python models/2_pytorch_distributed_model.py"

spell run --machine-type v100x4 \
  --github-url https://github.com/spellrun/spell-deeplab-voc-2012.git \
  --tensorboard-dir /spell/tensorboards/model_3/ \
  "python models/3_pytorch_distributed_threaded.py"

spell run --machine-type v100x8 \
  --github-url https://github.com/spellml/deeplab-voc-2012.git \
  --tensorboard-dir /spell/tensorboards/model_3/ \
  "python models/3_pytorch_distributed_threaded.py"

spell run --machine-type v100x4 \
  --github-url https://github.com/spellrun/spell-deeplab-voc-2012.git \
  --tensorboard-dir /spell/tensorboards/model_4/ \
  --distributed 1 \
  "python models/4_pytorch_distributed_horovod.py"

spell run --machine-type v100x8 \
  --github-url https://github.com/spellml/deeplab-voc-2012.git \
  --tensorboard-dir /spell/tensorboards/model_4/ \
  --distributed 1 \
  "python models/4_pytorch_distributed_horovod.py"

spell run --machine-type v100 \
  --github-url https://github.com/spellml/deeplab-voc-2012.git \
  --tensorboard-dir /spell/tensorboards/model_4/ \
  --distributed 4 \
  "python models/4_pytorch_distributed_horovod.py"

spell run --machine-type v100 \
  --github-url https://github.com/spellml/deeplab-voc-2012.git \
  --tensorboard-dir /spell/tensorboards/model_4/ \
  --distributed 8 \
  "python models/4_pytorch_distributed_horovod.py"