[docker] DeepSpeed image should contain nvcc

[vfdev-5]

Currently, "pytorchignite/msdp-apex:latest" docker image can not run cifar10 DeepSpeed example failing with error:

...
    basic_optimizer = self._configure_basic_optimizer(model_parameters)                                                                                                                          
  File "/opt/conda/lib/python3.8/site-packages/deepspeed/runtime/engine.py", line 661, in _configure_basic_optimizer
    optimizer = FusedAdam(model_parameters, **optimizer_parameters)
  File "/opt/conda/lib/python3.8/site-packages/deepspeed/ops/adam/fused_adam.py", line 72, in __init__
    fused_adam_cuda = FusedAdamBuilder().load()
  File "/opt/conda/lib/python3.8/site-packages/deepspeed/ops/op_builder/builder.py", line 174, in load
    return self.jit_load(verbose)
...
  File "/opt/conda/lib/python3.8/subprocess.py", line 1702, in _execute_child         
    raise child_exception_type(errno_num, err_msg, err_filename)
FileNotFoundError: [Errno 2] No such file or directory: '/usr/local/cuda/bin/nvcc'
    raise child_exception_type(errno_num, err_msg, err_filename)

[trsvchn]

is it enough to

RUN apt-get update && apt-get -qq install -y --no-install-recommends nvidia-cuda-toolkit

?
I have never tried to install it inside a container

I'll try it tomorrow.

[vfdev-5]

I think this part of Dockerfile:

ignite/docker/msdp/Dockerfile.msdp-apex

Lines 71 to 73 in e6950b1

	apt-get remove -y g++ && \
	apt-get autoremove -y && \
	rm -rf /var/lib/apt/lists/*

removed nvcc which should be already present in pytorch devel docker image:

ignite/docker/msdp/Dockerfile.msdp-apex

Line 36 in e6950b1

FROM pytorch/pytorch:${PTH_VERSION}-devel

[trsvchn]

@vfdev-5 yeah, you're absolutely right!

Running this line

ignite/docker/msdp/Dockerfile.msdp-apex

Line 71 in e6950b1

apt-get remove -y g++ && \

Removes the compiler even before autoremove:

The following packages will be REMOVED:
  build-essential cuda-command-line-tools-10-1 cuda-compiler-10-1 cuda-cupti-10-1
  cuda-minimal-build-10-1 cuda-nvcc-10-1 g++

Can we just remove this line or lines?

[vfdev-5]

Yes, let's juste remove those lines