TorchServe dockerfile does not exist

[Hegelim]

I am following the instructions here:
https://mmocr.readthedocs.io/en/latest/model_serving.html

I am trying to build the docker image from mmocr-serve:

docker build -t mmocr-serve:latest docker/serve/

However, there is no such directory docker/serve/
Is this a bug?

[gaotongxiao]

Yes, the directory is missing. We will add it back soon, but it may take some time. If you need it urgently, you may try downloading the docker/serve directory from mmdet (https://github.com/open-mmlab/mmdetection/blob/master/docker/serve/) and add RUN pip install mmocr to https://github.com/open-mmlab/mmdetection/blob/ca11860f4f3c3ca2ce8340e2686eeaec05b29111/docker/serve/Dockerfile#L31, then everything should work fine.

[Hegelim]

I followed your instructions - I added that line to line 31 and run

docker build -t mmocr-serve:latest .

However, it still doesn't work. The public key is messed up:

Sending build context to Docker daemon  3.584kB
Step 1/27 : ARG PYTORCH="1.6.0"
Step 2/27 : ARG CUDA="10.1"
Step 3/27 : ARG CUDNN="7"
Step 4/27 : FROM pytorch/pytorch:${PYTORCH}-cuda${CUDA}-cudnn${CUDNN}-devel
 ---> bb833e4d631f
Step 5/27 : ARG MMCV="1.3.17"
 ---> Running in f987263b6614
Removing intermediate container f987263b6614
 ---> e89c32cdb94b
Step 6/27 : ARG MMDET="2.25.0"
 ---> Running in f752cae18d40
Removing intermediate container f752cae18d40
 ---> d697c99aa45d
Step 7/27 : ENV PYTHONUNBUFFERED TRUE
 ---> Running in ab296e572672
Removing intermediate container ab296e572672
 ---> 555dd8dc9be0
Step 8/27 : RUN apt-get update &&     DEBIAN_FRONTEND=noninteractive apt-get install --no-install-recommends -y     ca-certificates     g++     openjdk-11-jre-headless     ffmpeg libsm6 libxext6 git ninja-build libglib2.0-0 libsm6 libxrender-dev libxext6     && rm -rf /var/lib/apt/lists/*
 ---> Running in 6e5840c40576
Get:1 https://developer.download.nvidia.com/compute/cuda/repos/ubuntu1804/x86_64  InRelease [1581 B]
Ign:2 https://developer.download.nvidia.com/compute/machine-learning/repos/ubuntu1804/x86_64  InRelease
Get:3 https://developer.download.nvidia.com/compute/machine-learning/repos/ubuntu1804/x86_64  Release [564 B]
Get:4 https://developer.download.nvidia.com/compute/machine-learning/repos/ubuntu1804/x86_64  Release.gpg [833 B]
Get:5 http://security.ubuntu.com/ubuntu bionic-security InRelease [88.7 kB]
Err:1 https://developer.download.nvidia.com/compute/cuda/repos/ubuntu1804/x86_64  InRelease
  The following signatures couldn't be verified because the public key is not available: NO_PUBKEY A4B469963BF863CC
Get:6 https://developer.download.nvidia.com/compute/machine-learning/repos/ubuntu1804/x86_64  Packages [73.8 kB]
Get:7 http://archive.ubuntu.com/ubuntu bionic InRelease [242 kB]
Get:8 http://security.ubuntu.com/ubuntu bionic-security/restricted amd64 Packages [982 kB]
Get:9 http://archive.ubuntu.com/ubuntu bionic-updates InRelease [88.7 kB]
Get:10 http://archive.ubuntu.com/ubuntu bionic-backports InRelease [74.6 kB]
Get:11 http://archive.ubuntu.com/ubuntu bionic/main amd64 Packages [1344 kB]
Get:12 http://security.ubuntu.com/ubuntu bionic-security/main amd64 Packages [2830 kB]
Get:13 http://security.ubuntu.com/ubuntu bionic-security/universe amd64 Packages [1517 kB]
Get:14 http://archive.ubuntu.com/ubuntu bionic/restricted amd64 Packages [13.5 kB]
Get:15 http://archive.ubuntu.com/ubuntu bionic/multiverse amd64 Packages [186 kB]
Get:16 http://archive.ubuntu.com/ubuntu bionic/universe amd64 Packages [11.3 MB]
Get:17 http://security.ubuntu.com/ubuntu bionic-security/multiverse amd64 Packages [22.8 kB]
Get:18 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 Packages [3262 kB]
Get:19 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 Packages [2291 kB]
Get:20 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse amd64 Packages [29.8 kB]
Get:21 http://archive.ubuntu.com/ubuntu bionic-updates/restricted amd64 Packages [1015 kB]
Get:22 http://archive.ubuntu.com/ubuntu bionic-backports/universe amd64 Packages [12.9 kB]
Get:23 http://archive.ubuntu.com/ubuntu bionic-backports/main amd64 Packages [12.2 kB]
Reading package lists...
W: GPG error: https://developer.download.nvidia.com/compute/cuda/repos/ubuntu1804/x86_64  InRelease: The following signatures couldn't be verified because the public key is not available: NO_PUBKEY A4B469963BF863CC
E: The repository 'https://developer.download.nvidia.com/compute/cuda/repos/ubuntu1804/x86_64  InRelease' is not signed.
The command '/bin/sh -c apt-get update &&     DEBIAN_FRONTEND=noninteractive apt-get install --no-install-recommends -y     ca-certificates     g++     openjdk-11-jre-headless     ffmpeg libsm6 libxext6 git ninja-build libglib2.0-0 libsm6 libxrender-dev libxext6     && rm -rf /var/lib/apt/lists/*' returned a non-zero code: 100

Fix

I then tried the suggestions here NVIDIA/nvidia-container-toolkit#258
Then everything works fine

[gaotongxiao]

Thanks for sharing the details! Would you like to raise a PR to supplement these missing files back?

[Hegelim]

Happy to contribute. Just created a PR here: #1073
Did I miss anything?