Skip to content

[OpenVINO-EP] Add missing dependency libs in Dockerfile#4064

Merged
jywu-msft merged 4 commits intomicrosoft:masterfrom
intel:Aravind/libjson_fix
Jun 2, 2020
Merged

[OpenVINO-EP] Add missing dependency libs in Dockerfile#4064
jywu-msft merged 4 commits intomicrosoft:masterfrom
intel:Aravind/libjson_fix

Conversation

@smkarlap
Copy link
Copy Markdown
Contributor

Description:

  • Added missing VAD-M hardware dependency libs into Dockerfile.
  • Update documentation with instructions on starting HDDL Daemon.

Motivation and Context

  • Required to be able to run the MCR Docker container on VAD-M hardware

cp onnxruntime/docs/Privacy.md /code/Privacy.md && \
cp onnxruntime/dockerfiles/LICENSE-IMAGE.txt /code/LICENSE-IMAGE.txt && \
cp onnxruntime/ThirdPartyNotices.txt /code/ThirdPartyNotices.txt && \
sed -i "s/sudo//" onnxruntime/dockerfiles/scripts/install_common_deps.sh &&\
Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

why is this needed?
is it just to get rid of the sudo at

sudo wget --quiet https://github.com/Kitware/CMake/releases/download/v3.14.3/cmake-3.14.3-Linux-x86_64.tar.gz
?
if so, can we modify that script and remove the sudo when downloading cmake? i'm not sure why it's needed anyway.

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is mainly needed to be able to validate container images behind company proxy servers and with conda python3 envs. There is a 'sudo pip install numpy' within the install_common_deps.sh, which we would like to use pip3 from the conda env. However, using sudo would cause it to use ubuntu 16.04's python2.7's pip instead. An alternative could be to replace sudo with 'sudo -E'.

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Where do you see sudo pip install numpy in install_common_deps.sh ? There's no sudo in the latest version on master.

Copy link
Copy Markdown
Contributor Author

@smkarlap smkarlap May 28, 2020

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ah.. my mistake.. i guess folks were having issues with line 22 (wget) behind proxy.

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

yes, then we should get rid of the sudo in line 22. not sure why it's even there.
there isn't one for the wget in line 14.

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Sounds good. I have removed the sed replacement line to remove sudo from install_common_deps.sh

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Will you make that change to remove the sudo from the wget in install_common_deps.sh ?
otherwise you mentioned you were running into issues?

@HectorSVC
Copy link
Copy Markdown
Contributor

/azp run Linux CPU CI Pipeline,Linux CPU x64 NoContribops CI Pipeline,Linux GPU CI Pipeline,Linux GPU TensorRT CI Pipeline,MacOS CI Pipeline,MacOS NoContribops CI Pipeline,Windows CPU CI Pipeline,Windows GPU CI Pipeline,Windows GPU TensorRT CI Pipeline,orttraining-linux-ci-pipeline,orttraining-linux-gpu-ci-pipeline,orttraining-mac-ci-pipeline

@azure-pipelines
Copy link
Copy Markdown

You have several pipelines (over 10) configured to build pull requests in this repository. Specify which pipelines you would like to run by using /azp run [pipelines] command. You can specify multiple pipelines using a comma separated list.

@jywu-msft
Copy link
Copy Markdown
Member

/azp run Linux CPU CI Pipeline,Linux CPU x64 NoContribops CI Pipeline,Linux GPU CI Pipeline,Linux GPU TensorRT CI Pipeline,MacOS CI Pipeline,MacOS NoContribops CI Pipeline,Windows CPU CI Pipeline,Windows GPU CI Pipeline

@azure-pipelines
Copy link
Copy Markdown

Azure Pipelines successfully started running 8 pipeline(s).

@jywu-msft
Copy link
Copy Markdown
Member

will you also modify install_common_deps.sh to remove the sudo invocation of wget?

'sudo' is not required, and hinders running script from within
proxy environments. Removing it also makes lines consistent with
each other (there are other wget lines without sudo).
@smkarlap
Copy link
Copy Markdown
Contributor Author

smkarlap commented Jun 1, 2020

'sudo' removed from install_common_deps.sh

@jywu-msft
Copy link
Copy Markdown
Member

/azp run Linux CPU CI Pipeline,Linux CPU x64 NoContribops CI Pipeline,Linux GPU CI Pipeline,Linux GPU TensorRT CI Pipeline,MacOS CI Pipeline,MacOS NoContribops CI Pipeline,Windows CPU CI Pipeline,Windows GPU CI Pipeline

@azure-pipelines
Copy link
Copy Markdown

Azure Pipelines successfully started running 8 pipeline(s).

@jywu-msft
Copy link
Copy Markdown
Member

/azp run Windows GPU TensorRT CI Pipeline,orttraining-linux-ci-pipeline,orttraining-linux-gpu-ci-pipeline,orttraining-mac-ci-pipeline

@azure-pipelines
Copy link
Copy Markdown

Azure Pipelines successfully started running 4 pipeline(s).

@jywu-msft jywu-msft merged commit baa0697 into microsoft:master Jun 2, 2020
@smkarlap smkarlap deleted the Aravind/libjson_fix branch June 19, 2020 00:00
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants