Skip to content

Commit

Permalink
feat: update deepspeed version to hosted deepspeed wheel (#361)
Browse files Browse the repository at this point in the history
* feat: update deepspeed to 0.7.5 wheel

Co-authored-by: Frank Liu <frankfliu2000@gmail.com>
  • Loading branch information
tosterberg and frankfliu committed Dec 6, 2022
1 parent a7be8e1 commit 9580dd2
Showing 1 changed file with 3 additions and 2 deletions.
5 changes: 3 additions & 2 deletions serving/docker/deepspeed.Dockerfile
Original file line number Diff line number Diff line change
Expand Up @@ -14,7 +14,7 @@ FROM nvidia/cuda:$version
ARG djl_version=0.20.0~SNAPSHOT
ARG torch_version=1.12.1
ARG accelerate_version=0.13.2
ARG deepspeed_version=0.7.5
ARG deepspeed_wheel="https://publish.djl.ai/deepspeed/deepspeed-0.7.5%2Bbf16-py2.py3-none-any.whl"
ARG transformers_version=4.23.1

EXPOSE 8080
Expand Down Expand Up @@ -44,7 +44,8 @@ RUN apt-get update && \
scripts/install_s5cmd.sh x64 && \
DEBIAN_FRONTEND=noninteractive apt-get install -yq libaio-dev libopenmpi-dev && \
pip3 install torch==${torch_version} --extra-index-url https://download.pytorch.org/whl/cu116 && \
pip3 install deepspeed==${deepspeed_version} transformers==${transformers_version} && \
pip3 install ${deepspeed_wheel} && \
pip3 install transformers==${transformers_version} && \
pip3 install triton==1.0.0 mpi4py sentencepiece accelerate==${accelerate_version} bitsandbytes && \
scripts/patch_oss_dlc.sh python && \
scripts/security_patch.sh deepspeed && \
Expand Down

0 comments on commit 9580dd2

Please sign in to comment.