Skip to content

[install] add -e/--examples flag to checkout submodules #755

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
jeffra merged 2 commits into from
Feb 12, 2021
+14 −11
Merged

[install] add -e/--examples flag to checkout submodules #755

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
942ec73
add -e/--examples flag to checkout submodules
jeffra Feb 12, 2021
a7b47bc
bump DSE commit
jeffra Feb 12, 2021
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion DeepSpeedExamples
Open in desktop
Submodule DeepSpeedExamples updated from 78d69c to 1bee84
23 changes: 13 additions & 10 deletions install.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -21,25 +21,23 @@ hostfile (hostfile: /job/hostfile). If no hostfile exists, will only install loc
-n, --no_clean Do not clean prior build state, by default prior build files are removed before building wheels
-m, --pip_mirror Use the specified pip mirror (default: the default pip mirror)
-H, --hostfile Path to MPI-style hostfile (default: /job/hostfile)
-e, --examples Checkout deepspeed example submodule (no install)
-v, --verbose Verbose logging
-h, --help This help text
"""
}

ds_only=0
tp_only=0
deepspeed_install=1
third_party_install=1
local_only=0
pip_sudo=0
entire_dlts_job=1
hostfile=/job/hostfile
pip_mirror=""
apex_commit=""
skip_requirements=0
allow_sudo=0
no_clean=0
verbose=0
examples=0

while [[ $# -gt 0 ]]
do
Expand Down Expand Up @@ -79,6 +77,10 @@ case $key in
shift
shift
;;
-e|--examples)
examples=1
shift
;;
-h|--help)
usage
exit 0
Expand All @@ -101,16 +103,17 @@ if [ "$allow_sudo" == "0" ]; then
fi
fi

if [ "$ds_only" == "1" ] && [ "$tp_only" == "1" ]; then
echo "-d and -t are mutually exclusive, only choose one of the two"
usage
exit 1
if [ "$examples" == "1" ]; then
git submodule update --init --recursive
exit 0
fi

if [ "$verbose" == "1" ]; then
VERBOSE="-v"
PIP_VERBOSE=""
else
VERBOSE=""
PIP_VERBOSE="--disable-pip-version-check"
fi

rm_if_exist() {
Expand All @@ -137,9 +140,9 @@ else
fi

if [ "$pip_mirror" != "" ]; then
PIP_INSTALL="pip install $VERBOSE -i $pip_mirror"
PIP_INSTALL="pip install $VERBOSE $PIP_VERBOSE -i $pip_mirror"
else
PIP_INSTALL="pip install $VERBOSE"
PIP_INSTALL="pip install $VERBOSE $PIP_VERBOSE"
fi


Expand Down