Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Update instance type to Standard_DS3_V2 #2037

Merged
merged 4 commits into from
Jan 25, 2023
Merged

Update instance type to Standard_DS3_V2 #2037

Show file tree
Hide file tree
Changes from 3 commits
Commits
Show all changes
4 commits
Select commit Hold shift + click to select a range
6bc4d57
Update instance type to Standard_DS3_V2
Jan 24, 2023
fd2a3e4
Update instance type on sdk examples
Jan 25, 2023
644c7e7
Update notebook
Jan 25, 2023
045b6bb
Update notebook
Jan 25, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion cli/endpoints/online/custom-container/minimal/multimodel/minimal-multimodel-deployment.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -10,5 +10,5 @@ code_configuration:
environment:
name: minimal-multimodel
image: {{ACR_NAME}}.azurecr.io/azureml-examples/minimal-multimodel:1
instance_type: Standard_DS2_v2
instance_type: Standard_DS3_v2
instance_count: 1
2 changes: 1 addition & 1 deletion .../single-model/conda-in-dockerfile/minimal-single-model-conda-in-dockerfile-deployment.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -20,5 +20,5 @@ environment:
scoring_route:
path: /score
port: 5001
instance_type: Standard_DS2_v2
instance_type: Standard_DS3_v2
instance_count: 1
2 changes: 1 addition & 1 deletion ...imal/single-model/pip-in-dockerfile/minimal-single-model-pip-in-dockerfile-deployment.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -20,5 +20,5 @@ environment:
scoring_route:
path: /score
port: 5001
instance_type: Standard_DS2_v2
instance_type: Standard_DS3_v2
instance_count: 1
2 changes: 1 addition & 1 deletion cli/endpoints/online/custom-container/mlflow/multideployment-scikit/mlflow-deployment.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -17,5 +17,5 @@ environment:
scoring_route:
path: /score
port: 5001
instance_type: Standard_DS2_v2
instance_type: Standard_DS3_v2
instance_count: 1
2 changes: 1 addition & 1 deletion cli/endpoints/online/custom-container/r/multimodel-plumber/r-deployment.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -22,5 +22,5 @@ environment:
scoring_route:
port: 8000
path: /score
instance_type: Standard_DS2_v2
instance_type: Standard_DS3_v2
instance_count: 1
2 changes: 1 addition & 1 deletion ...stom-container/tfserving/half-plus-two-integrated/half-plus-two-integrated-deployment.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -13,5 +13,5 @@ environment:
scoring_route:
port: 8501
path: /v1/models/hpt:predict
instance_type: Standard_DS2_v2
instance_type: Standard_DS3_v2
instance_count: 1
2 changes: 1 addition & 1 deletion cli/endpoints/online/custom-container/tfserving/half-plus-two/tfserving-deployment.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -22,5 +22,5 @@ environment:
scoring_route:
port: 8501
path: /v1/models/half_plus_two:predict
instance_type: Standard_DS2_v2
instance_type: Standard_DS3_v2
instance_count: 1
2 changes: 1 addition & 1 deletion cli/endpoints/online/custom-container/torchserve/densenet/torchserve-deployment.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -17,6 +17,6 @@ environment:
scoring_route:
port: 8080
path: /predictions/densenet161
instance_type: Standard_DS2_v2
instance_type: Standard_DS3_v2
instance_count: 1

2 changes: 1 addition & 1 deletion cli/endpoints/online/custom-container/torchserve/huggingface-textgen/ts-hf-tg-deployment.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -19,6 +19,6 @@ environment:
scoring_route:
port: 8080
path: /predictions/textgeneration
instance_type: Standard_DS2_v2
instance_type: Standard_DS3_v2
instance_count: 1

2 changes: 1 addition & 1 deletion cli/endpoints/online/managed/binary-payloads/binary-payloads-deployment.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -9,5 +9,5 @@ code_configuration:
environment:
image: mcr.microsoft.com/azureml/openmpi4.1.0-ubuntu20.04:latest
conda_file: env.yml
instance_type: Standard_DS2_v2
instance_type: Standard_DS3_v2
instance_count: 1
2 changes: 1 addition & 1 deletion cli/endpoints/online/managed/inference-schema/deployment-numpy.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -8,5 +8,5 @@ code_configuration:
environment:
image: mcr.microsoft.com/azureml/minimal-ubuntu20.04-py38-cpu-inference
conda_file: env.yml
instance_type: Standard_DS2_v2
instance_type: Standard_DS3_v2
instance_count: 1
2 changes: 1 addition & 1 deletion cli/endpoints/online/managed/inference-schema/deployment-pandas.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -8,5 +8,5 @@ code_configuration:
environment:
image: mcr.microsoft.com/azureml/minimal-ubuntu20.04-py38-cpu-inference
conda_file: env.yml
instance_type: Standard_DS2_v2
instance_type: Standard_DS3_v2
instance_count: 1
2 changes: 1 addition & 1 deletion cli/endpoints/online/managed/inference-schema/deployment-standard.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -8,5 +8,5 @@ code_configuration:
environment:
image: mcr.microsoft.com/azureml/minimal-ubuntu20.04-py38-cpu-inference
conda_file: env.yml
instance_type: Standard_DS2_v2
instance_type: Standard_DS3_v2
instance_count: 1
2 changes: 1 addition & 1 deletion cli/endpoints/online/managed/keyvault/README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -58,7 +58,7 @@ environment:
conda_file: env.yml
environment_variables:
KV_SECRET_MULTIPLIER: multiplier@https://<KV_NAME>.vault.azure.net
instance_type: Standard_DS2_v2
instance_type: Standard_DS3_v2
instance_count: 1
```

Expand Down
2 changes: 1 addition & 1 deletion cli/endpoints/online/managed/keyvault/keyvault-deployment.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -11,5 +11,5 @@ environment:
conda_file: env.yml
environment_variables:
KV_SECRET_MULTIPLIER: multiplier@https://<KV_NAME>.vault.azure.net
instance_type: Standard_DS2_v2
instance_type: Standard_DS3_v2
instance_count: 1
2 changes: 1 addition & 1 deletion cli/endpoints/online/managed/managed-identities/2-sai-deployment.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -8,7 +8,7 @@ code_configuration:
environment:
conda_file: ../../model-1/environment/conda-managedidentity.yml
image: mcr.microsoft.com/azureml/openmpi4.1.0-ubuntu20.04:latest
instance_type: Standard_DS2_v2
instance_type: Standard_DS3_v2
instance_count: 1
environment_variables:
STORAGE_ACCOUNT_NAME: "storage_place_holder"
Expand Down
2 changes: 1 addition & 1 deletion cli/endpoints/online/managed/managed-identities/2-uai-deployment.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -7,7 +7,7 @@ code_configuration:
environment:
conda_file: ../../model-1/environment/conda-managedidentity.yml
image: mcr.microsoft.com/azureml/openmpi4.1.0-ubuntu20.04:latest
instance_type: Standard_DS2_v2
instance_type: Standard_DS3_v2
instance_count: 1
environment_variables:
STORAGE_ACCOUNT_NAME: "storage_place_holder"
Expand Down
2 changes: 1 addition & 1 deletion cli/endpoints/online/managed/minimal/single-model-registered/deployment.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -8,5 +8,5 @@ code_configuration:
environment:
image: mcr.microsoft.com/azureml/minimal-ubuntu20.04-py38-cpu-inference:latest
conda_file: env.yml
instance_type: Standard_DS2_v2
instance_type: Standard_DS3_v2
instance_count: 1
2 changes: 1 addition & 1 deletion cli/endpoints/online/managed/openapi/README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -84,7 +84,7 @@ code_configuration:
environment:
image: mcr.microsoft.com/azureml/minimal-ubuntu20.04-py38-cpu-inference
conda_file: env.yml
instance_type: Standard_DS2_v2
instance_type: Standard_DS3_v2
instance_count: 1
```

Expand Down
2 changes: 1 addition & 1 deletion cli/endpoints/online/managed/openapi/deployment.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -9,5 +9,5 @@ code_configuration:
environment:
image: mcr.microsoft.com/azureml/minimal-ubuntu20.04-py38-cpu-inference
conda_file: env.yml
instance_type: Standard_DS2_v2
instance_type: Standard_DS3_v2
instance_count: 1
2 changes: 1 addition & 1 deletion cli/endpoints/online/managed/sample/blue-deployment.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -9,5 +9,5 @@ code_configuration:
environment:
conda_file: ../../model-1/environment/conda.yml
image: mcr.microsoft.com/azureml/openmpi4.1.0-ubuntu20.04:latest
instance_type: Standard_DS2_v2
instance_type: Standard_DS3_v2
instance_count: 1
2 changes: 1 addition & 1 deletion cli/endpoints/online/managed/sample/green-deployment.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -9,5 +9,5 @@ code_configuration:
environment:
conda_file: ../../model-2/environment/conda.yml
image: mcr.microsoft.com/azureml/openmpi4.1.0-ubuntu20.04:latest
instance_type: Standard_DS2_v2
instance_type: Standard_DS3_v2
instance_count: 1
2 changes: 1 addition & 1 deletion cli/endpoints/online/mlflow/lightgbm-deployment.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -6,5 +6,5 @@ model:
version: 1
path: lightgbm-iris/model
type: mlflow_model
instance_type: Standard_DS2_v2
instance_type: Standard_DS3_v2
instance_count: 1
2 changes: 1 addition & 1 deletion cli/endpoints/online/mlflow/sklearn-deployment-with-script.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -12,5 +12,5 @@ environment:
code_configuration:
code: sklearn-diabetes/src
scoring_script: score.py
instance_type: Standard_DS2_v2
instance_type: Standard_DS3_v2
instance_count: 1
2 changes: 1 addition & 1 deletion cli/endpoints/online/mlflow/sklearn-deployment.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -6,5 +6,5 @@ model:
version: 1
path: sklearn-diabetes/model
type: mlflow_model
instance_type: Standard_DS2_v2
instance_type: Standard_DS3_v2
instance_count: 1
2 changes: 1 addition & 1 deletion cli/jobs/pipelines-with-components/nyc_taxi_data_regression/deploy.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -2,5 +2,5 @@ $schema: https://azuremlschemas.azureedge.net/latest/managedOnlineDeployment.sch
name: demo
endpoint_name: reg-ep-1234
model: azureml://registries/<REGISTRY_NAME>/models/nyc-taxi-model/versions/<VERSION>
instance_type: Standard_DS2_v2
instance_type: Standard_DS3_v2
instance_count: 1
2 changes: 1 addition & 1 deletion ...thon/endpoints/online/custom-container/online-endpoints-custom-container-multimodel.ipynb
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -290,7 +290,7 @@
" \"scoring_route\": {\"path\": \"/score\", \"port\": 5001},\n",
" },\n",
" ),\n",
" instance_type=\"Standard_DS2_v2\",\n",
" instance_type=\"Standard_DS3_v2\",\n",
" instance_count=1,\n",
")"
]
Expand Down
4 changes: 2 additions & 2 deletions ...ython/endpoints/online/managed/debug-online-endpoints-locally-in-visual-studio-code.ipynb
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -91,7 +91,7 @@
" conda_file=\"../model-1/environment/conda.yml\",\n",
" image=\"mcr.microsoft.com/azureml/openmpi3.1.2-ubuntu18.04:20210727.v1\",\n",
" ),\n",
" instance_type=\"Standard_DS2_v2\",\n",
" instance_type=\"Standard_DS3_v2\",\n",
" instance_count=1,\n",
")\n",
"\n",
Expand Down Expand Up @@ -159,7 +159,7 @@
" conda_file=\"../model-2/environment/conda.yml\",\n",
" image=\"mcr.microsoft.com/azureml/openmpi3.1.2-ubuntu18.04:20210727.v1\",\n",
" ),\n",
" instance_type=\"Standard_DS2_v2\",\n",
" instance_type=\"Standard_DS3_v2\",\n",
" instance_count=2,\n",
")\n",
"\n",
Expand Down
2 changes: 1 addition & 1 deletion ...n/endpoints/online/managed/managed-identities/online-endpoints-managed-identity-sai.ipynb
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -178,7 +178,7 @@
" conda_file=\"../../model-1/environment/conda-managedidentity.yml\",\n",
" image=\"mcr.microsoft.com/azureml/openmpi4.1.0-ubuntu20.04:latest\",\n",
" ),\n",
" instance_type=\"Standard_DS2_v2\",\n",
" instance_type=\"Standard_DS3_v2\",\n",
" instance_count=1,\n",
" environment_variables={\n",
" \"STORAGE_ACCOUNT_NAME\": storage_account_name,\n",
Expand Down
2 changes: 1 addition & 1 deletion ...n/endpoints/online/managed/managed-identities/online-endpoints-managed-identity-uai.ipynb
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -181,7 +181,7 @@
" conda_file=\"../../model-1/environment/conda-managedidentity.yml\",\n",
" image=\"mcr.microsoft.com/azureml/openmpi4.1.0-ubuntu20.04:latest\",\n",
" ),\n",
" instance_type=\"Standard_DS2_v2\",\n",
" instance_type=\"Standard_DS3_v2\",\n",
" instance_count=1,\n",
" environment_variables={\n",
" \"STORAGE_ACCOUNT_NAME\": storage_account_name,\n",
Expand Down
2 changes: 1 addition & 1 deletion sdk/python/endpoints/online/managed/online-endpoints-binary-payloads.ipynb
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -232,7 +232,7 @@
" conda_file=\"binary-payloads/env.yml\",\n",
" image=\"mcr.microsoft.com/azureml/openmpi4.1.0-ubuntu20.04:latest\",\n",
" ),\n",
" instance_type=\"Standard_DS2_v2\",\n",
" instance_type=\"Standard_DS3_v2\",\n",
" instance_count=1,\n",
")"
]
Expand Down
6 changes: 3 additions & 3 deletions sdk/python/endpoints/online/managed/online-endpoints-inference-schema.ipynb
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -241,7 +241,7 @@
" image=\"mcr.microsoft.com/azureml/minimal-ubuntu20.04-py38-cpu-inference\",\n",
" conda_file=\"inference-schema/env.yml\",\n",
" ),\n",
" instance_type=\"Standard_DS2_v2\",\n",
" instance_type=\"Standard_DS3_v2\",\n",
" instance_count=1,\n",
")"
]
Expand Down Expand Up @@ -384,7 +384,7 @@
" image=\"mcr.microsoft.com/azureml/minimal-ubuntu20.04-py38-cpu-inference\",\n",
" conda_file=\"inference-schema/env.yml\",\n",
" ),\n",
" instance_type=\"Standard_DS2_v2\",\n",
" instance_type=\"Standard_DS3_v2\",\n",
" instance_count=1,\n",
")"
]
Expand Down Expand Up @@ -531,7 +531,7 @@
" image=\"mcr.microsoft.com/azureml/minimal-ubuntu20.04-py38-cpu-inference\",\n",
" conda_file=\"inference-schema/env.yml\",\n",
" ),\n",
" instance_type=\"Standard_DS2_v2\",\n",
" instance_type=\"Standard_DS3_v2\",\n",
" instance_count=1,\n",
")"
]
Expand Down
2 changes: 1 addition & 1 deletion sdk/python/endpoints/online/managed/online-endpoints-keyvault.ipynb
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -343,7 +343,7 @@
" environment_variables={\n",
" \"KV_SECRET_MULTIPLIER\": f\"multiplier@https://{keyvault_name}.vault.azure.net\"\n",
" },\n",
" instance_type=\"Standard_DS2_v2\",\n",
" instance_type=\"Standard_DS3_v2\",\n",
" instance_count=1,\n",
")"
]
Expand Down
2 changes: 1 addition & 1 deletion sdk/python/endpoints/online/managed/online-endpoints-multimodel.ipynb
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -309,7 +309,7 @@
" code=code_path, scoring_script=\"minimal-multimodel-score.py\"\n",
" ),\n",
" environment=f\"azureml:{environment.name}:{environment.version}\",\n",
" instance_type=\"Standard_DS2_v2\",\n",
" instance_type=\"Standard_DS3_v2\",\n",
" instance_count=1,\n",
")"
]
Expand Down
2 changes: 1 addition & 1 deletion sdk/python/endpoints/online/managed/online-endpoints-openapi.ipynb
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -222,7 +222,7 @@
" image=\"mcr.microsoft.com/azureml/minimal-ubuntu20.04-py38-cpu-inference\",\n",
" conda_file=\"openapi/env.yml\",\n",
" ),\n",
" instance_type=\"Standard_DS2_v2\",\n",
" instance_type=\"Standard_DS3_v2\",\n",
" instance_count=1,\n",
")"
]
Expand Down
4 changes: 2 additions & 2 deletions sdk/python/endpoints/online/managed/online-endpoints-safe-rollout.ipynb
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -222,7 +222,7 @@
" code_configuration=CodeConfiguration(\n",
" code=\"../model-1/onlinescoring\", scoring_script=\"score.py\"\n",
" ),\n",
" instance_type=\"Standard_DS2_v2\",\n",
" instance_type=\"Standard_DS3_v2\",\n",
" instance_count=1,\n",
")"
]
Expand Down Expand Up @@ -372,7 +372,7 @@
" code_configuration=CodeConfiguration(\n",
" code=\"../model-2/onlinescoring\", scoring_script=\"score.py\"\n",
" ),\n",
" instance_type=\"Standard_DS2_v2\",\n",
" instance_type=\"Standard_DS3_v2\",\n",
" instance_count=1,\n",
")"
]
Expand Down
4 changes: 2 additions & 2 deletions sdk/python/endpoints/online/managed/online-endpoints-simple-deployment.ipynb
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -202,7 +202,7 @@
" code_configuration=CodeConfiguration(\n",
" code=\"../model-1/onlinescoring\", scoring_script=\"score.py\"\n",
" ),\n",
" instance_type=\"Standard_DS2_v2\",\n",
" instance_type=\"Standard_DS3_v2\",\n",
" instance_count=1,\n",
")"
]
Expand Down Expand Up @@ -357,7 +357,7 @@
" code_configuration=CodeConfiguration(\n",
" code=\"../model-1/onlinescoring\", scoring_script=\"score.py\"\n",
" ),\n",
" instance_type=\"Standard_DS2_v2\",\n",
" instance_type=\"Standard_DS3_v2\",\n",
" instance_count=1,\n",
")"
]
Expand Down
2 changes: 1 addition & 1 deletion ...s/automl-classification-task-bankmarketing/automl-classification-task-bankmarketing.ipynb
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -690,7 +690,7 @@
" name=\"bankmarketing-deploy\",\n",
" endpoint_name=online_endpoint_name,\n",
" model=registered_model.id,\n",
" instance_type=\"Standard_DS2_V2\",\n",
" instance_type=\"Standard_DS3_V2\",\n",
" instance_count=1,\n",
" liveness_probe=ProbeSettings(\n",
" failure_threshold=30,\n",
Expand Down
2 changes: 1 addition & 1 deletion ...ml-regression-task-hardware-performance/automl-regression-task-hardware-performance.ipynb
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -700,7 +700,7 @@
" name=\"hardware-performance-deploy\",\n",
" endpoint_name=online_endpoint_name,\n",
" model=registered_model.id,\n",
" instance_type=\"Standard_DS2_V2\",\n",
" instance_type=\"Standard_DS3_V2\",\n",
" instance_count=1,\n",
" liveness_probe=ProbeSettings(\n",
" failure_threshold=30,\n",
Expand Down
2 changes: 1 addition & 1 deletion sdk/python/using-mlflow/deploy/mlflow_sdk_online_endpoints.ipynb
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -330,7 +330,7 @@
"outputs": [],
"source": [
"deploy_config = {\n",
" \"instance_type\": \"Standard_DS2_v2\",\n",
" \"instance_type\": \"Standard_DS3_v2\",\n",
" \"instance_count\": 1,\n",
"}"
]
Expand Down
2 changes: 1 addition & 1 deletion sdk/python/using-mlflow/deploy/mlflow_sdk_online_endpoints_progresive.ipynb
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -390,7 +390,7 @@
"outputs": [],
"source": [
"deploy_config = {\n",
" \"instance_type\": \"Standard_DS2_v2\",\n",
" \"instance_type\": \"Standard_DS3_v2\",\n",
" \"instance_count\": 1,\n",
"}"
]
Expand Down
2 changes: 1 addition & 1 deletion sdk/python/using-mlflow/deploy/scoring_to_mlmodel.ipynb
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -422,7 +422,7 @@
"import json\n",
"\n",
"deploy_config = {\n",
" \"instance_type\": \"Standard_DS2_v2\",\n",
" \"instance_type\": \"Standard_DS3_v2\",\n",
" \"instance_count\": 1,\n",
"}\n",
"\n",
Expand Down
Loading