index.rst

Deploy Models with SageMaker

Examples on how to host models for predictions, inference, and transformations with SageMaker.

Batch transform

../sagemaker_batch_transform/index

Bring your own container

bring_your_own_container

Data types

data_types

Model Compilation with Neo

../sagemaker_neo_compilation_jobs/index

Model deployment

../introduction_to_amazon_algorithms/xgboost_abalone/xgboost_inferenece_script_mode ../advanced_functionality/tensorflow_iris_byom/tensorflow_BYOM_iris ../advanced_functionality/kmeans_bring_your_own_model/kmeans_bring_your_own_model ../advanced_functionality/xgboost_bring_your_own_model/xgboost_bring_your_own_model

Elastic inference

../sagemaker-python-sdk/mxnet_mnist/mxnet_mnist_elastic_inference ../sagemaker-python-sdk/mxnet_mnist/mxnet_mnist_elastic_inference_local ../sagemaker-python-sdk/mxnet_onnx_eia/mxnet_onnx_eia

Inference-Recommender

../sagemaker-inference-recommender/inference-recommender ../sagemaker-inference-recommender/xgboost/xgboost-inference-recommender ../sagemaker-inference-recommender/sklearn-inference-recommender/sklearn-inference-recommender ../sagemaker-inference-recommender/tensorflow-cloudwatch/tf-cloudwatch-inference-recommender ../sagemaker-inference-recommender/huggingface-inference-recommender/huggingface-inference-recommender

Endpoints

endpoints

Model monitor

../sagemaker_model_monitor/index

Multi-Model Deployment

../advanced_functionality/multi_model_sklearn_home_value/sklearn_multi_model_endpoint_home_value

Nvidia Triton Inference

../sagemaker-triton/resnet50/triton_resnet50 ../sagemaker-triton/nlp_bert/triton_nlp_bert