diff --git a/src/sagemaker/tensorflow/deploying_python.rst b/src/sagemaker/tensorflow/deploying_python.rst index 7126389084..6a7fc6c78b 100644 --- a/src/sagemaker/tensorflow/deploying_python.rst +++ b/src/sagemaker/tensorflow/deploying_python.rst @@ -25,6 +25,15 @@ like this: The code block above deploys a SageMaker Endpoint with one instance of the type 'ml.c4.xlarge'. +TensorFlow serving on SageMaker has support for `Elastic Inference `_, which allows for inference acceleration to a hosted endpoint for a fraction of the cost of using a full GPU instance. In order to attach an Elastic Inference accelerator to your endpoint provide the accelerator type to ``accelerator_type`` to your ``deploy`` call. + +.. code:: python + + predictor = estimator.deploy(initial_instance_count=1, + instance_type='ml.c5.xlarge', + accelerator_type='ml.eia1.medium' + endpoint_type='tensorflow-serving-elastic-inference') + What happens when deploy is called ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ diff --git a/src/sagemaker/tensorflow/deploying_tensorflow_serving.rst b/src/sagemaker/tensorflow/deploying_tensorflow_serving.rst index b2dc9d32fa..30de627a37 100644 --- a/src/sagemaker/tensorflow/deploying_tensorflow_serving.rst +++ b/src/sagemaker/tensorflow/deploying_tensorflow_serving.rst @@ -34,15 +34,6 @@ estimator object to create a SageMaker Endpoint: The code block above deploys a SageMaker Endpoint with one instance of the type 'ml.c5.xlarge'. -TensorFlow serving on SageMaker has support for `Elastic Inference `_, which allows for inference acceleration to a hosted endpoint for a fraction of the cost of using a full GPU instance. In order to attach an Elastic Inference accelerator to your endpoint provide the accelerator type to ``accelerator_type`` to your ``deploy`` call. - -.. code:: python - - predictor = estimator.deploy(initial_instance_count=1, - instance_type='ml.c5.xlarge', - accelerator_type='ml.eia1.medium' - endpoint_type='tensorflow-serving-elastic-inference') - What happens when deploy is called ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^