Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
6 changes: 3 additions & 3 deletions docs/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -4,12 +4,12 @@

* Intel-Optimized TensorFlow (*coming soon*)
* Intel-Optimized TensorFlow Serving:
* [Installation Guide](general/tensorflow_serving/InstallationGuide.md)
* [General Best Practices](general/tensorflow_serving/GeneralBestPractices.md)
* [Installation Guide](/docs/general/tensorflow_serving/InstallationGuide.md)
* [General Best Practices](/docs/general/tensorflow_serving/GeneralBestPractices.md)
## Tutorials by Use Case

* Intel-Optimized TensorFlow (*coming soon*)
* Intel-Optimized TensorFlow Serving:
* [Image Recognition](image_recognition/tensorflow_serving/Tutorial.md) (ResNet50 and InceptionV3)
* [Image Recognition](/docs/image_recognition/tensorflow_serving/Tutorial.md) (ResNet50 and InceptionV3)
* Object Detection (*coming soon*)

2 changes: 1 addition & 1 deletion docs/general/tensorflow_serving/GeneralBestPractices.md
Original file line number Diff line number Diff line change
Expand Up @@ -86,5 +86,5 @@ Figure 1. NCHW format
- ***TENSORFLOW_SESSION_PARALLELISM*** = *num_physical_cores*/4
3. Use NCHW data format for images
4. See one of the hands-on tutorials for an advanced walkthrough of your use case:
* [Image Recognition](https://github.com/NervanaSystems/intel-models/blob/master/docs/image_recognition/tensorflow_serving/Tutorial.md) (ResNet50 and InceptionV3)
* [Image Recognition](/docs/image_recognition/tensorflow_serving/Tutorial.md) (ResNet50 and InceptionV3)
* Object Detection (*coming soon*)
12 changes: 6 additions & 6 deletions docs/image_recognition/tensorflow_serving/Tutorial.md
Original file line number Diff line number Diff line change
Expand Up @@ -11,12 +11,12 @@ It also provides sample code that you can use to get your optimized TensorFlow m
## Prerequisites

This tutorial assumes you have already:
* [Installed TensorFlow Serving](https://github.com/NervanaSystems/intel-models/blob/master/docs/general/tensorflow_serving/InstallationGuide.md)
* Read and understood the [General Best Practices](https://github.com/NervanaSystems/intel-models/blob/master/docs/general/tensorflow_serving/GeneralBestPractices.md),
* [Installed TensorFlow Serving](/docs/general/tensorflow_serving/InstallationGuide.md)
* Read and understood the [General Best Practices](/docs/general/tensorflow_serving/GeneralBestPractices.md),
especially these sections:
* **Performance Metrics**
* **TensorFlow Serving Configuration Settings**
* Ran an example end-to-end using a GRPC client, such as the one in the [Installation Guide](https://github.com/NervanaSystems/intel-models/blob/master/docs/general/tensorflow_serving/InstallationGuide.md)
* Ran an example end-to-end using a GRPC client, such as the one in the [Installation Guide](/docs/general/tensorflow_serving/InstallationGuide.md#option-2-using-grpc-this-is-the-fastest-method-but-the-client-has-more-dependencies)

## Background

Expand All @@ -31,8 +31,8 @@ Tuning TensorFlow Serving to take full advantage of your hardware for image reco
## Hands-on Tutorial - ResNet50 or InceptionV3

For steps 1 and 2, refer to the Intel Model Zoo FP32 benchmarks:
* [ResNet50 README](https://github.com/NervanaSystems/intel-models/tree/master/benchmarks/image_recognition/tensorflow/resnet50#fp32-inference-instructions)
* [InceptionV3 README](https://github.com/NervanaSystems/intel-models/tree/master/benchmarks/image_recognition/tensorflow/inceptionv3#fp32-inference-instructions)
* [ResNet50 README](/benchmarks/image_recognition/tensorflow/resnet50#fp32-inference-instructions)
* [InceptionV3 README](/benchmarks/image_recognition/tensorflow/inceptionv3#fp32-inference-instructions)

1. **Download the Model**: Download and extract the ResNet50 or InceptionV3 pre-trained model (FP32), using the instructions in one of the READMEs above.

Expand Down Expand Up @@ -81,7 +81,7 @@ For steps 1 and 2, refer to the Intel Model Zoo FP32 benchmarks:
For example, for a machine with `Core(s) per socket: 28` and `Socket(s): 2`, *num_physical_cores* = 28 * 2 = 56.

7. **Start the server**: Now let's start up the TensorFlow model server. To optimize overall performance, use the following recommended settings from the
[General Best Practices](https://github.com/NervanaSystems/intel-models/blob/master/docs/general/tensorflow_serving/GeneralBestPractices.md):
[General Best Practices](/docs/general/tensorflow_serving/GeneralBestPractices.md):
* OMP_NUM_THREADS = *num_physical_cores*
* TENSORFLOW_SESSION_PARALLELISM = *num_physical_cores*/4

Expand Down