Pre-requisites Run save_keras_model.ipynb to save model in required format Tf serving: Steps: 1. Install docker into your system # For Ubuntu sudo apt install docker.io 2. Clone tensorflow serving git repo git clone https://github.com/tensorflow/serving 3. Pull Minimal Docker image for tf serving from Docker Hub docker pull tensorflow/serving 4. Start TensorFlow Serving container and open the REST API port bash run_tf_serving.sh 5. Query the model using the predict API run_prediction.sh