Skip to content

Latest commit

 

History

History
40 lines (24 loc) · 2 KB

training_the_model.md

File metadata and controls

40 lines (24 loc) · 2 KB
Raw

Training the model

By this point, you should have a Jupyter Notebook running at http://127.0.0.1:8000.

Download training files

Open the Jupyter Notebook interface and create a new Terminal by clicking on New -> Terminal. In the Terminal, clone this git repo by executing: git clone https://github.com/kubeflow/examples.git.

Now you should have all the code required to complete training in the examples/github_issue_summarization/notebooks folder. Navigate to this folder. Here you should see two files:

  • Training.ipynb
  • seq2seq_utils.py

Perform training

Open Training.ipynb. This contains a complete walk-through of downloading the training data, preprocessing it and training it.

Run the Training.ipynb notebook, viewing the output at each step to confirm that the resulting models produce sensible predictions.

Export trained model files

After training completes, download the resulting files to your local machine. The following files are needed for serving:

  • seq2seq_model_tutorial.h5 - the keras model
  • body_pp.dpkl - the serialized body preprocessor
  • title_pp.dpkl - the serialized title preprocessor

If you haven't already, clone the kubeflow/examples repo locally, then issue the following commands to place these three files into the github_issue_summarization/notebooks folder on your local machine:

cd github_issue_summarization/notebooks
PODNAME=`kubectl get pods --namespace=${NAMESPACE} --selector="app=jupyterhub" --output=template --template="{{with index .items 0}}{{.metadata.name}}{{end}}"`
kubectl --namespace=${NAMESPACE} cp ${PODNAME}:/home/jovyan/examples/github_issue_summarization/notebooks/seq2seq_model_tutorial.h5 .
kubectl --namespace=${NAMESPACE} cp ${PODNAME}:/home/jovyan/examples/github_issue_summarization/notebooks/body_pp.dpkl .
kubectl --namespace=${NAMESPACE} cp ${PODNAME}:/home/jovyan/examples/github_issue_summarization/notebooks/title_pp.dpkl .

Next: Serving the model