Skip to content

mmgxa/E3_S20

Repository files navigation

Session 20 - Kubeflow Pipelines on EKS

Overview

In this session, we deploy a pipeline in Kubeflow provisioned inside EKS. All steps in the pipeline are executed in custom Docker images. The model is trained on CPU and deployed using KServe.

Create Docker Images

Custom Docker images are built for each of the steps. The images are then pushed to ECR.

To see all the steps and the code, see the steps here.

Setup

All of these steps are mentioned in the setup guide.

Access Kubeflow UI

Once all the components are up and running, access the UI.

kubectl port-forward svc/istio-ingressgateway -n istio-system 8080:80

And browse to kubeflow.localhost:8080

email : user@example.com password : 12341234

Notebook

Use the image created in step 1 for the notebook.

Pipeline

Inside the notebook, start the notebook. Don't forget to add the authentication token from Brave's Developer Tools.

Subsequent Runs

Upon running the completed pipeline ,we see that the processing components is reused and taken from the cache.

Also, the model gets a new revision number.

Demo

Demo

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published