Skip to content

Latest commit

 

History

History
 
 

03-orchestration

Folders and files

NameName
Last commit message
Last commit date

parent directory

..
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

3. Orchestration and ML Pipelines

This section of the repo contains Python code to accompany the videos that show how to use Prefect for MLOps. We will create workflows that you can orchestrate and observe.

3.1 Introdution to Workflow Orchestration

3.3 Prefect Workflow

3.5 Working with Deployments

3.6 Prefect Cloud (optional)

3.7 Homework

More information here.

Quick setup

Install packages

In a conda environment with Python 3.10.12 or similar, install all package dependencies with

pip install -r requirements.txt

Start the Prefect server locally

Create another window and activate your conda environment. Start the Prefect API server locally with

prefect server start

Alternative to self-hosted server use Prefect Cloud for added capabilties

Signup and use for free at https://app.prefect.cloud

Authenticate through the terminal with

prefect cloud login

Use your Prefect profile to switch between a self-hosted server and Cloud.

Notes

Did you take notes? Add them here:

Notes 2022 Edition

To read the notes from the previous edition, see here