0. Prerequisites

Install Docker Desktop

1. Docker Build

docker build -f Dockerfile.local . -t gx/gxdemo:local

2. Docker Run

docker run -p 8888:8888 -it -v ${pwd}:/app --name gx_demo gx/gxdemo:local

3. Run Great Expectations Init

Go to Docker Desktop. Find your container. Go to "Exec". Run: great_expectations init

4. Open Jupyter Notebook

Find the link in the terminal that you ran Docker Run in Navigate to the Jupyter Notebook tab and open the Notebook

5. Step Through Jupyter Notebook (Yellow Taxi - Manual Expectations)

Load one Parquet File (Yellow Taxi)

Create Expectations & Suite Manually

Import Next Parquet File - validation fails

Adjust Expectations - validation succeeds

6. Step Through Jupyter Notebook (Green Taxi - User Configurable Profiling)

Import New Parquet File (Green Taxi)

Import Next Parquet - Validate Expectations - validation fails

Configure Green Taxi Dataset (All Parquet Files) & Auto-Profile over Batched Dataset

Validate Expectations on second Green Taxi file - validation now succeeds