DataPipelineHW

This is a simple data pipeline project.

Requirements

Python 3.x
venv (for creating a virtual environment)
Dependencies (listed in requirements.txt)

Setup

Clone the repository:

git clone https://github.com/chellick/DataPipelineHW.git
cd DataPipelineHW

Create a virtual environment:

python -m venv venv

Activate the virtual environment:

On Windows:

.\venv\Scripts\activate

On Mac/Linux:

source venv/bin/activate

Install dependencies:

pip install -r requirements.txt

Usage

Run the pipeline:

python main.py