Data Engineering Intensive - Practices

Overview

Welcome to the Data Engineering Intensive - Practices project! This hands-on repository is designed to help you learn and practice the different concepts of data engineering including Data Pipelines, Cloud Computing, DBT, etc.

---

Hands-On Components

This project includes hands-on implementation of the following concepts:

• 02 - Deep Dive Into Data Engineering

  • 01 - Data Sources
    • Relational Database
    • Data Files
    • APIs

• TBA

---

Getting Started

Prerequisites

• Python 3.11 / 3.12 / 3.13

  • python --version

• pip

  • pip --version

• Git

1. Fork the repository to your GitHub account

• On teh GitHub repo, find and select 'Fork' on the top right conor

• On the page 'Create a new fork', select 'create fork'

• Clone teh repo to local

git clone <Replace with your repo URL>

2. Creat virtual environment (optional, but recommended)

Window

Create a virtual environment

python -m venv .venv

Activate the environment

.\.venv\Scripts\activate

3. Install packages

Using Pip to install packages from requirements.txt file

pip install -r requirements.txt

4. Happy Coding!

👨‍💻 👨‍💻

Author

Justin Nguyen - Data Engineer