uber_data_engineering | Modern Data Engineering GCP Project

Introduction

The goal of this project is to perform data analytics on Uber data using various tools and technologies, including GCP Storage, Python, Compute Instance, Mage Data Pipeline Tool, BigQuery, and Looker Studio.

Architecture

Technology Used

1. Programming Language - Python
2. Scripting Language - SQL
3. Google Cloud Platform
   • BigQuery
   • Cloud Storage
   • Looker Studio
   • Compute Instance

Modern Data Pipeline Tool: https://www.mage.ai/

Dataset Used

TLC Trip Record Data Yellow and green taxi trip records include fields capturing pick-up and drop-off dates/times, pick-up and drop-off locations, trip distances, itemized fares, rate types, payment types, and driver-reported passenger counts.