Skip to content

Developed an interactive dashboard utilizing Google Looker Studio to analyze Uber usage patterns in NYC. Designed a robust data model and implemented an efficient data pipeline using Mage AI on GCP's VM infrastructure. Utilized Google BigQuery for in-depth analytics and leveraged Google Cloud Platform for data processing.

Notifications You must be signed in to change notification settings

PreetKothari/Uber_etl_pipeline_data_analytics_project

Repository files navigation

NYC Uber Taxi Data Analysis | Data Engineering - Google Cloud Platform Project

Introduction

The goal of this project is to perform data analysis on NYC Uber Taxi data using various tools and technologies, including GCP Storage, Python, Compute Instance, Mage Data Pipeline Tool, BigQuery, and Looker Studio.

Architecture

Project Architecture

Technology Used

Programming Language:

  • Python
  • SQL Google Cloud Platform:
  • Google Storage
  • Compute Instance
  • BigQuery
  • Looker Studio Modern Data Pipeine Tool:
  • Mage: https://www.mage.ai/

Contribute to this open-source project - https://github.com/mage-ai/mage-ai

Dataset

TLC Trip Record Data Yellow and green taxi trip records include fields capturing pick-up and drop-off dates/times, pick-up and drop-off locations, trip distances, itemized fares, rate types, payment types, and driver-reported passenger counts.

Dataset used: https://github.com/PreetKothari/Uber_etl_pipeline_data_analytics_project/tree/main/Data

Website - https://www.nyc.gov/site/tlc/about/tlc-trip-record-data.page

Data Dictionary - https://www.nyc.gov/assets/tlc/downloads/pdf/data_dictionary_trip_records_yellow.pdf

Data Model

NY Taxi - Uber Data Model

About

Developed an interactive dashboard utilizing Google Looker Studio to analyze Uber usage patterns in NYC. Designed a robust data model and implemented an efficient data pipeline using Mage AI on GCP's VM infrastructure. Utilized Google BigQuery for in-depth analytics and leveraged Google Cloud Platform for data processing.

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published