Mapping of DWH database tables to business entities, attributes & metrics in Python, with automatic creation of flattened tables
-
Updated
Nov 21, 2023 - Python
Mapping of DWH database tables to business entities, attributes & metrics in Python, with automatic creation of flattened tables
implementing an end-to-end tweets ETL/Analysis pipeline.
Data warehousing date dimension and time dimension builders written in Python.
Efficient YouTube data harvesting and warehousing with Python, SQL, MongoDB, and Streamlit, enabling seamless analysis and visualization for insightful decision-making in content management and audience engagement strategies
Date dimension based on Iranian calendar
This project goal is to design a Data Platform for retail Data Analytics.
Batch ETL pipeline project on GCP to load and transform daily flight data using Spark to update tables in BigQuery. The pipeline is automated using Airflow.
How to manage SCD2 with Apache Hive 1.1 and HBase 1.2 w/o HiveQL UPDATE operation
Data Modeling with Postgres and Python
Repository for tutorials, information and notes on technology in general.
Check daily covid information
YouTube Data Harvesting and Warehousing using SQL, MongoDB and Streamlit
ETLing Data to a Cloud Data Warehouse
Implementation ETL with Python for data integration workflows.
Space Exploration Data Fusion : Unleashing the International Space Station Insights with MongoDB and SQL Integration
Generate DDL and Python (PygramETL) code from shared specification
This project enables users to fetch data from YouTube by utilizing the YouTube Data API key. The retrieved data is then stored in a MySQL database. Subsequently, the stored data is analyzed and presented in a Streamlit web application using Pandas DataFrame.
Add a description, image, and links to the datawarehousing topic page so that developers can more easily learn about it.
To associate your repository with the datawarehousing topic, visit your repo's landing page and select "manage topics."