A Web Scraper for Best Buy TV Products with Data Visualization
-
Updated
Nov 2, 2023 - Python
A Web Scraper for Best Buy TV Products with Data Visualization
Integration of Covid-19 data utilising Azure Data Factory to perform data ingestion, transformation and storage activities. The goal of this guided project was to become familiar with Microsoft Azure technologies, including; Azure Data Factory(ADF), Azure Data Lake Storage Gen2, Azure SQL Database, Azure Blob Storage, Dataflow, Databricks, etc.
The data engineering project aims to migrate a company's on-premises database to Azure, leveraging Azure Data Factory for data ingestion, transformation, and storage. The project will implement a three-stage storage strategy, consisting of bronze, silver, and gold data layers (Medalion architecture). Documentation of the project is in PDF file.
Covid ETL Project using Azure Data Engineering Stack
Add a description, image, and links to the azuresqldb topic page so that developers can more easily learn about it.
To associate your repository with the azuresqldb topic, visit your repo's landing page and select "manage topics."