ETL pipeline tailored for Olympics data
-
Updated
Jun 12, 2024 - Python
ETL pipeline tailored for Olympics data
This repository contains code for an end-to-end IoT data pipeline using Azure services. It ingests, processes, and stores IoT device data from AWS S3 to Azure Data Lake Storage and Azure SQL Database, leveraging Azure Data Factory and Azure Functions for seamless integration and automation.
A repository to continue my education on Azure Data Services.
ETL motor racing data project using Azure Databricks, Pyspark and Azure Date Lakes
Streaming order book data using TD Ameritrade API
Cloud Based Sensoring Solution for flow telemetry. Shown here is an early stage sensoring prototype with azure based alerting and app deployment.
Azure Data Lake Gen2 storage connectors for Data Culpa - monitor data quality automatically with Data Culpa Validator
Add a description, image, and links to the azure-data-lake topic page so that developers can more easily learn about it.
To associate your repository with the azure-data-lake topic, visit your repo's landing page and select "manage topics."