A stand-alone test framework that allows to write unit tests for Data Factory pipelines on Microsoft Fabric and Azure Data Factory.
A python application that leverages Microsoft Azure to build a fully functional trading system.
An end-to-end data engineering pipeline that fetches data from Wikipedia, cleans and transforms it with Apache Airflow and saves it on Azure Data Lake. Other processing takes place on Azure Data Factory, Azure Synapse and Tableau.
Data engineering project using Azure Data Factory and Apache Airflow
Formula 1 race data engineering project which utilises azure services and databricks to ingest and analyse the data.
Python script that cleans the JSON document used by an Azure Data Factory or Azure Synapse Copy Activity to specify the source-sink mapping.
A data pipeline project build on databricks and azure to demostrate lifecycle of a cloud data project.
A demand forecasting pipeline deployed on Azure and AWS
A B2B solution and architecture. This includes code for Azure Function App, SQL Server. Integration with azure synapse and event hubs as well.
A repository to continue my education on Azure Data Services.
Data pipeline that processes Formula1 data with Azure Databricks, DeltaLake, and Azure Data Factory
Unofficial samples that utilise Pigment's API to integrate with data movement and serverless solutions.
Using LLMS to extract medical Data for Doctors and Hospitals
This repository contains code for an end-to-end IoT data pipeline using Azure services. It ingests, processes, and stores IoT device data from AWS S3 to Azure Data Lake Storage and Azure SQL Database, leveraging Azure Data Factory and Azure Functions for seamless integration and automation.
Treinamento Azure Data Factory + Azure Databricks + Azure Analysis Services + Power BI
"Explore Formula 1 data analytics with this project. Leveraging the Ergast API, it utilizes Databricks Spark for ingestion, transformation, and analysis. ADLS acts as the storage layer, while Power BI visualizes the ADLS presentation layer. Uncover insights in the world of Formula 1 through powerful data analytics."
Azure Data Factory v2 datapipeline sample code snippets...
Add a description, image, and links to the azure-data-factory topic page so that developers can more easily learn about it.
To associate your repository with the azure-data-factory topic, visit your repo's landing page and select "manage topics."