Collection of Databricks and Jupyter Notebooks
-
Updated
Mar 11, 2024 - Jupyter Notebook
Collection of Databricks and Jupyter Notebooks
Databricks ETL Pipeline for retrieving and processing NI TestStand test results, featuring a well-documented notebook for ETL operations, Data Lake for storage, Spark SQL+Python for transformations, and Power BI as the final visualization of factory metrics.
building a real-world data pipeline in Azure Data Factory (ADF) dataset provided by https://www.ecdc.europa.eu/ ingesting data from sources such as HTTP and Azure Blob Storage into Azure Data Lake Gen2 using ADF. transformed data and loaded transformed data using Databricks Notebook Activity in Azure Data Factory (ADF) and load into Azure Data L…
Add a description, image, and links to the azure-sql-database topic page so that developers can more easily learn about it.
To associate your repository with the azure-sql-database topic, visit your repo's landing page and select "manage topics."