An Akka Streams source of Azure Data Lake data
-
Updated
Jan 1, 2024 - Scala
An Akka Streams source of Azure Data Lake data
Batch process that compacts different parquet files stored at Azure Data Lake Storage following the requirements specified at README.
The idea is to connect to ADL storage (Azure Data Lake) from Databricks cluster and perform some Scala script on the ADL data.
Add a description, image, and links to the azure-data-lake topic page so that developers can more easily learn about it.
To associate your repository with the azure-data-lake topic, visit your repo's landing page and select "manage topics."