A microservices-based Streaming and Batch data processing in Cloud Foundry and Kubernetes
This repository includes a small project that includes main ML topics as a reference.
This Ads Data Pipeline simulates and processes company and Google advertising data, calculating key performance metrics in real time. It stores the data in MongoDB, schedules regular updates, and saves processed statistics to CSV files for further analysis.
Data pipeline using Databricks asset bundle & dbt
Repo that relates to the Medium blog 'Creating serverless data pipelines with Azure Functions and Azure Pipelines'
Building a four-step data pipeline using Airflow to download podcast episodes.
Add a description, image, and links to the datapipelines topic page so that developers can more easily learn about it.
To associate your repository with the datapipelines topic, visit your repo's landing page and select "manage topics."