A portable Datamart and Business Intelligence suite built with Docker, Mage, dbt, DuckDB and Superset
-
Updated
Nov 9, 2024 - Dockerfile
#
mage-ai
Here are 31 public repositories matching this topic...
The Zoomcamp MLOps Course covers tools like MLflow, Mage, Flask, Prometheus, Evidently, Grafana, Prefect, Terraform, and GitHub Actions. It emphasizes experiment tracking, model deployment, monitoring, CI/CD, and orchestration, culminating in an end-to-end project integrating best practices in MLOps.
flask aws streaming monitoring mongodb model grafana orchestration batch-processing prefect mlops mlflow mage-ai
-
Updated
Feb 18, 2025 - Jupyter Notebook
The CNPJ Data ETL Pipeline is designed to automate the download, processing, and storage of public CNPJ data from the Brazilian Federal Revenue. The pipeline is built with Mage.ai and AWS S3 to ensure efficient data management and scalability.
data-storage data-engineering cloud-computing public-data data-processing data-pipeline amazon-s3 etl-pipeline script-automation mage-ai cnpj-data
-
Updated
Feb 3, 2025 - Python
An end-to-end data engineering pipeline project that processes and analyzes Maintenance Work Orders using Mage, Docker, Google BigQuery, MariaDB, and Looker Studio. It features a seamless integration of cloud and open-source tools for scalable data storage, transformation, and visualization.
python bigquery data automation cloud sql database docker-compose virtual-machine excel gcp mariadb orchestration data-engineering maintenance database-schema compute-engine work-orders visualization-dashboard mage-ai
-
Updated
May 23, 2025 - Jupyter Notebook
# 🇧🇷 CNPJ Data PipelineUm script modular e configurável para processar arquivos CNPJ da Receita Federal do Brasil. 🐙 Este projeto oferece suporte a múltiplos bancos de dados e permite o processamento inteligente de mais de 50 milhões de empresas.
data-storage data-engineering cloud-computing public-data data-processing data-pipeline amazon-s3 etl-pipeline script-automation mage-ai cnpj-data
-
Updated
Jul 7, 2025 - Python
End-to-end data engineering project
-
Updated
Jul 19, 2023 - Jupyter Notebook
A data engineering project built around Smogon's Stats API.
-
Updated
Nov 21, 2024 - Python
Data modeling and ETL pipeline for data analytics on Uber dataset using Google cloud storage, BigQuery, and Looker Studio
-
Updated
Sep 19, 2023 - Jupyter Notebook
Solutions for @DataTalksClub's Data Engineering Zoomcamp 2024.
python docker workflow data-science database etl docker-compose orchestration datascience data-engineering data-analysis etl-pipeline de-zoomcamp mage-ai
-
Updated
Mar 4, 2024 - Jupyter Notebook
An end to end Data Engineering Project
data-engineering data-analytics data-modeling python-pandas data-visualization-project data-engineering-pipeline gcp-project looker-studio mage-ai
-
Updated
Jan 23, 2024 - Jupyter Notebook
Docker image for Mage AI deployment using Docker
-
Updated
Dec 23, 2024 - Dockerfile
-
Updated
Jan 8, 2024 - Python
A full data pipeline project. from the ETL to the Dashboard
-
Updated
May 25, 2023 - Jupyter Notebook
Data Engineering Pipeline for Uber Data Analysis using Google Cloud Platform, Mage-AI and Looker
-
Updated
Feb 23, 2024 - Jupyter Notebook
This repository contains the research, code, and examples related to the orchestration of data pipelines using a microservices architecture. The project explores the challenges of constructing modern data-centric pipelines and evaluates the role of orchestration tools in Data Science workflows.
-
Updated
Mar 17, 2025
In this project, I built a data pipeline using Mage.ai for ETL, GCP for storage, BigQuery for querying, and Looker Studio for analytics. This project helped me learn how to process, store, and visualize data effectively using modern tools.
-
Updated
Jan 22, 2025 - Jupyter Notebook
An end-to-end data engineering project using Amazon S3, EC2, mage.io, Google BigQuery and Looker.
-
Updated
Aug 12, 2023 - Jupyter Notebook
Personal project for Data Engineering Zoomcamp
-
Updated
Apr 13, 2024 - Jupyter Notebook
Improve this page
Add a description, image, and links to the mage-ai topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the mage-ai topic, visit your repo's landing page and select "manage topics."