PyJaws: A Pythonic Way to Define Databricks Jobs and Workflows
-
Updated
Jun 18, 2024 - Python
PyJaws: A Pythonic Way to Define Databricks Jobs and Workflows
2024 project
Pipeline to automate the collection of board game and expansion data from BoardGameGeek's XML API2. Data is stored in Google Cloud Storage and BigQuery. Data is modelled using DBT in a star schema. (Terraform, GCP, Mage, Python, dbt)
This project is the database migration pipline project using mage.ai.
an end-to-end data pipeline extracting music listening habits and producing an insightful dashboard
Add a description, image, and links to the mage topic page so that developers can more easily learn about it.
To associate your repository with the mage topic, visit your repo's landing page and select "manage topics."