Skip to content

moritzkoerber/local-data-stack

Repository files navigation

Local data stack

This project demos how to integrate duckdb and delta lake with dbt, orchestrated by Dagster. The stack once per day queries data from a stock exchange (Xetra) through an API and does an incremental load into a medallion architecture. Finally, a simply line chart is created via Plotly. Overview:

Overview

How to run

Simply run $ uv run dg dev to launch the dagster webserver.

About

This project demos how to integrate duckdb and delta lake with dbt, orchestrated by Dagster.

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages