Data Engineering examples for Airflow, Prefect; dbt for BigQuery, Redshift, ClickHouse, Postgres, DuckDB; PySpark for Batch processing; Kafka for Stream processing
airflow kafka spark pyspark prefect airflow-dags ksqldb typer-cli dbt-bigquery dbt-postgres dbt-clickhouse dbt-redshift
-
Updated
Feb 19, 2025 - Python