dbt enables data analysts and engineers to transform their data using the same practices that software engineers use to build applications.

Python library and web service for Open Source Software Health and Sustainability metrics & data collection. You can find our documentation and new contributor information easily here: https://oss-augur.readthedocs.io/en/main/ and learn more about Augur at our website https://augurlabs.io

Few projects related to Data Engineering including Data Modeling, Infrastructure setup on cloud, Data Warehousing and Data Lake development.

MetricFlow allows you to define, build, and maintain metrics in code.

Linked Open Data Modeling Language

do more with dbt. dbt-fal helps you run Python alongside dbt, so you can send Slack alerts, detect anomalies and build machine learning models.

Amazon DynamoDB Data Modeling Course

Link Modeling Language (LinkML) model

Data processing and modelling framework for automating tasks (incl. Python & SQL transformations).

WG3 Metadata Specification

Automated assistance for the schema development lifecycle

The dbt adapter for Firebolt

Mapping of DWH database tables to business entities, attributes & metrics in Python, with automatic creation of flattened tables

An end-to-end data pipeline which extracts divvy bikeshare data from web loads it into data lake and datawarehouse transforms it using dbt and finally , a dashboard to visualize the data using looker studio, the pipeline is orchestrated using prefect

Development of the Gellish Communicator reference application and tools for universal data exchange and data integration supporting Formal English and other Gellish formalized natural languages.

tranSMART Arborist ETL toolkit

Amora Data Build Tool enables analysts and engineers to transform data on the data warehouse (BigQuery) by writing Amora Models that describe the data schema using Python's "PEP484 - Type Hints" and select statements with SQLAlchemy. Amora is able to transform Python code into SQL data transformation jobs that run inside the warehouse.

This repository serves as a comprehensive guide to effective data modeling and robust data quality assurance using popular open-source tools

An ETL pipeline that transfers data from files into a star schema data model in Postgres using Python and SQL

This project demonstrates how to build and automate an ETL pipeline using DAGs in Airflow and load the transformed data to Bigquery. There are different tools that have been used in this project such as Astro, DBT, GCP, Airflow, Metabase.