A curated list of awesome big data frameworks, ressources and other awesomeness.

The Cloud Operational Data Store: use SQL to transform, deliver, and act on fast-changing data.

Privacy and Security focused Segment-alternative, in Golang and React

Hydra: Column-oriented Postgres. Add scalable analytics to your project in minutes.

data load tool (dlt) is an open source Python library that makes data loading easy 🛠️

2019新型冠状病毒疫情时间序列数据仓库 | COVID-19/2019-nCoV Infection Time Series Data Warehouse

The dbt-native data observability solution for data & analytics engineers. Monitor your data pipelines in minutes. Available as self-hosted or cloud service with premium features.

🔥🔥🔥 Open Source Alternative to Hightouch, Census, and RudderStack - Reverse ETL & Data Activation

Few projects related to Data Engineering including Data Modeling, Infrastructure setup on cloud, Data Warehousing and Data Lake development.

[NOT MAINTAINED] Light-weight Python OLAP framework for multi-dimensional data analysis

TensorBase is a new big data warehousing with modern efforts.

Open source SQL Query Assistant service for Databases/Warehouses

Useful scripts, udfs, views, and other utilities for migration and data warehouse operations in BigQuery.

Scratch is a swiss army knife for big data.

Personal Data Engineering Projects

Optimus is an easy-to-use, reliable, and performant workflow orchestrator for data transformation, data modeling, pipelines, and data quality management.

Data API Framework for AI Agents and Data Apps

Supercharge BigQuery with BigFunctions

DomainMOD is an open source application written in PHP & MySQL used to manage your domains and other internet assets in a central location. DomainMOD also includes a Data Warehouse framework that allows you to import your web server data so that you can view, export, and report on your live data.

One framework to develop, deploy and operate data workflows with Python and SQL.