The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.

Python SQL Parser and Transpiler

the portable Python dataframe library

Compare tables within or across databases

Chat snowflake database - Text to SQL

⚡ Data quality testing for the modern data stack (SQL, Spark, and Pandas) https://www.soda.io

🎣 List of `pre-commit` hooks to ensure the quality of your `dbt` projects.

Snowflake Snowpark Python API

Scan databases and data warehouses for PII data. Tag tables and columns in data catalogs like Amundsen and Datahub

Better SQL in Jupyter. 📊

One framework to develop, deploy and operate data workflows with Python and SQL.

Snowflake CLI is an open-source command-line tool explicitly designed for developer-centric workloads in addition to SQL operations.

ingestr is a CLI tool to copy data between any databases with a single command seamlessly.

locopy: Loading/Unloading to Redshift and Snowflake using Python.

Astro SDK allows rapid and clean development of {Extract, Load, Transform} workflows using Python and SQL, powered by Apache Airflow.

Simple DDL Parser to parse SQL (HQL, TSQL, AWS Redshift, BigQuery, Snowflake and other dialects) ddl files to json/python dict with full information about columns: types, defaults, primary keys, etc. & table properties, types, domains, etc.

LiDAR snowfall simulation

A Streamlit app that provides insights on your Snowflake account usage.

Learn how to auto-ingest streaming data into Snowflake using Snowpipe.

Code and tutorial to develop a real time data pipeline and a Streamlit app that consumes this data.