The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.

A curated list of awesome Amazon Web Services (AWS) libraries, open source repos, guides, blogs, and other resources. Featuring the Fiery Meter of AWSome.

A library that allows you to easily mock out tests based on AWS infrastructure.

Official s3cmd repo -- Command line tool for managing S3 compatible storage services (including Amazon S3 and CloudFront).

Continuous Archiving for Postgres

Utils for streaming large files (S3, HDFS, gzip, bz2...)

An end-to-end GoodReads Data Pipeline for Building Data Lake, Data Warehouse and Analytics Platform.

Example end to end data engineering project.

A Python-based application to backup Grafana settings by using the Grafana API

Directly upload files to S3 compatible services with Django.

Python pathlib-style classes for cloud storage services such as Amazon S3, Azure Blob Storage, and Google Cloud Storage.

Storage Explorer - Publicly open storage viewer (Amazon S3 Bucket, Azure Blob, FTP server, HTTP Index Of/)

A Python library that allows you to interact with Amazon S3 Buckets as if they are your local filesystem.

NoDB isn't a database.. but it sort of looks like one.

Astro SDK allows rapid and clean development of {Extract, Load, Transform} workflows using Python and SQL, powered by Apache Airflow.

🤖 State-of-the-art, production ready LLM apps made mega-easy, so you don't have to build them from scratch 🤯 Create a bot, now 🫵

Parallel uploads to Amazon AWS S3

Packaged version of ultralytics/yolov5 + many extra features

🗂️ a pleasant file explorer in your terminal supporting all filesystems

Jupyter Notebooks in S3 - Jupyter Contents Manager implementation