Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.

Collection of Tools, Workflows and Processes to help Facilitate Archiving Scientific Data.

Batch Layer Processing and Export for GIMP 2.99.18

Efficient batch statistics computation library for Python.

Python GUI to interact with Whisperx

Flask server for Honeybee or Preview ( Function with Both webserver and logic server)

I'm documenting my learning of Data Engineering here.

The Python Thing-Doer

Batch multidimensional indexing for pytorch

A Python script to run a batch of images through ControlNet via A1111's API.

Manipulate the XML based *.mscx and *.mscz files of the notation software MuseScore.

Fully automated batch processing of Revit files with your own Python or Dynamo task scripts!

A Blender addon for batch converting 3D files and associated textures into other formats.

Bulk convert #Bitcoin private keys from extended hex to WIF.

Executor plugin interfacing Covalent with AWS Batch

Template-based file renaming utility

Discover real-time weather analysis through stream and batch processing with Apache Kafka, Apache Spark, and MySQL. This project seamlessly integrates both techniques to compute essential weather metrics, offering valuable insights into weather patterns. Join us in exploring dynamic weather datasets and uncovering actionable insights

Data Engineering Project using NYC Citi Bike data for years 2019, 2020, and 2023

Simple Work Queue for Parallel HTTP API Requests with Rate Limiting.

Tool to distribute a list of computational tasks over a pool of compute resources. The pool can grow or shrink.