Workflow Engine for Kubernetes
-
Updated
May 26, 2024 - Go
Workflow Engine for Kubernetes
Fancy stream processing made operationally mundane
The open source high performance ELT framework powered by Apache Arrow
lakeFS - Data version control for your data lake | Git for data
Memphis.dev is a highly scalable and effortless data streaming platform
Apache DevLake is an open-source dev data platform to ingest, analyze, and visualize the fragmented data from DevOps tools, extracting insights for engineering excellence, developer experience, and community growth.
Compute over Data framework for public, transparent, and optionally verifiable computation
A collection of online resources to help you on your Tech journey.
Conduit streams data between data stores. Kafka Connect replacement. No JVM required.
Substation is a toolkit for routing, normalizing, and enriching security event and audit logs.
A lightweight CLI tool for versioning data alongside source code and building data pipelines.
Transform your pythonic research to an artifact that engineers can deploy easily.
Service for bulk-loading data to databases with automatic schema management (Redshift, Snowflake, BigQuery, ClickHouse, Postgres, MySQL)
Beneath is a serverless real-time data platform ⚡️
rtdl makes it easy to build and maintain a real-time data lake
A Kubernetes Operator to orchestrate Benthos pipelines
Go library to create and manage data pipelines on your machine
Synchronize Postgres to Snowflake in near-real time with one simple application
Preludio is a data wrangling language based on PRQL and written in Go. 🎭
Add a description, image, and links to the data-engineering topic page so that developers can more easily learn about it.
To associate your repository with the data-engineering topic, visit your repo's landing page and select "manage topics."