RRK1000 / data-pipeline-example Public

Notifications You must be signed in to change notification settings
Fork 0
Star 0

A demo project leveraging Apache Kafka, Benthos, and a FastAPI server to stream and persist "real-time" dummy data into a PostgreSQL database within a containerised environment

0 stars 0 forks Branches Tags Activity

Notifications

Name		Name	Last commit message	Last commit date
Latest commit History 19 Commits
ingestion-svc		ingestion-svc
processing-svc		processing-svc
storage-svc		storage-svc
README.md		README.md
docker-compose.yaml		docker-compose.yaml

Repository files navigation

data-pipeline-example

This project is to demonstrate an integrated data pipeline designed to be independently deployable on the cloud

Overview

Components

About

A demo project leveraging Apache Kafka, Benthos, and a FastAPI server to stream and persist "real-time" dummy data into a PostgreSQL database within a containerised environment

golang kafka postgresql benthos fastapi

Report repository

Languages