Skip to content

A small but powerful tool to design, simulate, and visualize data pipelines from a simple config file.

Notifications You must be signed in to change notification settings

JinnbeamHH/pipeline-visualizer

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

3 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

🧩 Data Pipeline Visualizer & Simulator

A lightweight Streamlit app that reads a YAML pipeline config, visualizes it as a DAG, and simulates an ETL run.

🔥 Features

  • DAG graph built with networkx + pyvis
  • Step-by-step ETL simulation
  • Upload your own config files
  • Easy to run: no DBs, no logins, just streamlit run app.py

🛠️ Getting Started

git clone https://github.com/HanseJinn/pipeline-visualizer.git
cd pipeline-visualizer
pip install -r requirements.txt
streamlit run app.py

About

A small but powerful tool to design, simulate, and visualize data pipelines from a simple config file.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages