Experiments with NoDB ideas.

Insipred by https://duckdb.org/2024/12/05/csv-files-dethroning-parquet-or-not.html

tl;dr

• CSV on S3
• Ingestion:
  • PostgreSQL CDC
  • PostgREST-like API
  • OTEL
• Upload to S3 every ~5 seconds
• Queries via S3 proxy for:
  • statistics
  • caching
  • predicate pushdown on virtual columns
• Dashboards:
  • GitHub Pages
  • DuckDB (Wasm)
  • Markdown

Examples

Real time notifications

---

Demo: ...

Tools: PostgreSQL CDC, WebSockets, and push notifications

---

Audit

---

Demo: ...

Tools: PostgreSQL CDC, S3

---

Basic product analytics

---

Demo: ...

Tools: PostgreSQL CDC, custom ingestion, DuckDB, and Markdown

---

Basic observability

---

Demo: ...

Tools: Telemetry, DuckDB, and Markdown

---

Next

• LZ4
• Parquet
• Delta / Iceberg