Home

NoETL Ops

This wiki is the operational + deployment companion to noetl/ops. Topics that live in this repository — Kubernetes manifests, deployment playbooks, CI/CD, infrastructure automation — have their reference pages here.

For NoETL application documentation (Python API, DSL semantics, the v2 distributed-runtime spec, etc.) see the noetl/noetl wiki.

Where the manifests live. As of the Scope B consolidation (May 2026), all NoETL operational manifests live exclusively in noetl/ops/ci/manifests/. The previous parallel copy at noetl/noetl/ci/manifests/ was deleted; only a MOVED.md breadcrumb remains there. The automation/development/noetl.yaml playbook reads from local ci/manifests/... paths (no more cross-repo $NOETL_REPO/ci/manifests/...).

Pages

Manifests (ci/manifests/)

Page	What
KEDA Scaler	Worker-pool autoscaling via NATS JetStream consumer lag. Install Helm chart + apply ScaledObject.
NATS Supercluster	Multi-cluster JetStream topology with gateway-meshed clusters. Apply 2-cluster reference manifest.

Automation playbooks (automation/)

Page	What
GKE Helm install	Install + upgrade NoETL on GKE via the Helm chart + Cloud SQL + PgBouncer + chart-templated KEDA. The GKE deploy path the project supports.
Firestore MCP agent	Firestore document, event-log, replay, and batch helper methods used by domain playbooks.

(The automation/development/noetl.yaml kind playbook is currently documented inline in the noetl/noetl wiki under operational sections — will migrate here in a future Scope B refactor.)

Cross-references

• noetl/noetl wiki — application code.
• noetl/noetl — application repo.
• noetl/ops — this repo (deployment
  • automation).
• noetl/docs — design docs + feature specs (the v2 distributed-runtime spec lives there).