Skip to content

History / Runbook L1 Command Bus Cutover

Revisions

  • wiki(L1 round 4): prod deploy — EHDB bus ~2.4x faster than NATS (#205 closed) + writer-restart survival (#208 closed); T5 gate is now the user-pool autoscaler (#210); GMP-not-VM correction

    @akuksin akuksin committed Jul 31, 2026
  • L1 T4 COMPLETE — EHDB is the production command bus (full flip 80/80 on shastaratech prod) Runbook: status banner rewritten to SUCCESS; T4 go/no-go checklist cleared with the latency caveat + a new T5 checklist; prod execution log restructured into three rounds (held-at-canary / failed-on-#203 / succeeded) with the #203 root cause + fix + before-after table, the post-flip prod state, the rollback command, and the latency regression. Program page: L1 status T0-T4 done / T5 held; T4+T5 table rows rewritten. Home: program bullet leads with prod-command-bus state. Sessions-Log: new 2026-07-27 entry. Refs noetl/ai-meta#194, #202 (closed), #203 (closed), #205, #206

    @akuksin akuksin committed Jul 28, 2026
  • runbook(L1 T4): prod execution log — shastaratech 2026-07-26 Step0+Shadow PASS, held at canary (2-shard user-pool blocker) Records the executed T4 run on shastaratech prod: 2-shard deltas, Step 0 + Shadow PASS (0 divergence, 121 NATS == 121 EHDB), the per-shard user-pool canary blocker, the two forward paths (ai-meta#202), and the clean hold state (bus back on NATS). Refs noetl/ai-meta#194 #202.

    @claude claude committed Jul 27, 2026
  • runbook(L1 T4): findings resolved via subject-based routing; kind re-validated; prod-go-ready

    @claude claude committed Jul 22, 2026
  • runbook(L1 T4): kind-validated 2026-07-22 — correctness PASS, EHDB at NATS latency parity; 2 findings gate prod (pool routing MUST-FIX, addr IP:port)

    @claude claude committed Jul 22, 2026
  • docs(ehdb): L1 T4 pre-prod code merged — runbook env catalogue + status Cutover runbook: status banner → pre-prod code merged (path A claim RPC + server/worker NOETL_COMMAND_BUS flag + shadow KEDA), not deployed; the worker-image build + kind e2e + prod flip stay human-gated. Added the implemented env catalogue (NOETL_COMMAND_BUS_* — writer dir/binds/claim addr/ ack_wait) + the shadow/ehdb/nats mode semantics. Refs noetl/ai-meta#194

    @claude claude committed Jul 21, 2026
  • docs(ehdb): L1 T0-T3 shadow arc complete + T4 cutover runbook (prepared, gated) Program page: L1 T0-T3 status table (all merged; latency gate PASS, bus p99 137us). New Runbook-L1-Command-Bus-Cutover: the NOETL_COMMAND_BUS flag, cutover sequence + validation gates, go/no-go checklist, and the one-command rollback — PREPARED, NOT EXECUTED (T4/T5 human-gated). Sessions-Log + sidebar updated. Refs noetl/ai-meta#194

    @claude claude committed Jul 20, 2026