wiki: prod CQRS rollout (ops#200) RECORDED + LIVE-PROD e2e validation — 28/30 execs PASS, sole-writer + clean-chain + never-scan, prod healthy on the new path Sessions-Log entry + Home Last-refreshed + Releases ops row for the prod CQRS publish-only + off-server state-builder cutover validated under real production load (validates the prior session's executed flip). Refs noetl/ai-meta#103/#107/#111.

kadyapam committed Jun 21, 2026

Sessions-Log + Home: PROD CQRS cutover executed (server v3.39.1 / worker v5.40.2, gate-ON validated) Prod GKE flipped to CQRS publish-only + off-server state builder, gate-ON validated (materializer sole writer, never-scan, roots=1/terminals=1/ dangling=0). One-time owner-applied prev_event_id migration + GSM pg_noetl_k8s stale-secret finding recorded. Tracks #103/#107/#115/#111. Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>

kadyapam committed Jun 21, 2026

#119 + #118 SHIPPED + gate-ON kind-validated + CLOSED — off-server restart-rehydration unblocks the terminal-finalize FinalizedGuard; single+multi-replica blemish-free

kadyapam committed Jun 20, 2026

#118 fix shipped for review (FinalizedGuard) + #119 filed (off-server WAL-drain stall blocks integration) - Home: #118 row → In progress (corrected root cause = duplicate finalize, not link_batch bypass; server#253 + e2e#73); new #119 row; Last refreshed prepend. - Sessions-Log: 2026-06-20 entry — fix + unit proof + integration blocked by #119 + cluster restored to baseline.

kadyapam committed Jun 20, 2026

#118 — add single-replica terminal-finalize chain-fork to Home active umbrellas (follow-up of #117)

kadyapam committed Jun 20, 2026

#117 SHIPPED — off-server spine ordered by prev_event_id chain + walked from real tip worker v5.40.1 (worker#122 baeae78) + e2e #72 cdf1768. High-concurrency fan-out reduce wedge fixed: the off-server from_events spine was sorted by event_id; the worker walked from max(event_id) but the real causal tip is event_ids.last() (ChainHeads watermark), so under a fan-out id-inversion the max-id walk missed the inverted tip and the reduce never fired. Now builds from expected_head + orders by the prev_event_id chain walk. 2-replica affinity gate-ON stress: 6/6 iterations, 108/108 execs COMPLETE, 15 real id-inversions all fired reduce_customer + completed. Single-replica 7/8 (1 fail = separate pre-existing terminal-finalize race, non-wedging). Updated: Sessions-Log (new entry), Releases (worker v5.40.1 row + last refreshed), Home (last refreshed + recently-closed #117), Umbrella-Decoupled- Context-Event-Chain (#117 sibling note).

kadyapam committed Jun 20, 2026

docs(wiki): #116 program-scale step 2 — execution-affinity write ordering shipped + multi-replica validated Umbrella Recent-activity + Next-steps, Home (Last refreshed + ecosystem-map server cell v3.39.0 + #115 row + sessions/releases previews), Sessions-Log, Releases (server v3.39.0). #117 follow-up linked.

kadyapam committed Jun 20, 2026

#115 program-scale step 1: multi-replica coherence data layer (server v3.38.0) + execution-affinity staged Home (Last refreshed + ecosystem map server v3.38.0 + sessions/releases previews), Sessions-Log (full entry), Releases (v3.38.0 row), Umbrella-Decoupled-Context-Event-Chain (program-scale activity row). NATS-KV-backed ChainHeads + ExecDescriptor (NOETL_REPLICA_COHERENCE=nats_kv, default local); single-replica parity proven, 2-replica resolves proven, full completion staged on execution-affinity.

kadyapam committed Jun 20, 2026

wiki: #115 Phase 5 atomic-working-item context (tenet 6) shipped — server v3.37.0 + worker v5.40.0 Home (Last refreshed + Active-umbrella #115 + Ecosystem map server v3.37.0/worker v5.40.0 + Sessions/Releases preview), Sessions-Log (Phase 5 entry), Releases (server v3.37.0 + worker v5.40.0 rows), Umbrella-Decoupled-Context-Event-Chain (Phase 5 plan row SHIPPED + activity log + §6.3 #77-dependency resolved).

kadyapam committed Jun 20, 2026

#115 Phase 6 SHIPPED — hot-path noetl.event read class retired (audit-only); server v3.36.0 + ops + e2e Home (Last refreshed + #115 umbrella status + server ecosystem cell v3.35→v3.36 + sessions/releases previews), Sessions-Log (new entry), Releases (v3.36.0 row), Umbrella-Decoupled-Context-Event-Chain (Recent activity Phase 6 row). Gate-ON literal-zero validated: hot-path scan Δ0 + drive state_build Δ0 ⇒ ZERO noetl.event scans on the hot path end-to-end; audit/replay still work. RFC never-scan end state (tenet 3) reached under the flag. Default event_scan, prod unchanged.

kadyapam committed Jun 20, 2026

docs(wiki): #115 Phase 4 REMAINDER — stateless off-server drive edge (server v3.35.0 + worker v5.39.0 + e2e) Home (Last refreshed + #115 umbrella row + server/worker ecosystem version cells → v3.35.0 / v5.39.0), Sessions-Log (new 2026-06-20 entry), Releases (server v3.35.0 + worker v5.39.0 rows), Umbrella-Decoupled- Context-Event-Chain (Recent-activity row + Phase 4 marked COMPLETE in Next-concrete-steps). Zero server state rebuild + zero noetl.event reads on the drive path under offserver; completes #107 step 2 server-side.

kadyapam committed Jun 20, 2026

#115 Phase 4 DRIVE CUTOVER shipped + gate-ON parity-validated — worker v5.38.0 + server v3.34.0 + ops + e2e Home (Last refreshed + #115 umbrella row + worker/server ecosystem version cells), Sessions-Log (new top entry), Releases (worker v5.38.0 + server v3.34.0 rows + preamble), Umbrella-Decoupled-Context-Event-Chain (status + Recent-activity row).

kadyapam committed Jun 20, 2026

docs(wiki): #115 Phase 4 KERNEL+FLAG SHIPPED + shadow kind-validated (worker v5.37.0 + server v3.33.0) Off-server state builder: pool-side WAL chain index + chain-walk spine (parity by construction) + cache keyed by immutable chain head (CacheHit/Incremental/ ColdRebuild) + live WAL shadow loop, gate-ON kind-validated (993 WAL events / 0 noetl.event scans / 28 cold + 21 incremental / fresh fan-out COMPLETED, sole-writer + lag-0). Drive cutover staged. Home (Last refreshed + #115 row + server/worker version cells + Sessions/Releases previews), Sessions-Log, Releases, and Umbrella-Decoupled-Context-Event-Chain (Recent activity + Next steps) updated in lockstep with the ai-meta pointer bumps.

kadyapam committed Jun 20, 2026

docs(wiki): #115 Phase 3 MERGED (server v3.32.0) + Phase 4 (off-server state builder) started Home (Last refreshed + #115 row + server v3.32.0 ecosystem cell + Sessions/Releases previews), Sessions-Log, Releases (timeline row + Last refreshed), and Umbrella-Decoupled-Context-Event-Chain (Recent activity + Next steps) updated in lockstep with the ai-meta repos/server pointer bump to 8338417.

kadyapam committed Jun 19, 2026

#115 Phase 3 IMPLEMENTED + kind-validated (chain-walk state builder, server#245 open) Home (Last refreshed + #115 umbrella row), Sessions-Log (Part B entry filled in), and the umbrella page (status header + Recent-activity row + Next-steps Phase 3→implemented) drift together. Chain-walk state builder behind NOETL_STATE_BUILD_MODE: parity 41/41 match, no-scan proven (event_scans=0, 1064 PK hops), all topologies COMPLETE gate-ON. PR open for review; ai-meta repos/server pointer bump staged for after merge.

kadyapam committed Jun 19, 2026

#115 Phase 2 MERGED → pointers bumped (server v3.31.0 + noetl ecd16a2) + Phase 3 started Part A close-out of the one-level event chain. Home (Last refreshed + ecosystem server v3.31.0 / noetl ecd16a2 cells + #115 umbrella row + Releases preview), Sessions-Log (new top entry), Releases (timeline + per-repo server v3.31.0 row + Last refreshed), and the umbrella page (status header + Recent-activity row + Next-steps Phase 2→merged / Phase 3→in-progress) all drift together. Phase 3 (chain-walk state builder, server-side, flagged NOETL_STATE_BUILD_MODE default event_scan) now in progress.

kadyapam committed Jun 19, 2026

#115 Phase 2 implemented + kind-validated: one-level prev_event_id event chain (server#244 + noetl#667 open, awaiting merge)

kadyapam committed Jun 19, 2026

#115 Phase 1 shipped: references-in-state consume side (closed #113 + #114) Home (Last refreshed + #115 active row Phase-1 status + #101 consume-side-done + removed closed #113/#114 from active + added to Recently closed + server v3.30.0 / worker v5.36.0 ecosystem cells), Sessions-Log (new entry prepended), Releases (timeline + per-repo server v3.30.0 + worker v5.36.0 rows + lead), Umbrella-Decoupled-Context-Event-Chain (Status + Phase 1 ✅ SHIPPED + Recent activity + Next steps). worker#117 (v5.36.0) + server#243 (v3.30.0); all 9 #113 stalls COMPLETE gate-ON.

kadyapam committed Jun 19, 2026

RFC #115: Decoupled Context + Event Chain — file design + dashboard wiring New Umbrella-Decoupled-Context-Event-Chain.md (full RFC). Wires the dashboard per wiki-maintenance Rule 0a: Home Active-umbrellas row + Last-refreshed headline, Sessions-Log entry, _Sidebar link, and a reframe banner + Home-row note on Umbrella-Orchestrator-Scaling (#101). Refs noetl/ai-meta#115

kadyapam committed Jun 19, 2026

#114: oversized command.issued offload shipped (server v3.29.5); #101 consume side is the remaining off-server-drive cutover blocker Home (Last refreshed + #114 active-umbrella row + ecosystem-map server v3.29.5 + sessions/releases previews) + Sessions-Log entry + Releases v3.29.5 row + Umbrella-Orchestrator-Scaling Recent-activity row + Next-steps (#101 consume side).

kadyapam committed Jun 19, 2026

#113: off-server drive payload-size + cancel fix (server v3.29.4); #114 opened for distinct oversized-command stall Home (active umbrellas +#113/#114, Last refreshed, ecosystem-map server v3.29.4, sessions+releases previews) + Sessions-Log entry + Releases v3.29.4 row.

kadyapam committed Jun 19, 2026

docs(home,sessions): fill #103 GKE pre-flip pointer (ops 9edd9c4 / ai-meta e5b6d6c, PR #197) Replace the OPS_SHA_TBD placeholder left when the entry was written before the ops pointer bump landed. ops PR #197 merged as 9edd9c4; ai-meta pointer bump is e5b6d6c.

kadyapam committed Jun 19, 2026

wiki: #103 GKE pre-flip prep landed — prod images pushed, GMP monitoring live, manifests staged (Home/Sessions/Umbrella)

kadyapam committed Jun 19, 2026

wiki: materializer-lag guardrail shipped (#103 pre-flip observability gate) — Home/Sessions/Releases/Umbrella

kadyapam committed Jun 19, 2026

#103 server CQRS cutover COMPLETE — FLIP-READY (cancel/finalize through the chokepoint, server v3.29.3) Home (Last refreshed + #103/#104/#111 rows + ecosystem map server cell v3.28.0→v3.29.3 + Sessions/Releases previews), Sessions-Log (new top entry), Releases (v3.29.3 row + lead), Umbrella-Orchestrator-Scaling (Recent-activity row + Next-concrete-steps = flip-ready).

kadyapam committed Jun 19, 2026

#104 off-server-drive × gate reconciliation PROVEN; server v3.29.2 + e2e gate rig - Home: Last refreshed; #104 + #111 Active-umbrella rows; Sessions-log + Releases previews. - Sessions-Log: new 2026-06-19 entry (off-server-drive × gate proof, cold-cache rebuild, gate rig). - Releases: server v3.29.2 row + Last refreshed. - Umbrella-Event-WAL-Storage: Recent activity row + Next-concrete-steps (flip readiness).

kadyapam committed Jun 19, 2026

docs: #103 ack-after-materialize cascade landed (tools 3.13.0 + worker 5.34.0 + ops#194; pointers bumped)

kadyapam committed Jun 19, 2026

docs: #103 ack-after-materialize durability resolved + fault-tested (deferred ack + worker materializer loop)

kadyapam committed Jun 19, 2026

dashboard: #103 gate-on sole-writer PROVEN end-to-end (catalog_id FK fix → v3.29.1)

kadyapam committed Jun 19, 2026

dashboard: #103 clean-cluster soak — server cutover re-proven; materializer playbook lost-events bug staged (ops#192)

kadyapam committed Jun 18, 2026