Skip to content

History / Architecture

Revisions

  • docs: RFC DECIDED — EHDB completion program (event-log engine bottleneck fix + noetl self-sufficiency, platform-only); Roadmap Phases 6-10

    @kadyapam kadyapam committed Jul 5, 2026
  • docs: RFC — server↔EHDB coupling (loose) + EHDB as pluggable storage substrate (Phase 8); up for Codex review

    @kadyapam kadyapam committed Jul 5, 2026
  • docs: EHDB re-home COMPLETE — both PRs merged, #238 closed - Python retire noetl/noetl#691 MERGED (ff3a920f); Roadmap re-home → complete, #238 CLOSED. Architecture "Implemented" note updated. Sessions-Log entry. - worker-rust owns EHDB in-process (noetl/worker#153 d6226a2); Python path gone. Refs noetl/ehdb#234, closes noetl/ehdb#238

    @kadyapam kadyapam committed Jul 5, 2026
  • docs: EHDB worker integration re-homed into worker-rust (Rust-only); Python retired - Roadmap "Integration debt: re-home Phase B–D" → DONE: worker-rust owns the integration in-process (noetl/worker#153 MERGED d6226a2); Python retire (noetl/noetl#691) open awaiting review; kind-validated. - Architecture "Rust-first EHDB worker integration" decision → Implemented. - Sessions-Log: re-home + kind evidence entry. Refs noetl/ehdb#234, noetl/ehdb#238

    @kadyapam kadyapam committed Jul 5, 2026
  • docs: Rust-first EHDB worker-integration decision + Phase D pointer finalized Architecture: add 'Architecture Decision: Rust-first EHDB worker integration (Python as thin wrapper)' — engine already Rust; the Phase B–D Python glue in noetl/core is a disabled-default stopgap that does not run in the prod Rust worker; target = worker-rust owns the integration in-process against the ehdb crate; Python = thin binding (the Polars model). Roadmap: mark Phase E (system WASM store -> RAG) as Rust-first; add integration-debt item to re-home Phase B-D worker integration from Python into worker-rust (noetl/ehdb#238). Sessions-Log: entry for the decision + noetl#690 merge / ai-meta repos/noetl pointer finalization. Refs noetl/ehdb#234, noetl/ehdb#238 Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>

    @kadyapam kadyapam committed Jul 5, 2026
  • docs(phase-d): event-stream drain — Architecture + Roadmap (Done) + Sessions-Log Document integration Phase D (event-stream integration path): the bounded disabled-by-default worker/playbook/system durable-consumer drain (project/consume/ack), the event-log-authoritative invariant (EHDB is a derived consumer, never writes the NoETL event log), and the control-plane guard. Roadmap Phase D = Done, next = Phase E (system WASM store). EHDB noetl/ehdb#237 (3cefba9); NoETL noetl/noetl#690 (awaiting review). Tracks noetl/ehdb#234.

    @kadyapam kadyapam committed Jul 5, 2026
  • docs: EHDB integration Phase C — worker/playbook data-plane append/read step

    @kadyapam kadyapam committed Jul 5, 2026
  • docs: EHDB integration Phase B — worker/playbook readiness hook Architecture: add *Worker/Playbook Readiness Hook (Integration Phase B)* section (bounded stateless preflight, code-level control-plane guard, metrics, not-a-server-endpoint). Roadmap: mark integration Phase B DONE, add Phase C (bounded worker/playbook data-plane step) as next. Sessions-Log: Phase B integration entry. Lands with noetl/noetl#688 (merge 5960e91d). Tracks noetl/ehdb#234.

    @kadyapam kadyapam committed Jul 4, 2026
  • docs: EHDB integration Phase A — ops env-rendering boundary + disabled-by-default contract Ops/runtime enablement landed via noetl/ops#234. Document the control-plane vs data-plane env-rendering boundary (enforced in the Helm chart template, not values) and the disabled-by-default, byte-neutral contract on the Architecture page; mark integration Phase A DONE on the Roadmap. Refs noetl/ehdb#234

    @kadyapam kadyapam committed Jul 4, 2026
  • docs: add local reference summary helper

    @kadyapam kadyapam committed Jul 4, 2026
  • docs: document embedded NoETL role policy

    @kadyapam kadyapam committed Jul 3, 2026
  • docs: add noetl runtime surface fixture

    @kadyapam kadyapam committed Jul 3, 2026
  • docs: add core identifier json validation

    @kadyapam kadyapam committed Jul 2, 2026
  • docs: add schema json decode validation

    @kadyapam kadyapam committed Jul 2, 2026
  • docs: add schema column identifier revalidation

    @kadyapam kadyapam committed Jul 2, 2026
  • docs: add duplicate schema column validation

    @kadyapam kadyapam committed Jul 2, 2026
  • docs: add local arrow selector validation

    @kadyapam kadyapam committed Jul 2, 2026
  • docs: add local arrow projection validation

    @kadyapam kadyapam committed Jul 2, 2026
  • docs: add strict system library metadata decoding

    @kadyapam kadyapam committed Jun 25, 2026
  • docs: add strict retrieval metadata decoding

    @kadyapam kadyapam committed Jun 25, 2026
  • docs: add strict catalog metadata decoding

    @kadyapam kadyapam committed Jun 25, 2026
  • docs: add strict storage metadata decoding

    @kadyapam kadyapam committed Jun 25, 2026
  • docs: add strict system journal replay validation

    @kadyapam kadyapam committed Jun 25, 2026
  • docs: add strict transaction journal replay validation

    @kadyapam kadyapam committed Jun 25, 2026
  • docs: add strict stream journal replay validation

    @kadyapam kadyapam committed Jun 25, 2026
  • docs: add stream sequence replay validation

    @kadyapam kadyapam committed Jun 25, 2026
  • docs: add canonical retrieval receipt event validation

    @kadyapam kadyapam committed Jun 25, 2026
  • docs: add strict retrieval receipt event validation

    @kadyapam kadyapam committed Jun 25, 2026
  • docs: add canonical retrieval receipt payload validation

    @kadyapam kadyapam committed Jun 25, 2026
  • docs: add strict retrieval receipt payload validation

    @kadyapam kadyapam committed Jun 25, 2026