-
Notifications
You must be signed in to change notification settings - Fork 0
Documentation Errata
This page audits documentation in the sw-mlpl source repository. Original audit: 2026-08-01. Resolution pass: 2026-08-02 -- the source docs were repaired against this list in commit 7a985122 (saga E4 step 009). Follow-up reconciliation: 2026-08-02 -- E4 subsequently closed in df7731b5 and the roadmap was reordered in 16f0d78f. The tables below preserve both the original findings and later status drift.
| Finding | Status | How it was addressed |
|---|---|---|
| E-001 CUDA guide "planned" | Resolved |
docs/using-cuda.md now opens with a SUPERSEDED banner pointing at the shipped scope (saga-cuda-foundation.md, saga-cuda-demo-parity.md); the stale status block was removed |
| E-002 broad GPU-training wording | Resolved for MLX; open for CUDA | E4 closed on 2026-08-02 with general resident-tape MLX training. CUDA still uses recognized gpu_step shapes until the deferred cuda-resident-tensors saga |
| E-003 root build commands | Resolved | README Quick Start and Development sections rewritten for component workspaces / --manifest-path
|
| E-004 configurations eras | Resolved (banner) |
docs/configurations.md opens with an errata note superseding the "planned" server sections and old install paths |
| E-005 architecture pre-CUDA | Resolved (banner) |
docs/architecture.md opens with an errata note: in-process CUDA slice shipped; peer service/distributed still future |
| E-006 MLX guide staleness | Resolved (banner) |
docs/using-mlx.md errata note: LoRA shipped, CUDA slice shipped, path mapping, and the E4 resident-tape supersession of the perf caveat; the LoRA section status flipped to SHIPPED |
| E-007 old monolith paths | Partially resolved | Banners in the affected guides state the components/<name>/crates/* mapping; a mechanical per-line path sweep remains future work |
| E-008 status.md scoreboard | Resolved as historical; banner drifted |
docs/status.md is correctly marked HISTORICAL and points to current sources, but its banner still says E4 is active and mHC planned-soon; see E-013 |
| E-009 Engram planned/implemented split | Resolved; status advanced | E1-E3 remain complete; E4 is now complete and E5 engram-mlx is the next substrate saga. E6-E9 and Engram CUDA remain deferred |
| E-010 mHC status | Superseded by roadmap reorder | mHC is not planned-soon now. CPU phases are parked behind MTP; MLX and CUDA phases are deferred. See E-014 |
| E-011 README counts conflict | Resolved | Hard-coded playground counts removed from README (generated content, labeled as such) |
| E-012 README backend roadmap | Resolved | README roadmap section rewritten: MLX/CUDA/Ollama framed by shipped scope with per-guide caveats |
Process rule instituted (same step): repository CLAUDE.md now carries a "Wiki errata discipline" section and the /mw-cp checkpoint playbook gained a docs-gate item -- any step that documents new features or flips a doc claim must update this page (and the affected wiki pages) in the same step.
The source repository moved again after the E-001 through E-012 repair. These are the current corrections as of 2026-08-02:
| Finding | Severity | Status | Current source of truth |
|---|---|---|---|
| E-013 historical status banner drift | Medium | Open |
docs/status.md still says E4 active and mHC planned-soon; docs/saga.md and docs/future-sagas-queue.md supersede those two phrases |
| E-014 mHC priority changed | Medium | Resolved in roadmap, stale elsewhere |
docs/future-sagas-queue.md parks mHC CPU work behind MTP and defers mHC accelerator work |
| E-015 E4 completion changed MLX scope | High | Resolved in current architecture/design docs |
docs/architecture.md, docs/future-saga-gpu-training.md, docs/saga.md, and docs/benchmarks.md now describe resident MLX training |
flowchart LR
E4[E4 resident MLX complete] --> E5[E5 Engram on MLX next]
E5 --> KV[KV cache]
KV --> MTP[MTP training]
MTP --> Spec[MTP self-speculation]
Spec --> MHC[mHC CPU phases parked behind MTP]
MHC --> MHCAccel[mHC accelerator phases deferred]
E5 --> EngramLater[Engram E6-E9 deferred]
EngramLater --> EngramCuda[Engram CUDA deferred]
Severity: Medium. Status: open. The historical banner added by the repair commit was directionally correct, but it froze two fast-moving statements: “E4 active” and “mHC planned-soon.” Later on 2026-08-02, E4 completed and the roadmap parked mHC behind MTP.
This does not make the old scoreboard authoritative again. Its pointers to CHANGES.md, docs/saga.md, docs/benchmarks.md, and docs/future-sagas-queue.md remain correct. The banner should eventually say E4 complete, E5 next, and mHC parked/deferred, or avoid duplicating live roadmap state altogether.
Severity: Medium. Status: roadmap corrected. The original audit requested an explicit mHC status, and the first repair described it as a bounded planned-soon track. User direction on 2026-08-02 reordered the queue:
- E5
engram-mlxremains next. - The MTP program follows E5: generation-state/KV cache, MTP training, then MTP self-speculation.
-
mhc-p1-constrained-transformsandmhc-p2-cpu-layerare parked behind MTP, not cancelled. -
mhc-p3-mlx-residentandmhc-cudaare deferred.
The authoritative record is the future sagas queue, not the older docs/status.md banner or research transcripts.
Severity: High. Status: resolved in current source docs. E4 replaced the eager per-operation MLX training path with a TensorHandle seam and device-resident autograd/optimizer state. General MLX models can now train resident; the old bespoke fast paths were demoted beneath the resident path. A small number of exact CPU kernels, notably fused cross-entropy backward, still cross the seam and are observable through counters.
The correction is backend-specific: CUDA has not yet implemented the resident DeviceOps seam and still relies on recognized per-shape GPU training routes. Current sources now state this distinction in architecture, the landed GPU-training design, the saga history, and benchmarks.
The original audit follows, unchanged except for this header.
Entries identify contradictions or likely stale material and point to stronger current evidence.
flowchart LR
Claim[Documentation claim] --> Current{Matches current source and history?}
Current -->|Yes| Use[Use as reference]
Current -->|No| Errata[Check this errata]
Errata --> Evidence[Prefer source, tests, CHANGES, completed saga]
Evidence --> Scope[Separate shipped slice from future scope]
Severity meanings:
- High: likely to cause a failed build, wrong platform decision, or materially false capability claim.
- Medium: wrong paths, versions, status, or counts that confuse navigation and onboarding.
- Low: historical wording or internal inconsistency with limited operational impact.
| Area | Severity | Stale or inconsistent claim | Current evidence |
|---|---|---|---|
| CUDA guide | High | CUDA is planned and not shipped | CUDA foundation and demo-parity sagas, crates, tests, and demos are present |
| GPU training scope | High | Broad wording can imply arbitrary MLX/CUDA training | General GPU-training design says only recognized shapes are accelerated today |
| Root build instructions | High | Run cargo build at repository root |
Current repository has cellular component workspaces and no root Cargo.toml
|
| Configuration guide | High | CLI server and connected web remain planned | Server, SSE, cancel, persistence, reattach, visualization storage, and web connect mode shipped |
| Architecture guide | High | CUDA in-process is planned/deferred | CUDA-enabled evaluator/server vertical slice is implemented |
| MLX guide | Medium | LoRA is planned; CUDA is the future second backend | LoRA and a CUDA vertical slice have shipped; persistent MLX tensor work is active |
| Paths throughout docs | Medium |
apps/mlpl-web, root crates/mlpl-*, and services/mlpl-mlx-serve
|
Current code lives primarily under components/*/crates/*
|
| Status scoreboard | High | Stops at v0.20-era roadmap and lists Engram only as generic planned Saga 18 | Engram E1-E3 completed, E4 is active, later Engram phases remain planned |
| Engram status | Medium | Older docs say Engram has no concrete API |
engram, apply_engram, engram_stats, hashes/gathers, tape path, and demos exist, while the overall track remains in progress |
| mHC status | Medium | Research documents discuss mHC without a current status landing page | mHC is planned soon, not shipped |
| Playground counts | Low | README says both 382 glossary entries and 377 alphabetical entries | Counts contradict within the same file and generated content changes frequently |
Severity: High. The CUDA guide says “planned,” “not yet shipped,” and describes Saga 17 as future work. The current repository contains components/cuda-rt, components/cuda-model, and components/cuda-eval, plus demos/lora_finetune_cuda.mlpl, published CUDA literate pages, and real-GPU parity tests.
Use CUDA foundation and CUDA demo parity for current implemented scope. Preserve an important qualification: a separate generalized CUDA service/distributed layer and arbitrary-model GPU autograd are not complete.
Severity: High. The README and older MLX/status prose can be read as saying autograd, optimizers, and train work generally on MLX. The actual backend design uses special accelerated paths for recognized LoRA and MLP shapes; an unsupported model can fall through to the CPU tape. The same issue applies to CUDA.
The authoritative limitation is documented in future general GPU training. The active persistent-tensor work is addressing this foundation. Documentation should eventually distinguish “same language remains correct,” “forward op dispatched,” and “entire training graph GPU-resident.”
Severity: High. The README shows root-level commands such as cargo build, cargo run -p mlpl-repl, and cargo bench -p mlpl-bench. The repository root currently has no Cargo.toml. Binaries and tools live in component workspaces such as components/cli, components/serve, and components/dev-tools.
Users must change into the owning component workspace or pass --manifest-path. Demo file paths must then be adjusted relative to that workspace.
Severity: High. The header says it is current through v0.18.0 and early sections acknowledge shipped server/MLX-service slices. Later sections still title the CLI server “planned” and list mlpl-serve, mlpl-repl --connect, and web origin routing as planned. Those later claims are superseded by Saga 21 and 21.5 implementation.
The same file refers to old install paths such as apps/mlpl-repl. Use the CLI server guide for the shipped REST/SSE, cancellation, persistence, reattach, visualization, and connected-browser surface, while also applying path erratum E-007.
Severity: High. The architecture guide labels in-process CUDA planned/deferred and presents R2/R3 as the only CUDA future. The current code has an in-process CUDA feature and a CUDA-enabled mlpl-serve vertical slice on Linux/NVIDIA.
The future separate CUDA peer service, multi-GPU/distributed operations, and discovery are still not shipped. A future documentation update should show both the current in-process CUDA server and the planned symmetric peer topology.
Severity: Medium. The MLX guide correctly documents early MLX behavior and poor eager round-trip performance, but still calls LoRA planned and CUDA a future backend. Both have since gained shipped slices. Its old crates/mlpl-mlx and crates/mlpl-eval paths also predate component decomposition.
The performance caveat remains valuable. It should now be paired with the active persistent-tensor/Metal work and with a precise distinction between supported fast paths and general training.
Severity: Medium. Examples include:
-
apps/mlpl-webin the README, REPL guide, server guide, and configuration guide. -
crates/mlpl-eval,crates/mlpl-serve,crates/mlpl-cli, andcrates/mlpl-benchin multiple guides. -
services/mlpl-mlx-servein status/architecture-era prose.
Current equivalents generally live under a component workspace, for example components/web/crates/mlpl-web, components/eval/crates/mlpl-eval, components/serve/crates/mlpl-serve, and components/dev-tools/crates/mlpl-bench. Exact crate ownership should be resolved from current component manifests because decomposition continues.
Severity: High. The status page ends its completed table around v0.20 and presents CUDA-as-a-service as wholly planned. It does not capture the later CUDA foundation/demo parity work or the active Engram E1-E4 sequence recorded in CHANGES.md, docs/saga.md, and .agentrail/plan.md.
It remains useful as historical release context but should not be used alone to answer “what exists today?”
Severity: Medium. Older files such as docs/status.md, docs/plan.md, docs/missing-demos.md, docs/gaps-to-be-addressed.md, and docs/are-we-driven-yet.md describe Engram generically as future research or lacking an API. Current source and references contain:
-
ngram_hashandgather_rowsprimitives. -
engram(...),apply_engram(...), andengram_stats(...). - Differentiation and training through the Engram path.
- Engram Hash, Learnable Phrase Memory, and Tiny LM + Engram demos.
- Completed E1-E3 records.
The correction is not “Engram is finished.” The Engram saga plan is a multi-stage E1-E10 effort. E4 persistent GPU tensors is active, with MLX, import/retrofit, large-model, checkpoint/scaling, and CUDA phases still ahead.
Severity: Medium. Research and paper-driven documents discuss mHC, and are-we-driven-yet correctly identifies only partial prerequisites such as ModelSpec; constrained projections and the mHC architecture graph do not exist as completed capability.
At this snapshot, mHC is planned soon. It should be clearly listed in a current roadmap/status document before readers can reliably distinguish it from implemented paper-driven features.
Severity: Low. The README introduction says the playground has 63 demos, 58 lessons, and a 382-entry glossary. Its glossary section later says 377 alphabetical entries. At least the glossary counts cannot both describe the same snapshot. Demos, lessons, and glossary data are generated/evolving, so hard-coded counts should be generated during the page build or labeled with a build date.
Severity: Medium. The README groups using-mlx.md and using-cuda.md under “forward-looking, not yet shipped,” despite MLX having shipped long ago and the current CUDA vertical slice being implemented. using-ollama.md is similarly framed by an older Saga-19 status even though llm_call and :ask work exist in native paths.
The original maintenance list is retained here as an audit record. Items 1-7 were addressed by the 2026-08-02 repair commit through rewrites, generated-count removal, or explicit supersession banners:
- Fix root build/install commands for component workspaces.
- Replace
docs/using-cuda.mdwith a current shipped-scope guide. - Rewrite the configuration and architecture matrices around current local/server/peer modes.
- Add explicit GPU-residency and fallback language to every accelerator claim.
- Refresh
docs/status.mdwith CUDA, post-v0.20 work, Engram E1-E4, and mHC planned-soon status. - Mechanically update former
apps,crates, andservicespaths. - Generate playground content counts from the registry at build time.
The remaining current documentation work is narrower:
- Update the
docs/status.mdhistorical banner so it does not say E4 is active or mHC planned-soon. - Continue the mechanical old-path sweep beyond the high-visibility banners.
- Keep CUDA wording explicit that general resident-tape training awaits
cuda-resident-tensors. - Avoid copying fast-moving roadmap ordering into historical status pages; link to
docs/future-sagas-queue.mdinstead.
This audit focuses on high-visibility user, deployment, backend, architecture, status, Engram, and mHC documentation. It is not a line-by-line verification of every historical plan or research transcript. Planning files are expected to preserve historical ideas; the issue is when they are linked or labeled as current reference without a supersession notice.