Skip to content

docs(fundamentals): add Architecture and Database pages#21494

Merged
bloxster merged 3 commits into
docs/prose-audit-2026-05-27from
docs/architecture-database-2026-05-28
May 29, 2026
Merged

docs(fundamentals): add Architecture and Database pages#21494
bloxster merged 3 commits into
docs/prose-audit-2026-05-27from
docs/architecture-database-2026-05-28

Conversation

@bloxster
Copy link
Copy Markdown
Collaborator

@bloxster bloxster commented May 28, 2026

Summary

Two new pages in Fundamentals:

  • /fundamentals/architecture — staged sync, modular processes, storage split, embedded Caplin, flat-KV state. Mermaid component diagram at the top.
  • /fundamentals/database — datadir layout, MDBX engine properties, immutable .seg snapshots, per-transaction history granularity, mainnet sizing, tuning flags, safe-to-delete table.

Stacked on #21451

Rebased on top of docs/prose-audit-2026-05-27 so links can target the renamed Prune Modes page. GitHub auto-retargets the base to release/3.4 once #21451 merges.

Verification

  • npm run build passes with onBrokenLinks/onBrokenAnchors: 'throw'
  • docs-site / build (incl. llms verification) ✓ pass
  • llms.txt and llms-full.txt regenerated

Notes

  • Sourced from the Improving-public-docs spec and the README.md "Datadir structure" / "Erigon3 datadir size" / "Modularity" sections. Once this lands, those README sections become safe to delete per the spec.
  • Adds @docusaurus/theme-mermaid@^3.10.0 (used by the architecture diagram).

Closes two of the largest content gaps identified in the
[Improving-public-docs](https://github.com/erigontech/erigon-documents/blob/master/public-docs/Improving-public-docs.md)
spec: the high-level Architecture overview and the deep-dive
Database / datadir page.

New pages:
- `/fundamentals/architecture` (sidebar_position 3)
  - At-a-glance ASCII component diagram
  - Staged Sync pipeline + Erigon 3 consolidation notes
  - Modular processes (Sentry/Downloader/Execution/RPC Daemon/TxPool/Caplin)
  - Storage model split (chaindata vs snapshots)
  - Embedded Caplin consensus layer
  - Flat KV state model + RPC-latency rationale
  - Prune-modes vs sync-modes clarification

- `/fundamentals/database` (sidebar_position 15)
  - Datadir directory tree with role per folder
  - MDBX engine properties (no compaction, mmap reads, single-writer)
  - Immutable .seg snapshots + BitTorrent distribution
  - Per-transaction history granularity
  - Real Nov-2024 mainnet + bor-mainnet sizing numbers
  - Why chaindata/ stays small (and is recoverable from snapshots)
  - Tuning flags (--batchSize, --db.size.limit, --db.read.concurrency)
  - Safe-to-delete subdirectories table

Cross-links: both pages link to each other plus existing pages
(Modules, Caplin, Optimizing Storage, Hardware Requirements, Sync Modes).
No content duplication with Optimizing Storage — that page covers
multi-disk tiering recipes, these pages cover concepts.

Sources: erigontech/erigon README "Datadir structure", "Erigon3 datadir
size", "Erigon3 changes from Erigon2", "Modularity", "More Efficient
State Storage" sections.

llms.txt and llms-full.txt (both static/ and root copies) regenerated.

Build: `pnpm run build` passes with onBrokenLinks/onBrokenAnchors: 'throw'.

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
No-op whitespace change. CI's `ci-gate.yml > changes` job consistently
classified this PR as `docs_site=false` across 3 attempts on the same
headSha, despite the PR's 45-file diff being entirely under
`docs/site/`. A fresh commit invalidates the cached path-filter view
and lets `docs-site / build` actually run and verify llms.txt is up
to date.

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
@bloxster bloxster marked this pull request as ready for review May 28, 2026 18:38
@bloxster bloxster changed the base branch from release/3.4 to docs/prose-audit-2026-05-27 May 28, 2026 18:43
…nnet sizing

- Architecture page: ASCII component diagram → Mermaid flowchart
- Database page: remove Polygon (bor-mainnet) disk-size block; we no
  longer maintain that chain
- Add @docusaurus/theme-mermaid@^3.10.0 and enable mermaid in config
- Regenerate llms-full.txt

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Copy link
Copy Markdown
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Adds two new Fundamentals documentation pages (Architecture and Database), wires up Docusaurus Mermaid support for the architecture diagram, and regenerates the llms.txt / llms-full.txt indexes accordingly.

Changes:

  • New fundamentals/architecture.md with a Mermaid component diagram and sections on staged sync, modular processes, storage model, embedded Caplin, flat KV state, and pruning.
  • New fundamentals/database.md covering datadir layout, MDBX properties, snapshot files, mainnet sizing, tuning flags, and safe-to-delete subdirectories.
  • Enables @docusaurus/theme-mermaid in docusaurus.config.ts and adds the dependency (with corresponding lockfile updates).

Reviewed changes

Copilot reviewed 8 out of 9 changed files in this pull request and generated no comments.

Show a summary per file
File Description
docs/site/docs/fundamentals/architecture.md New Architecture page with Mermaid diagram
docs/site/docs/fundamentals/database.md New Database page (datadir, MDBX, snapshots, tuning)
docs/site/docusaurus.config.ts Enable Mermaid markdown + theme
docs/site/package.json Add @docusaurus/theme-mermaid dep
docs/site/package-lock.json Lockfile updates for theme-mermaid + mermaid transitive deps
docs/site/static/llms.txt, llms.txt Add Architecture and Database entries to LLM index
docs/site/static/llms-full.txt, llms-full.txt Inline full text of the two new pages
Files not reviewed (1)
  • docs/site/package-lock.json: Language not supported

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

@bloxster bloxster merged commit f0b409c into docs/prose-audit-2026-05-27 May 29, 2026
6 checks passed
@bloxster bloxster deleted the docs/architecture-database-2026-05-28 branch May 29, 2026 07:52
@yperbasis
Copy link
Copy Markdown
Member

@bloxster This PR was merged not into main, but some other branch.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants