[#820 / 2] Pilot batch — Genesis (50 chapters)

[CraigBuckmaster]

Part of Epic #820 Hermeneutic Lenses. PILOT GATE — must ship clean before any other batch (#820/3 onward) opens.

Goal

Generate the first wave of curated-sparse lens content for all 50 Genesis chapters. Validates the entire pipeline end-to-end: AI generation, lens quality scorer, accuracy auditor (tier-2 strictest gate per Craig's setting), schema validator, DB build, R2 upload.

Workflow per chapter

In ephemeral /tmp/gen_genesis_lenses.py:

1. Load chapter content from content/genesis/{N}.json
2. For each lens, decide if it genuinely fits this chapter (typically 3–5 of 8)
3. Generate guidance + optional panel_filter + panel_order
4. Run python3 _tools/lens_quality_scorer.py --chapter gen{N} — reject + regenerate if any entry < 90
5. Run python3 _tools/accuracy_auditor.py --chapter meta_lens_gen{N} --tier 2 — reject + regenerate on tier-2 fail
6. Write content/hermeneutic_lenses/chapters/gen{N}.json

Output shape (per file)

{
  "lenses": [
    {
      "lens_id": "grammatical",
      "guidance": "80-280 chars, anchored to a real verse number or proper noun",
      "panel_filter": ["heb", "hist", "ctx", "lit"],
      "panel_order":  ["heb", "lit", "hist", "ctx"]
    }
  ]
}

Acceptance criteria

• All 50 Genesis chapter JSON files written
• Every entry scores ≥ 90 on lens_quality_scorer.py
• Every entry passes accuracy_auditor.py --tier 2
• schema_validator.py Section 21 passes
• DB rebuilds; chapter_lens_content row count between 150 and 250 (sanity bound for sparse coverage on 50 chapters)
• Manual smoke test on 5 chapters in dev build: lens toggle works, guidance shows, panels filter/reorder per Epic: Hermeneutic Lenses Content #820/1 wiring
• R2 upload succeeds, manifest delta lands

Pilot gate

If this batch ships clean, sub-issues #820/3 through #820/10 unblock and can run in parallel. If the pilot doesn't ship clean, no batches open until tooling/prompt issues are resolved.

Out of scope

• Any non-Genesis content
• Premium-tier gating changes (already wired)

[CraigBuckmaster]

Started — Genesis 1 ships as a single-chapter proof-of-concept in PR #1791 to validate the full pipeline before scaling.

What #1791 proved out

• ✅ Schema validator Section 21 fires on real content
• ✅ lens_quality_scorer.py --chapter gen1 runs end-to-end (caught a real regex bug; fixed in same PR)
• ✅ accuracy_meta_extractors.extract_hermeneutic_lenses() produces the right shape of claims for tier-2 audit
• ✅ build_sqlite.py populates chapter_lens_content correctly (6 rows for gen1)
• ✅ All 6 entries scored 100/100 on DVCR

Coverage decisions to lock in for the rest of the pilot

• Curated sparse: 6 of 8 lenses on Genesis 1 (skipped devotional + missional — those are better anchored to later texts)
• Most chapters will land at 3-5 lenses; Gen 1 is denser theologically so 6 is justified
• 80-280 char ceiling for guidance is workable but tight — it forces concise writing, which is good

What's next under this issue (#1781)

• Genesis 2-50 = 49 more chapters
• Batch sizing: ~10 chapters per session/PR for context-window safety
• Each batch goes through the same gate: schema_validator → lens_quality_scorer ≥90 → tier-2 accuracy audit (in CI)

Once #1791 merges and the tier-2 CI gate passes on it, batches will start in the next session.

[CraigBuckmaster]

Batch 1: Gen 2-10 — PR #1792

40 new entries across 9 chapters. Combined with #1791's gen1, the corpus is now 46 entries on 10 chapters, all 8 lens types represented (mission debuted on gen10).

Quality gate: 46/46 at 100/100 on the lens scorer locally. CI tier-2 audit running on the PR.

Pilot progress (50 chapters target)

• ✅ gen1 (PoC) — merged
• ✅ gen2-10 (batch 1) — PR feat(lenses): Genesis 2-10 lens content, batch 1 of pilot (#820, #1781) #1792 in flight
• ⏳ gen11-20 — batch 2 (next session)
• ⏳ gen21-30 — batch 3
• ⏳ gen31-40 — batch 4
• ⏳ gen41-50 — batch 5

Notes for the next batches

• Gen 11 is Babel — pairs with Gen 10's mission lens; will close the loop with gen10 explicitly
• Gen 12 is the missional turning point of the OT (Abrahamic call) — at least 6 lenses warranted
• Gen 22 (Abraham/Isaac) and Gen 49 (Jacob's blessing) are the two other theologically densest chapters in the rest of Genesis
• Most narrative chapters (Gen 13-20-ish, Gen 24-36) will probably land at 3-4 lenses each

[CraigBuckmaster]

Batch 2: Gen 11-20 — PR #1793

45 new entries across 10 chapters. Combined with prior batches, the corpus is now 91 entries on 20 chapters — 40% of the pilot done.

Quality gate: 91/91 passing on the lens scorer locally, avg 99.9/100. CI tier-2 audit running on the PR.

Highlights

• gen11 + gen12 form the missional arc: Babel's scattering → Abrahamic call → Pentecost reverse. Mission lens now has 3 entries.
• gen14: Melchizedek typology — the OT type that drives Hebrews 5-7.
• gen15: covenant ratification + v 6 (Paul's justification verse).
• gen17: circumcision → baptism (Col 2:11-12) typology.

Pilot progress (50 chapter target)

• ✅ gen1-10 (20% done)
• ✅ gen11-20 (40% done) ← this batch
• ⏳ gen21-30 (Sodom aftermath, Isaac/Rebekah cycle, beginning of Jacob)
• ⏳ gen31-40 (Jacob's transformation, Joseph's beginning)
• ⏳ gen41-50 (Joseph cycle, Jacob's blessing — gen49 is theologically dense)

Note for future batches

Theology-dense chapters wanted to spill past 280 chars consistently. Treating the ceiling as a hard 250 during drafting avoids the trim-iteration pattern. Will adjust drafting approach for batch 3.

[CraigBuckmaster]

Batch 3: Gen 21-30 — PR #1794

37 new entries across 10 chapters. Combined with prior batches, the corpus is now 128 entries on 30 chapters — 60% of the pilot.

Quality gate: 128/128 passing on the lens scorer locally, avg 99.9/100. CI tier-2 audit running on the PR.

Highlights

• gen22 (Akedah) at 6 lenses — densest theological chapter after Gen 1
• gen28 (Jacob's ladder) — typological/christocentric anchored on John 1:51
• gen25 (Esau-Jacob election) — anchored on Rom 9:10-13

Pilot progress (50 chapter target)

• ✅ gen1-10 (20%)
• ✅ gen11-20 (40%)
• ✅ gen21-30 (60%) ← this batch
• ⏳ gen31-40 (Jacob's transformation; Joseph cycle begins at ch 37)
• ⏳ gen41-50 (Joseph cycle conclusion; gen49 blessings)

Lens distribution so far (8/8 represented)

• redemptive 30, canonical 29, christocentric 20, grammatical 17
• typological 14, devotional 11, literary 4, mission 3