Skip to content

v2.0.0: Scholarly-Quality Translation Overhaul

Choose a tag to compare

View all tags
@CraigVG CraigVG released this 24 Mar 22:04
· 19 commits to main since this release
v2.0.0
9696fd1

What Changed

Major translation quality overhaul responding to scholarly community feedback. Every translation with Latin/Greek source text has been independently verified.

Translation Quality

  • Benchmark score: 3.54 → 4.38 (exceeds 4.0 target and 4.14 human reference)
  • 5,162 letters fully audited (100% of letters with source text)
  • ~217 fabricated translations found and fixed across all collections
  • New scholarly translation pipeline emphasizing fidelity over readability
  • 54 author-specific voice profiles for accurate register

Data Fixes

  • 3,026 AI metadata headers ("From:/To:/Date:") stripped from all translations
  • 1,628 New Advent advertising texts stripped from 19th-century translations
  • 535+ Isidore template/paraphrase translations replaced with real translations from Greek
  • 190 Hormisdas boilerplate context blocks replaced with real translations from Latin
  • 134 duplicate/misattributed records removed (99 Augustine staging, 34 Gregory duplicates, 1 Gregory IX misattribution)
  • 343 Isidore letters re-OCR'd from Patrologia Graeca page scans using Gemini Vision

UI Improvements

  • Translation source badges on every letter page (green = human, amber = AI-assisted)
  • Scholarly mode hides AI translations, shows only pre-existing scholarly sources

Infrastructure

  • scripts/scholarly_translate.py — new translation pipeline
  • scripts/benchmark_translations.py — blind comparison scoring system
  • scripts/scholarly_validate.py — automated quality checks
  • scripts/ocr_patrologia_graeca.py — Gemini Vision OCR pipeline for PG volumes
  • data/author_prompts.json — 54 author voice/style profiles
  • Deployment docs in CLAUDE.md (rsync to cvg-primary)

Database Stats

Metric v1.1.0 v2.0.0
Total letters 7,049 6,914 (duplicates removed)
With translation ~7,000 6,824 (98.7%)
Fabricated translations ~217 0
AI headers 3,026 0
Benchmark score 3.54 4.38
Collections audited 0% 100%

Audit Coverage

Every collection with Latin/Greek source text has been 100% audited:
Augustine (161), Isidore (630), Symmachus (587), Gregory (399), Cassiodorus (477), Ennodius (297), Hormisdas (249), Libanius (817), Basil (325), Pliny (365), Sidonius (171), Venantius (100), and 14 smaller collections (559).

Assets 2
Loading