Skip to content

Fly OCR: compound eyes, characters, and a fixed connectome

Choose a tag to compare

@jerryjliu jerryjliu released this 13 Sep 02:07
· 2 commits to main since this release

Fly OCR sends glyph pixels through a fixed MaleCNS connectome and trains a small decoder on downstream neural activity. This first public release includes calibrated letter recognition, original-input comparisons, numeric tables, an honest compound-eye replay, and a 13-page research report.

  • 166,700 retained neurons and 25,582,938 frozen connections.
  • Calibrated 68-class benchmark: 87.6% overall; 85.0% on letters. Small, font-dependent evaluation; not general OCR.
  • 2:56 compilation showing letters, numeric tables and formatting failures, with actual errors preserved.
  • 11 source recordings, compact trained checkpoints, a static local viewer, reproducible scripts, source licenses and a clean export manifest.
  • Local checks: 26 tests; 983 recorded events verified; 12 videos fully decoded; browser controls and isolated installed inference checked.

The two-eye view is a schematic atlas of recorded sampled light. It does not change recognition and is not a reconstruction of fly optics. Preprocessing and table/string assembly are conventional geometry outside the circuit. No biological literacy or practical OCR advantage is claimed.

Download the video, PDF report, or full source-and-assets archive below. The README includes local setup and reproduction steps. The large source connectome and local caches are downloaded separately, not included in the archive.