Skip to content

Vision OCR 1.16.0 — Accurate mode reads difficult pages with stronger on-device readers, chosen by kind of page

Latest

Choose a tag to compare

@charlesapetersen charlesapetersen released this 16 Oct 23:17
· 4 commits to main since this release

Accurate mode: stronger on-device readers, chosen by kind of page. Settings has a new Accurate mode box, off by default and best left off for everyday scans. Switched on, it reads difficult print with an extra on-device reader, newspapers above all, and fits that reader's words onto the lines Vision finds, so the text layer still sits on the words. A table beside it shows how accurate, how fast, how much memory and how large a download each reader is, and a slider sets the most memory a reader may use. Readers are downloaded only after a confirmation that names the total (about 1.3 GB for Falcon-OCR with the shared runtime and layout model, 0.9 GB for PaddleOCR-VL). Every file is checked before it is installed, and nothing is downloaded while the mode is off. "Measure on this Mac" times each downloaded reader on a few pages, so the speed column shows estimates for your Mac. Accuracy is not measured there.

Four kinds of page. Choose pages sets a reader for each kind: Newspapers, Photographed pages, Handwritten pages and Other documents. The app sorts each page into a kind by itself. It spots a camera's photo of a page from the camera's tags or from how the page was lit, and handwriting from the shape of the ink in its lines. Sideways and upside-down pages are read upright.

Handwriting. A new reader for handwritten pages, LightOnOCR-3 (a 5.2 GB download that needs the memory limit set to 8 GB or more), missed about 96 words in 1,000 on 19 photographed letters and notes, a small sample. On the same pages Vision missed 561 and Falcon-OCR 409. Words read from a hand mostly cannot be placed on Vision's lines, so by default a handwritten page is followed by a page of the reader's text, which can be selected, copied and searched. A setting turns this off.

Faster batches. On a Mac with 16 GB of memory or more, two pages can be read by Falcon-OCR or PaddleOCR-VL at once, and the longest pages go first. In a ten-page test this finished about 18% sooner with PaddleOCR-VL and 13% sooner with Falcon-OCR.

Smaller photos of pages. A dropped photo or image of a page is now compressed like a scanned page. A phone photo of a typed letter went from 830 KB to about 87 KB with the same text. A Photographed pages slider sets how much of the paper behind the words is kept, and a camera's photo now gets a Letter-sized page.

Cleaner type and better selection on scans. Pale typewriting, and typing on grey or yellowed paper, comes out as solid as the scan shows it. Black type no longer comes out near-bold. Faint pencil and dark marks that are not words, such as rules, stamps and ink handwriting, stay legible. Lines that were missing from the text layer, or garbled at their ends, now read as printed. A drag across the top half of a line no longer copies the line above, and a drag down one column of a magazine page stays in that column. On newspapers with a rule printed between the columns, a line read on into the next column is split into its two columns (C28, C41, C52, C53, C54, C55, C56).

Plainer settings. The settings now explain themselves without terms like "invisible text layer" or "JBIG2".

The full list is in CHANGELOG.md.