Skip to content

Unlimited-OCR-2: the six cases' inputs and stage dumps (#2074 at b68ea38f2)

Pre-release
Pre-release

Choose a tag to compare

@BobClawblaw BobClawblaw released this 11 Nov 21:52

Inputs for Unlimited-OCR-2's six cases (ashhart#2074, head b68ea38f2): the five page images, each case's stage dumps from the release's own code (torch bf16 and float32, each with its top2 sidecar), and the two block-case files tf-uocr-blocks reads. SHA256SUMS covers every file.

Pages (the same bytes as release uocr-0af3eb8c8): report-1.png, report-2.png (synthetic report pages, A4 at 150 dpi); paper-1.png, paper-3.png, paper-10.png (pages 1, 3 and 10 of Unlimited-OCR-2.pdf from the release at 0480966938291445591f69f08a13b041c073a96a, 150 dpi, PyMuPDF 1.27.2.2).

Stage dumps (tools/zig/uocr_reference.py dump MODEL OUT PAGE[,PAGE...], torch 2.15.0 on the Apple CPU; the script is unchanged between c7cd2ff4a and b68ea38f2): <case>.safetensors + <case>.json (bf16) and <case>-f32.safetensors + <case>-f32.json (float32), for report-1, report-2, paper-1, paper-3, paper-10, and document (the five pages in that order as one request). Each .json holds the prompt ids, the greedy reply ids, its text and top2: each step's two highest logits as [id, logit, id, logit].

Block cases (uocr_reference.py blocks MODEL report-1.safetensors OUT --call C --view V): report-1-blocks-tile1.safetensors (call 0, view 1: tile view 1, 640) and report-1-blocks-global.safetensors (call 1, view 0: the global view, 1024).

Commands (MODEL = the release's checkpoint directory, P = the pages):

tf-uocr-decode MODEL P/report-1.png report-1.safetensors report-1-f32.safetensors
tf-uocr-decode MODEL P/report-1.png report-1.safetensors report-1-f32.safetensors --their-embeds
# likewise report-2, paper-1, paper-3, paper-10; the document adds --reply-reported to the first form:
tf-uocr-decode MODEL P/report-1.png,P/report-2.png,P/paper-1.png,P/paper-3.png,P/paper-10.png document.safetensors document-f32.safetensors --reply-reported
tf-uocr-blocks MODEL report-1-blocks-tile1.safetensors
tf-uocr-blocks MODEL report-1-blocks-global.safetensors