Skip to content

ethos-parser 0.55.0

Choose a tag to compare

View all tags
@ethos-pramaan ethos-pramaan released this 13 Sep 11:26
· 266 commits to main since this release
Immutable release. Only release title and notes can be modified.
v0.55.0
15ebe51

The first release of ethos-parser: a deterministic, pure-Rust PDF and office-document parser whose output is canonical JSON — the same bytes for the same input on every run, and across both instruction sets it has been tested on.

Platforms

Archive Target State
ethos-parser-0.55.0-aarch64-apple-darwin.tar.gz macOS, Apple silicon verified
ethos-parser-0.55.0-x86_64-apple-darwin.tar.gz macOS, Intel verified (executed under Rosetta 2)

verified means built with the pinned Rust 1.88.0, executed, and its output byte-identical to the native build's — extract and classify over the eight gate documents, and markdown, html and ground over six of them (the two largest are skipped for the projections only; the 950 MB representation makes them slow, and they are still compared through extract). SHA256SUMS.txt records the state beside each digest.

Not shipped: Linux and Windows. Neither was built — the build host has no cross linker for either — and even a cross-built binary could not have been executed there, and a binary nobody has run is an untested claim for an engine whose product is byte-identical output. They follow when a machine of each platform can verify them. Separately, 412 comparisons over 86 documents found zero differences between aarch64 and x86_64 output — the instruction-set half of the cross-machine claim; the operating-system half is not yet tested.

Not on a registry. Nothing is published to crates.io, npm or PyPI.

Install

gh release download v0.55.0 --repo docushell/ethos-parser
shasum -a 256 -c SHA256SUMS.txt --ignore-missing
tar -xzf ethos-parser-0.55.0-aarch64-apple-darwin.tar.gz
./ethos-parser-0.55.0-aarch64-apple-darwin/ethos-parser --version

Each archive holds the binary, LICENSE (Apache-2.0) and README.md. Neither binary is notarized: the Apple silicon one carries the linker's ad-hoc signature, and the Intel one is unsigned. A copy downloaded through a browser is quarantined, and macOS will refuse to open it; once the digest checks out, xattr -d com.apple.quarantine ethos-parser-0.55.0-*/ethos-parser clears it. gh release download does not set the quarantine attribute.

What is in 0.55.0

Readers and emitters changed (why it is a MINOR):

  • Every PDF text run carries the block its page's leading-gap cut placed it in — 63.7% of real paragraph breaks at 100% precision on the one labellable gate document.
  • The ruled table rule accepts either shape of grid evidence, stops reading inter-cell whitespace as rows, and stops reading a stack of shaded lines as a grid: on the 200-document benchmark 14 documents emit a table, every one holding a table in ground truth, against 5 at 0.54.0.
  • A grounding box's height is scaled by the rendered em, not the raw Tf operand — on nist-sp-800-207 all 82 909 measured run boxes were about a point tall.
  • ground withholds spans past ethos.grounding.v1's one-million cap instead of emitting an artifact the Ethos verifier refuses, and says so in the artifact, on stderr, and over MCP.

Memory, byte-identically:

  • The worst gate document's peak falls from 6.49 GiB to 3.65 GiB.
  • Every command that loads a representation needs about the payload's size less (ground on the largest document: 4093 → 3299 MiB).
  • MCP extract on a 4.6 MB PDF: 8.7 GiB → 1.1 GiB.

profile_sha256: sha256:daada6989e1fe4090f146db55c03ca5f53d5a91d7c06f4a0787f4c252cd05880. Artifacts from any earlier build are deliberately non-comparable with these.

The full entry, with every measurement and what was tried and refused, is in CHANGELOG.md.

Known limits

  • A caller cannot set a hard memory ceiling; --max-pages bounds pages, not bytes.
  • ground guards the span cap only. The schema's other limits — 5,000 pages, a million elements, 100,000 tables, 16 KiB strings — are not yet enforced before emission; nothing in the test corpus approaches them.
  • grounding-check peaks at about 13× its input.
  • Table recall is 33% on the 200-document benchmark: the ruled rule needs a grid the page drew, and the alignment rule has emitted no table on it.

Checksums

d2df6c690a1d667b361cadef09b507eda5ef2a2d8252ca1c62f3804fe4656b25  ethos-parser-0.55.0-aarch64-apple-darwin.tar.gz
8a1a96b0bba0d67d127067107b40633bc67cd760bc3b05111cc5a9b6104d6c9b  ethos-parser-0.55.0-x86_64-apple-darwin.tar.gz
Assets 6
Loading