Clusy Crawler v0.2.0 Beta 2 Preview

Clusy Crawler Beta 2 is a preview of the self-hosted FastAPI crawler and
extraction service.

What changed

• consistent 0.2.0b2 package, runtime, OpenAPI, and health identity;
• rewritten README, benchmark guide, and evidence status;
• one current registry-backed Article Extraction Benchmark receipt;
• fail-closed claim validation across Markdown, Unicode, nested headings, code
  fences, comparison language, deployment language, and reader-visible privacy
  paths;
• static, browser, and quality container boundaries verified in GitHub Actions.

Verified scoped evidence

A post-tag clean-source replay used a Git tree byte-identical to
v0.2.0-beta.2. On the fixed 181-page AEB article_body protocol:

• Clusy F1: 0.972127
• exact Trafilatura 2.1.0 F1: 0.957546
• F1 delta: +0.014581
• paired F1 delta CI95: [+0.005547, +0.025336]
• paired-bootstrap win fraction: 0.9996
• machine-local in-memory extraction throughput: 173.97 pages/s

The comparator ran in a separate 17-package hash-pinned, label-free
environment. The receipt is registered on main under
bench/evidence/aeb-article-body-trafilatura-2-1-77b8d00-beta2-public/.

This receipt covers local closed-loop article-body extraction only. Throughput
is one Darwin arm64 in-memory observation. It is not a universal SOTA,
live-vendor, HTTP-service-throughput, end-to-end crawling, production
deployment, stability, or reliability claim.

Validation

• Python: 1528 passed, 3 skipped
• Rust: 45 passed
• Ruff, mypy, documentation, evidence, Rust format/clippy, and all three
  container build/smoke boundaries passed in
  GitHub Actions run 30607087994

The existing Beta 1 tag remains available only as a superseded legacy evidence
record. See the current README and docs/BENCHMARKS.md on main for exact
hashes, limitations, and reproduction entry points.