data-2026.04.08

M24: Data Quality + Parameter Extraction + URL Cleanup

Store

• 9,839 pages (0 empty), 11.0M words
• 6,406 endpoints, 3,046 with request_schema (47.5%)
• 204,123 semantic chunks, LanceDB compacted

Changes since data-2026.04.06

• CCXT citation URLs: stripped .md extension from docs.ccxt.com canonical URLs,
  removed 2,019 GitHub wiki revision duplicates (old versions of 7 pages)
• Deleted 5,797 CCXT empty pages + 160 junk thin pages
• Fixed all empty pages via Playwright re-render
• Bitget: re-crawled 182 → 568 pages (386 new)
• Parameter extraction: backfilled request_schema for 760 endpoints
• Pipeline fix: 304 on stored-empty pages forces Playwright re-render
• Reranker deps fixed: mlx-lm + safetensors for macOS

Pipeline

• MRR: 0.6212, PFX: 78.3%, URL: 65.6%
• 796 tests passing