Skip to content

Releases: gradigit/xdocs

data-2026.04.08

Choose a tag to compare

@gradigit gradigit released this 08 Apr 15:51

M24: Data Quality + Parameter Extraction + URL Cleanup

Store

  • 9,839 pages (0 empty), 11.0M words
  • 6,406 endpoints, 3,046 with request_schema (47.5%)
  • 204,123 semantic chunks, LanceDB compacted

Changes since data-2026.04.06

  • CCXT citation URLs: stripped .md extension from docs.ccxt.com canonical URLs,
    removed 2,019 GitHub wiki revision duplicates (old versions of 7 pages)
  • Deleted 5,797 CCXT empty pages + 160 junk thin pages
  • Fixed all empty pages via Playwright re-render
  • Bitget: re-crawled 182 → 568 pages (386 new)
  • Parameter extraction: backfilled request_schema for 760 endpoints
  • Pipeline fix: 304 on stored-empty pages forces Playwright re-render
  • Reranker deps fixed: mlx-lm + safetensors for macOS

Pipeline

  • MRR: 0.6212, PFX: 78.3%, URL: 65.6%
  • 796 tests passing

Data 2026.04.06

Choose a tag to compare

@gradigit gradigit released this 06 Apr 06:38

Data Release 2026-04-06

Source commit: f04eccf

Changes

  • Clean index rebuild: 339,179 chunks, 2.5 GB compacted
  • Korean exchange name support (18 names)
  • agent-browser content-selector fallback for SPAs
  • KuCoin clean extraction, dYdX thin page fixes

Install

./scripts/bootstrap-data.sh

Data 2026.04.05

Choose a tag to compare

@gradigit gradigit released this 05 Apr 05:06

Data Release 2026-04-05

Source commit: 78851f9

Changes since data-2026.04.02

  • 6,406 endpoints (was 6,039) — Bybit 129→308 (crawled docs replace Postman), Coinone 22→41, OKX/WOO re-extracted with rate limits
  • 400 endpoints with rate_limit data (OKX, WOO, Bitget patterns)
  • Agent-browser content-selector fallback for SPA sites (KuCoin, ReadMe.io)
  • docs_url specificity scoring — 249 endpoints re-resolved to better pages
  • dYdX 107 thin pages fixed via Playwright re-sync
  • Semantic index rebuilt: 357,583 chunks, 2.6 GB compacted
  • Pipeline: MRR=0.6409, PFX=79.37%, 778 tests

Install

./scripts/bootstrap-data.sh

Data 2026.04.02

Choose a tag to compare

@gradigit gradigit released this 02 Apr 03:19

Data Release 2026-04-02

Source commit: ffbdb14

Changes since last release (data-2026.03.26)

  • +972 endpoints extracted from crawled docs (M23): aevo 110, bitbank 389, phemex 120, coinex 134, woo 73, cryptocom 73, apex 37, aster 21, gains 15
  • 6,039 total endpoints (was 5,034), 39/46 exchanges covered
  • Semantic index rebuilt: 357,416 chunks, jina-v5-text-small 1024d
  • 107 dYdX thin pages fixed via Playwright re-sync (130→23 thin)
  • known_sources populated for all 46 exchanges
  • 8 bugs fixed: BUG-8/9/15/16/17/18 + citation excerpts + payload detection
  • 778 tests passing, MRR 0.6428, PFX 78.84%

Install

./scripts/bootstrap-data.sh

Data 2026.03.26

Choose a tag to compare

@gradigit gradigit released this 26 Mar 02:52

Data snapshot from maintainer repo commit c630e16.

Download and extract:

./scripts/bootstrap-data.sh data-2026.03.26

Data 2026.03.17

Choose a tag to compare

@gradigit gradigit released this 16 Mar 16:07

10,941 pages, 16.93M words, 4,963 endpoints across 46 exchanges. 338K LanceDB chunks (Jina v5-small 1024d).