Skip to content

Library Docs Phase 2 — subpage follow-loading

Choose a tag to compare

@Korrnals Korrnals released this 15 Sep 12:43
· 7 commits to main since this release

v0.11.0 — Library Docs Phase 2

Subpage follow-loading: Context7-grade quality without their database.

Added

  • Subpage follow-loading in library_docs (subpages=3, 0 = off): after the landing page, same-site links are extracted, ranked by overlap with the query (y/ies morphology — "dependency" matches "dependencies"), and the top pages are loaded in parallel through the dive semaphore, merged into one digest. Live: fastapi "dependency injection" — 4,383 characters of content vs 1,951 of navigation in Phase 1; the site-search fallback found the exact tutorial/dependencies/, classes-as-dependencies/, advanced-dependencies/ pages on a linkless landing (the HTTP tier had stripped the nav markup).
  • Site-search discovery fallback: when the landing source carries no links (the HTTP tier cut the nav markup), subpages are located with one targeted web_search "{library} {query} site:{host}" through our own engine.
  • Unit tests: seed index (internal-key filtering), same-site logic, extractor (ranking / asset filtering / limit), morphology.

Changed

  • Architectural: dictionary-based "navigation" heuristics (link density / word variety) proved brittle at the TOC/prose boundary and were removed — follow-loading is now unconditional for a purpose-built tool; the decision is recorded in a code comment.

Install: pip install bathys==0.11.0
Changelog: CHANGELOG.md