Skip to content

v4.2.5_sync

Latest

Choose a tag to compare

@axwfae axwfae released this 19 Sep 15:09
· 69 commits to master since this release
3d6222e

DonSeTch v4.2.5_sync

Changed

  • The npm package page carries a real README instead of the stub: the fourth
    tool (web_screenshot), the feature list, the full platform matrix with
    OCR/rerank availability per platform, the install troubleshooting notes,
    the sponsor tiers, and links to the docs. package.json gained a
    funding field, so npm shows a sponsor link on the package page, and
    search keywords that describe what the package actually is.
  • The repository README was rewritten: 1090 lines to 700, sponsors moved
    from dead last to the fourth section with a nav link from the top, the
    v3 and v4 "what's new" sections folded into the feature sections they
    describe, the WRB results replaced by a pointer to the WRB repo, and the
    comparison table cut from 18 rows to 12 plus a short Firecrawl head to
    head. Two stale numbers fixed: the tests badge said 1270 while the body
    said 727.

Fixed

  • A crawl seeded on a page at the host root (/p0.html, /index.php)
    returned the seed alone, or nothing, with complete: true. The
    auto-scope rule that keeps /tokio on docs.rs inside /tokio/* was
    applied to the file name too, so the scope became /p0.html/* and
    every sibling link was filtered out before it reached the frontier.
    Separately, the quality gate skipped a low-quality page before
    harvesting its outlinks, and a hub page (a link list with almost no
    prose) is the lowest-quality page on a site and the one a crawl is
    seeded from. A root-level file now scopes to the host, and a skipped
    page still feeds the frontier (mnaza, dondai44423#250, fixes dondai44423#249).
  • A resolver that could not answer (EAI_AGAIN: resolv.conf unreachable,
    SERVFAIL, a VPN flap) was reported as network.dns with
    errorKind: permanent and a do-not-retry action, the mirror of dondai44423#248:
    the outage read as a dead name. It is transient now, while a name that
    does not exist stays permanent. Search enrichment no longer demotes a
    live result when the resolver times out during the prefetch, and the
    ghost probe's failure class and the search task status label kept their
    signals (mnaza, dondai44423#251).
  • Egress lane health learned the same variants: a proxy lane whose own
    name stops resolving is marked dead again, and a resolver timeout is
    counted as a timeout (the message reads "dns timeout", which the old
    contains("timed out") check never matched).

Full Changelog: https://github.com/axwfae/donsetch_noavx/commits/v4.2.5_sync