DonSeTch v4.2.5_sync
Changed
- The npm package page carries a real README instead of the stub: the fourth
tool (web_screenshot), the feature list, the full platform matrix with
OCR/rerank availability per platform, the install troubleshooting notes,
the sponsor tiers, and links to the docs.package.jsongained a
fundingfield, so npm shows a sponsor link on the package page, and
search keywords that describe what the package actually is. - The repository README was rewritten: 1090 lines to 700, sponsors moved
from dead last to the fourth section with a nav link from the top, the
v3 and v4 "what's new" sections folded into the feature sections they
describe, the WRB results replaced by a pointer to the WRB repo, and the
comparison table cut from 18 rows to 12 plus a short Firecrawl head to
head. Two stale numbers fixed: the tests badge said 1270 while the body
said 727.
Fixed
- A crawl seeded on a page at the host root (
/p0.html,/index.php)
returned the seed alone, or nothing, withcomplete: true. The
auto-scope rule that keeps/tokioon docs.rs inside/tokio/*was
applied to the file name too, so the scope became/p0.html/*and
every sibling link was filtered out before it reached the frontier.
Separately, the quality gate skipped a low-quality page before
harvesting its outlinks, and a hub page (a link list with almost no
prose) is the lowest-quality page on a site and the one a crawl is
seeded from. A root-level file now scopes to the host, and a skipped
page still feeds the frontier (mnaza, dondai44423#250, fixes dondai44423#249). - A resolver that could not answer (EAI_AGAIN: resolv.conf unreachable,
SERVFAIL, a VPN flap) was reported asnetwork.dnswith
errorKind: permanentand a do-not-retry action, the mirror of dondai44423#248:
the outage read as a dead name. It is transient now, while a name that
does not exist stays permanent. Search enrichment no longer demotes a
live result when the resolver times out during the prefetch, and the
ghost probe's failure class and the search task status label kept their
signals (mnaza, dondai44423#251). - Egress lane health learned the same variants: a proxy lane whose own
name stops resolving is marked dead again, and a resolver timeout is
counted as a timeout (the message reads "dns timeout", which the old
contains("timed out")check never matched).
Full Changelog: https://github.com/axwfae/donsetch_noavx/commits/v4.2.5_sync