Skip to content

Cockroach Crawler v0.2.0

Latest
Latest

Choose a tag to compare

View all tags
@AjnasNB AjnasNB released this 16 Jul 08:55
v0.2.0
7778b89

Cockroach Crawler 0.2.0 is a security-focused release for bounded public-web and explicitly trusted crawling.

Highlights:

  • DNS-validated, address-pinned requests with redirect-hop revalidation.
  • Conservative Chromium proxy with deny-by-default egress, SSRF controls, exact budgets, robots/sitemap policy, and fail-closed cookie handling.
  • Agent adapter at cockroach-crawler/agent with immutable creator policy.
  • Public TypeScript declarations, JSON/JSONL CLI output, provenance, stats, and content hashes.
  • 45 core tests plus 26 real Chromium integration tests; Node 20.18.1, 22, and 24 CI.

Install:

npm install cockroach-crawler@0.2.0

The browser is not a JavaScript/process sandbox. Review SECURITY.md and use browser mode only for authorized targets.

Release-proof assets

Assets 4
Loading