v0.1.1 — CapSolver Cloudflare clear fixes

What's changed

• CapSolver AntiCloudflareTask no longer sends page html (CapSolver rejects it as invalid html)
• Managed Cloudflare interstitials preferred over widget Turnstile when both are present
• After a successful CapSolver clear, skip classifyHtml false-positives on pages that embed Cloudflare assets
• Docs updated for socks5 + sticky proxy + html omit

Install

git clone https://github.com/teslashibe/web-scrape.git
cd web-scrape && git checkout v0.1.1 && npm ci

Synced from production smore web-scraper CapSolver hardening.

v0.1.0 — CLI-first web-scrape

web-scrape v0.1.0

CLI-first website scrape + browser fetch with SSRF/robots guards and optional CapSolver Cloudflare clears. Thin MCP HTTP adapter included.

Install

git clone https://github.com/teslashibe/web-scrape.git
cd web-scrape && npm install && npx playwright install chromium
./bin/web-scrape.mjs fetch https://example.com/ --json

Surfaces

• CLI: fetch · scrape · serve
• Library: import { scrape, browserFetchURL } from 'web-scrape'
• MCP: POST /mcp/v1 tools browser_fetch_url, scrape_website_context

Verified

• 107/107 unit tests
• npm run validate + npm run smoke
• Live CLI fetch/scrape against example.com