Skip to content

v0.1.0 — CLI-first web-scrape

Choose a tag to compare

View all tags
@teslashibe teslashibe released this 18 Jul 16:48
· 1 commit to main since this release
v0.1.0
9f0e5bb
This commit was signed with the committer’s verified signature.
teslashibe Brendan Playford
GPG key ID: 663CFC091C1BDFBD
Verified
Learn about vigilant mode.

web-scrape v0.1.0

CLI-first website scrape + browser fetch with SSRF/robots guards and optional CapSolver Cloudflare clears. Thin MCP HTTP adapter included.

Install

git clone https://github.com/teslashibe/web-scrape.git
cd web-scrape && npm install && npx playwright install chromium
./bin/web-scrape.mjs fetch https://example.com/ --json

Surfaces

  • CLI: fetch · scrape · serve
  • Library: import { scrape, browserFetchURL } from 'web-scrape'
  • MCP: POST /mcp/v1 tools browser_fetch_url, scrape_website_context

Verified

  • 107/107 unit tests
  • npm run validate + npm run smoke
  • Live CLI fetch/scrape against example.com
Assets 2
Loading