@hasna/crawl

AI-powered web crawler — self-hosted Firecrawl alternative. Crawl, extract, render JS, search. CLI + MCP + REST API + Dashboard.

Install

npm install -g @hasna/crawl

CLI Usage

crawl --help

• crawl crawl <url>
• crawl list
• crawl stats
• crawl search <query>
• crawl sitemap <url>
• crawl map <url>
• crawl export

MCP Server

crawl-mcp

30 tools available.

REST API

crawl-serve

Cloud Sync

This package supports cloud sync via @hasna/cloud:

cloud setup
cloud sync push --service crawl
cloud sync pull --service crawl

Data Directory

Data is stored in ~/.hasna/crawl/.

License

Apache-2.0 -- see LICENSE