Initial release of claude-crawl.
Features
- Fetch — URL to markdown via Jina Reader
- Search — Web search via Jina Search or Firecrawl
- Scrape — JS-rendered extraction via Firecrawl
- Crawl — Multi-page async crawling via Cloudflare (up to 100K pages) or Firecrawl
- Map — URL discovery via Firecrawl
- Screenshot/PDF — Visual capture via Cloudflare Browser Rendering
- Extract — AI-powered structured data extraction via Cloudflare
- Rerank — Relevance scoring via Jina Reranker
- Ground — Fact-checking via Jina Grounding
- Deep Research — Multi-source research agent
Components
- 1 skill (web content routing)
- 1 agent (deep-research)
- 1 command (
/claude-crawl:setup) - 2 hooks (SessionStart auth check, WebFetch interception)
- 13 shell scripts (zero external deps — curl + jq only)