Skip to content

v0.1.2

Choose a tag to compare

@laurentvv laurentvv released this 22 Jul 08:39
· 18 commits to main since this release

⚡ Performance warning in the tool description

The crawl tool now exposes a performance warning in its MCP description, visible to any MCP client (ZCode, Claude Desktop, Cline) via tools/list. This lets the AI warn users before launching a potentially slow crawl.

What's new

  • Tool description updated (src/crawl4ai_mcp_llm/server.py):
    • Warns that crawls can take 30 seconds to several minutes
    • Recommends setting the MCP client timeout generously (e.g. 600000 ms / 10 min)
    • Lists tips to speed up crawls:
      • css_selector to extract only the relevant content (main, article)
      • wait_for_selector for single-page applications
      • Lower max_depth when recursive crawling isn't needed

Why

Heavy/SPA sites (React, Next.js, Mintlify), high max_depth, and the first crawl of a session (Playwright browser startup) can be slow. Without this warning, the AI may launch a crawl without informing the user it could take minutes.

Install

uvx crawl4ai-mcp-llm

Full Changelog: v0.1.1...v0.1.2