v0.6.3 — Self-Healing Scrapers, Semantic Cache, MCP Server

What's New

Self-Healing Parsers — When a website changes its HTML, Harvest automatically regenerates CSS selectors via LLM. No manual fixes needed.

Semantic Cache — Caches by meaning, not exact URL. Ask "get prices" then "extract product prices": second call is instant, 0 tokens. 50-70% token reduction on real workloads.

Structural Diff — Git diff for web pages. See what changed, what moved, what's new. Recommendations included.

Script Generator — Analyze page once, generate standalone Python script. Zero tokens at runtime.

MCP Server — Works with Claude, Cursor, Hermes, custom agents out of the box.

Honest Limitations

• Turnstile checkbox (behavioral biometrics) can still block
• Requires Chromium (~300MB)
• LLM extraction needs an endpoint (Ollama, OmniRoute, or OpenAI-compatible)
• Brand new — no community yet

Quick Start

pip install harvest-agent
# or
git clone https://github.com/zad111ak-ai/harvest
cd harvest && pip install -e .

Links

• PyPI: https://pypi.org/project/harvest-agent/
• Dev.to: https://dev.to/joseph_postman_b091ffaccf/i-built-a-web-scraper-that-fixes-itself-when-websites-change-then-i-open-sourced-it-4jgd

MIT Licensed. Built in 3 weeks.