Repository navigation
v0.12.0
v0.12.0
Metadata + non-HTML content routing.
Added
- Metadata: fetch results now carry a
metadatadict (author,published_at,site_name,language) extracted via trafilatura on the HTTP fast path. Exposed inscrape_manyoutput, CLI--json, and MCPfetch/search_fetch. Values arenullwhen unknown or when the winning strategy was not HTTP. - Non-HTML routing: the HTTP fast path converts JSON (pretty code block), CSV (GFM table), RSS/Atom feeds (link list), PDFs (per-page text via new
pypdfcore dep), and plain text instead of erroringnot HTML. Valid non-HTML payloads skip the 100-char thin-check in the ladder.
Fixed
- MCP leak-scan test marker scoped to traceback frames, fixes a false positive on real page content.
Install
pip install webget-cli
uv tool install "webget-cli[browser,mcp]"