v0.3.0 — web_headers: inspect HTTP without the body

v0.3.0 — web_headers: inspect HTTP without the body

New tool: web_headers

Inspect the HTTP status, response headers and redirect chain of a URL
without downloading the page body — the diagnostic companion to
web_fetch:

• url (required) — full http/https URL to inspect
• method — HEAD (default, downloads no body) or GET; falls back to
  GET automatically when the server answers 405/501
• followRedirects (default true) — follow redirects and report every hop

Returns { url, finalUrl, status, statusText, method, headers, redirects }.
Unlike web_fetch, any HTTP status (404/500/…) is reported — this is a
diagnostic tool. Works through the same zero-dependency proxy transport as
the other tools (proxy support extended with a request-method parameter).

Example: check a download link and its redirect chain, or verify an
endpoint's content-type/caching/security headers before fetching.

Also: README (EN/ZH) updated for the fourth tool, 97 tests all green
(12 new: HEAD probe, GET fallback, redirect chains/limits, non-2xx
reporting, timeout, and HEAD through a local proxy fixture).

Install:

dsh plugin --profile web add github:TYEclipse/dsh-webfetch#v0.3.0

---

中文摘要

v0.3.0 新增 web_headers 工具：用 HEAD 请求探测任意 URL 的 HTTP 状态码、响应头与重定向链，不下载正文（服务器不支持 HEAD 时自动回退 GET，非 2xx 状态照常报告），是 web_fetch 的读前诊断搭档。代理传输层同步支持自定义请求方法；README 中英双语已更新；97 个测试全绿（新增 12 个：HEAD 探测/GET 回退/重定向链与上限/非 2xx 报告/超时/经代理 HEAD）。

v0.2.0 — web_feed: read RSS/Atom feeds

What's new / 新特性

• web_feed (new tool): read any RSS 2.0 / Atom feed and return a clean, LLM-friendly entry listing — title, link (relative links resolved), published date, author, summary, and optional full content. Handles CDATA, HTML entities (incl. entity-escaped markup in type="html" Atom summaries), and markup stripping. web_fetch cannot extract XML feeds, so this closes that gap.
• Proxy support (new): Node's built-in fetch ignores HTTP_PROXY/HTTPS_PROXY, so requests failed on proxy-required networks. dsh-webfetch now ships a zero-dependency http-proxy transport (CONNECT tunnelling for https, absolute-URI form for http, Proxy-Authorization for proxy credentials) with NO_PROXY matching (exact/suffix/wildcard/IPv4 CIDR). Auto-detected from env; overridable via httpProxy/httpsProxy/noProxy config ('' disables).
• Feed content types accepted: application/rss+xml, application/atom+xml, application/xml, text/xml (web_fetch/web_links remain HTML/plain-text only).
• Charset detection now also sniffs the XML declaration.

Fixes / 修复

• (none — feature release)

Verification / 验证

• 85 offline tests green (fixture server incl. a local fake-proxy fixture; e2e through the execute path).
• Real-network smoke: https feed fetched through a real proxy (CONNECT tunnel + TLS) in ~0.7 s.
• Install self-test on a scratch profile: structure 3 checks + headless end-to-end web_feed on a live GitHub atom feed (proxy path).

Install: dsh plugin --profile <name> add github:TYEclipse/dsh-webfetch#v0.2.0

v0.1.0

dsh-webfetch v0.1.0

网页阅读器 Web page reader — 首发版本（历史发布补账 / historical release backfill）。

工具 Tools

• web_fetch — URL → 干净 markdown / text（内容类型门禁）
• web_links — 提取页面链接清单

安装 Install

dsh plugin --profile <name> add github:TYEclipse/dsh-webfetch

零运行时依赖（zero runtime dependencies）。