Skip to content

v0.2.0 — web_feed: read RSS/Atom feeds

Choose a tag to compare

View all tags
@TYEclipse TYEclipse released this 21 Aug 23:24
· 4 commits to main since this release
v0.2.0
62fdf85

What's new / 新特性

  • web_feed (new tool): read any RSS 2.0 / Atom feed and return a clean, LLM-friendly entry listing — title, link (relative links resolved), published date, author, summary, and optional full content. Handles CDATA, HTML entities (incl. entity-escaped markup in type="html" Atom summaries), and markup stripping. web_fetch cannot extract XML feeds, so this closes that gap.
  • Proxy support (new): Node's built-in fetch ignores HTTP_PROXY/HTTPS_PROXY, so requests failed on proxy-required networks. dsh-webfetch now ships a zero-dependency http-proxy transport (CONNECT tunnelling for https, absolute-URI form for http, Proxy-Authorization for proxy credentials) with NO_PROXY matching (exact/suffix/wildcard/IPv4 CIDR). Auto-detected from env; overridable via httpProxy/httpsProxy/noProxy config ('' disables).
  • Feed content types accepted: application/rss+xml, application/atom+xml, application/xml, text/xml (web_fetch/web_links remain HTML/plain-text only).
  • Charset detection now also sniffs the XML declaration.

Fixes / 修复

  • (none — feature release)

Verification / 验证

  • 85 offline tests green (fixture server incl. a local fake-proxy fixture; e2e through the execute path).
  • Real-network smoke: https feed fetched through a real proxy (CONNECT tunnel + TLS) in ~0.7 s.
  • Install self-test on a scratch profile: structure 3 checks + headless end-to-end web_feed on a live GitHub atom feed (proxy path).

Install: dsh plugin --profile <name> add github:TYEclipse/dsh-webfetch#v0.2.0

Assets 2
Loading