Skip to content

Releases

v0.23.4

Choose a tag to compare

@github-actions github-actions released this 09 Sep 08:20

Full Changelog: v0.23.3...v0.23.4

v0.23.3

Choose a tag to compare

@github-actions github-actions released this 09 Sep 06:26

Full Changelog: v0.23.2...v0.23.3

v0.23.2

Choose a tag to compare

@github-actions github-actions released this 09 Sep 05:19

Full Changelog: v0.23.1...v0.23.2

v0.23.1

Choose a tag to compare

@wuaishare wuaishare released this 07 Sep 11:18

Security and distribution hardening release.

  • Close DNS-rebinding/SSRF validation-to-connect gaps by pinning validated public endpoints and verifying peers.
  • Guard browser fallback navigation and requests against non-public destinations.
  • Treat extracted remote content as untrusted data to prevent indirect prompt-injection escalation.
  • Require explicit trusted-proxy opt-in for proxy-based remote DNS.
  • Align Agent Skill metadata and ClawHub thin-bundle distribution boundaries.

All 128 tests pass locally; GitHub CI covers Python 3.10/3.12/3.14 plus service, MCP, and browser extras.

ShareXtract v0.23.0

Choose a tag to compare

@wuaishare wuaishare released this 06 Sep 12:16

LinkedIn public-post extraction through the official anonymous Embed representation for posts eligible for off-LinkedIn embedding.

Highlights:

  • Adds linkedin-post for normal /posts/...-activity-{id}-..., /feed/update/urn:li:activity:{id}, and public embed URLs
  • Uses LinkedIn activity ID as the stable content identity
  • Consumes only the anonymous public Embed page; no OAuth, access token, li_at cookie, login automation, or browser runtime
  • Normalizes author name/URL/type, follower display, commentary, relative publication display, reaction count, and comment count
  • Exports only images explicitly present in feed-images content
  • Keeps profile images, company logos, and generic Open Graph previews out of post media
  • Normalizes article/link attachments separately with URL, title, subtitle, and thumbnail
  • Does not export LinkedIn comment bodies; only the public comment count is normalized
  • Validates Embed activity URN against the requested activity ID
  • Falls back to public Open Graph description only when Embed commentary is absent
  • Posts that are not eligible for off-LinkedIn embedding fail cleanly instead of triggering authentication fallback
  • Two real Microsoft samples validated: one article attachment post and one image post
  • Registry grows to 33 routes/standards with 33 contract fixtures and 21 configured live samples
  • 123 local tests, clean-wheel validation, bilingual README link checks, YAML validation, secret scan, and full Live Matrix passed
  • GitHub Actions success across all five jobs

This release treats public embed eligibility as an explicit provider policy boundary rather than something to bypass.

ShareXtract v0.22.0

Choose a tag to compare

@wuaishare wuaishare released this 06 Sep 12:04

Threads, Instagram and Facebook public-post extraction through standard Open Graph with Meta tokenless oEmbed as a resilient official enhancement layer.

Highlights:

  • Adds threads-post, instagram-post and facebook-post native adapters
  • Uses standard public Open Graph as the readable-content contract
  • Uses Meta tokenless oEmbed only as a best-effort official embed/provider enhancement
  • Requires no Meta Developer App, access token, login cookie or browser runtime
  • Threads: extracts public text/username and intentionally does not export og:image as post media because live validation shows text posts can expose the profile image
  • Instagram: extracts caption, username, displayed likes/comments, post/reel type and public thumbnail; shortcode remains stable identity and video stream URLs are never exported
  • Facebook: extracts author, public post summary and preview image; provider-declared numeric canonical identifiers are recorded separately from requested public identity
  • Uses unversioned tokenless Instagram/Facebook oEmbed endpoints to avoid coupling ShareXtract to a rolling Graph API version
  • All three adapters preserve Open Graph content if tokenless oEmbed is temporarily unavailable
  • Fixes SafeHttpClient default User-Agent to track the actual runtime ShareXtract version instead of remaining hard-coded to 0.1
  • Registry grows to 32 routes/standards with 32 contract fixtures and 20 configured live samples
  • 118 local tests, clean-wheel validation, bilingual README link checks, YAML validation, secret scan and full Live Matrix passed
  • GitHub Actions success across all five jobs

This release continues the project policy of standard/open public content first, official tokenless embeds as enhancement, and browser execution only as a last resort.

ShareXtract v0.21.0

Choose a tag to compare

@wuaishare wuaishare released this 06 Sep 11:29

Pinterest public Pin extraction through standard Open Graph metadata on anonymous public Pin HTML.

Highlights:

  • Adds pinterest-pin for direct public Pinterest Pin URLs, including localized pinterest.com subdomains and slugged Pin paths
  • Uses only standard Open Graph metadata already present in anonymous static HTML
  • Normalizes requested Pin ID, title, description, public image URL/dimensions, updated time, source link, and Pinterest-declared metadata
  • Does not parse PWS_DATA, PWS_INITIAL_PROPS, or other internal PWS bootstrap state
  • Does not call undocumented pidgets APIs, require Pinterest API tokens, or use browser rendering
  • Reuses ShareXtract existing generic Open Graph parser instead of duplicating HTML parsing
  • Adds a Pinterest-specific identity safeguard: live validation showed link rel=canonical and og:url can point to a different Pin ID whose fetched content has different title/image/time
  • Therefore the requested Pin ID remains ShareXtract stable canonical/dedupe identity; Pinterest-declared canonical/OG URLs are recorded separately with an explicit mismatch flag
  • Three real public Pins validated; both matching and mismatching declared-canonical cases covered
  • Adds a fixed Pinterest Live Health sample and deterministic contract fixture
  • Registry grows to 29 routes/standards with 29 contract fixtures and 17 configured live samples
  • 109 local tests, clean-wheel validation, bilingual README link checks, YAML validation, secret scan, and full Live Matrix passed
  • GitHub Actions success across all five jobs

This release keeps Pinterest extraction standards-based and public-only while avoiding false deduplication caused by Pinterest content-level canonicalization behavior.

ShareXtract v0.20.0

Choose a tag to compare

@wuaishare wuaishare released this 06 Sep 11:05

Telegram public channel/group post extraction through the official anonymous Post Widget.

Highlights:

  • Adds telegram-post for public t.me/channel/message_id and compatible telegram.me URLs
  • Uses Telegram official anonymous Post Widget HTML with no login, Bot Token, OAuth, or browser runtime
  • Normalizes author/channel, message text, exact timestamp, view count, verification state, reactions, link-preview metadata, and public photos
  • Text/link-preview sample t.me/telegram/83 live-verified
  • Photo/reaction sample t.me/durov/43 live-verified
  • Does not call or export widget auth/upload API configuration
  • Does not export temporary audio/video playback stream URLs
  • Pure HTTP + HTML parsing keeps this adapter lightweight and deterministic
  • Adds a fixed documented Live Health sample and contract fixture
  • Registry grows to 28 routes/standards with 28 contract fixtures and 16 configured live samples
  • 105 local tests, clean-wheel validation, bilingual README link checks, YAML validation, secret scan, and full Live Matrix passed
  • GitHub Actions success across all five jobs

Telegram officially documents its Post Widget for messages from public channels and groups; this release consumes only that public embedding surface and excludes auth/upload helpers and temporary streams.

ShareXtract v0.19.0

Choose a tag to compare

@wuaishare wuaishare released this 06 Sep 10:55

Reddit public posts and threads through documented oEmbed, with standard Atom RSS as a resilient content enhancement.

Highlights:

  • Adds reddit-oembed for public Reddit thread and comment-permalink URLs
  • Uses documented https://www.reddit.com/oembed?url=... as the stable primary public contract
  • Reuses ShareXtract standard Atom parser against thread .rss for post body and comments
  • Maps Atom entry zero to the post body and later entries to normalized comment messages with author, timestamp and permalink
  • RSS is explicitly best-effort: 403/429/unavailability preserves the oEmbed result instead of failing the adapter
  • extraction_method remains documented_reddit_oembed so RSS rate limits do not create false protocol drift
  • Does not call currently blocked Reddit .json post endpoints
  • Requires no Reddit OAuth, login cookies, copied credentials, or browser automation
  • Comment permalinks canonicalize to their parent thread
  • Adds a fixed Reddit Live Health sample and deterministic contract fixture
  • Registry grows to 27 routes/standards with 27 contract fixtures and 15 configured live samples
  • Manual live verification successfully returned the original post body plus 12 comments; a later clean-wheel run hit RSS 403 while oEmbed still succeeded, validating the intended layered fallback
  • 101 local tests, clean-wheel validation, bilingual README link checks, YAML validation, secret scan, and full Live Matrix passed
  • GitHub Actions success across all five jobs

This release deliberately respects Reddit current API access policy: the blocked anonymous .json surface is not bypassed. ShareXtract relies on Reddit public oEmbed and open Atom syndication instead.

ShareXtract v0.18.0

Choose a tag to compare

@wuaishare wuaishare released this 06 Sep 10:21

Kuaishou public atlas/image extraction through an isolated anonymous browser route, plus accurate optional-runtime health reporting.

Highlights:

  • Adds kuaishou-atlas for current public picture/atlas share pages and short links
  • Keeps kuaishou-video ahead of atlas so ordinary videos remain on the lighter anonymous Apollo SSR path
  • Recognizes that current image-share static window.INIT_STATE is empty and uses browser rendering only as a last resort
  • Opens a fresh anonymous browser context with no imported cookies, storage, or account state
  • Scopes extraction to the active .swiper-slide-active .player work so recommendation cards are not mixed into the result
  • Normalizes author, caption, topics, visible like/comment/collection counts, avatar, music title, and public /ufile/atlas/ image URLs
  • Release-time live validation extracted 31 original atlas images from the current work
  • Does not pre-seed, copy, manufacture, export, or persist did/browser visitor state
  • Does not generate or replay __NS_hxfalcon or other protected internal request parameters
  • Does not convert page-internal protected requests into a private API integration
  • Excludes audio/video streams, protected request URLs, share tokens, and browser storage from normalized output
  • Adds a generic fetch_public_rendered_snapshot browser helper returning only final URL/title/text/HTML
  • Adapter Health now understands Playwright/Chromium as an optional runtime and distinguishes package presence from executable availability
  • Clean base wheel correctly reports kuaishou-atlas optional_unavailable; configured Playwright + Chrome reports healthy
  • Registry grows to 26 routes/standards with 26 deterministic contract fixtures
  • 97 local tests, clean-wheel validation, bilingual README link checks, YAML validation, secret scan, fixed Live Matrix, and Kuaishou atlas manual live validation passed
  • GitHub Actions success across all five jobs including browser-extra

This release keeps browser execution inside the public-only boundary: normal anonymous page execution is allowed, but page-generated device state and protected requests are not imported, persisted, exported, manufactured, or replayed.