Repository navigation
Releases
v0.23.4
Full Changelog: v0.23.3...v0.23.4
v0.23.3
v0.23.2
v0.23.1
Security and distribution hardening release.
- Close DNS-rebinding/SSRF validation-to-connect gaps by pinning validated public endpoints and verifying peers.
- Guard browser fallback navigation and requests against non-public destinations.
- Treat extracted remote content as untrusted data to prevent indirect prompt-injection escalation.
- Require explicit trusted-proxy opt-in for proxy-based remote DNS.
- Align Agent Skill metadata and ClawHub thin-bundle distribution boundaries.
All 128 tests pass locally; GitHub CI covers Python 3.10/3.12/3.14 plus service, MCP, and browser extras.
ShareXtract v0.23.0
LinkedIn public-post extraction through the official anonymous Embed representation for posts eligible for off-LinkedIn embedding.
Highlights:
- Adds linkedin-post for normal /posts/...-activity-{id}-..., /feed/update/urn:li:activity:{id}, and public embed URLs
- Uses LinkedIn activity ID as the stable content identity
- Consumes only the anonymous public Embed page; no OAuth, access token, li_at cookie, login automation, or browser runtime
- Normalizes author name/URL/type, follower display, commentary, relative publication display, reaction count, and comment count
- Exports only images explicitly present in feed-images content
- Keeps profile images, company logos, and generic Open Graph previews out of post media
- Normalizes article/link attachments separately with URL, title, subtitle, and thumbnail
- Does not export LinkedIn comment bodies; only the public comment count is normalized
- Validates Embed activity URN against the requested activity ID
- Falls back to public Open Graph description only when Embed commentary is absent
- Posts that are not eligible for off-LinkedIn embedding fail cleanly instead of triggering authentication fallback
- Two real Microsoft samples validated: one article attachment post and one image post
- Registry grows to 33 routes/standards with 33 contract fixtures and 21 configured live samples
- 123 local tests, clean-wheel validation, bilingual README link checks, YAML validation, secret scan, and full Live Matrix passed
- GitHub Actions success across all five jobs
This release treats public embed eligibility as an explicit provider policy boundary rather than something to bypass.
ShareXtract v0.22.0
Threads, Instagram and Facebook public-post extraction through standard Open Graph with Meta tokenless oEmbed as a resilient official enhancement layer.
Highlights:
- Adds threads-post, instagram-post and facebook-post native adapters
- Uses standard public Open Graph as the readable-content contract
- Uses Meta tokenless oEmbed only as a best-effort official embed/provider enhancement
- Requires no Meta Developer App, access token, login cookie or browser runtime
- Threads: extracts public text/username and intentionally does not export og:image as post media because live validation shows text posts can expose the profile image
- Instagram: extracts caption, username, displayed likes/comments, post/reel type and public thumbnail; shortcode remains stable identity and video stream URLs are never exported
- Facebook: extracts author, public post summary and preview image; provider-declared numeric canonical identifiers are recorded separately from requested public identity
- Uses unversioned tokenless Instagram/Facebook oEmbed endpoints to avoid coupling ShareXtract to a rolling Graph API version
- All three adapters preserve Open Graph content if tokenless oEmbed is temporarily unavailable
- Fixes SafeHttpClient default User-Agent to track the actual runtime ShareXtract version instead of remaining hard-coded to 0.1
- Registry grows to 32 routes/standards with 32 contract fixtures and 20 configured live samples
- 118 local tests, clean-wheel validation, bilingual README link checks, YAML validation, secret scan and full Live Matrix passed
- GitHub Actions success across all five jobs
This release continues the project policy of standard/open public content first, official tokenless embeds as enhancement, and browser execution only as a last resort.
ShareXtract v0.21.0
Pinterest public Pin extraction through standard Open Graph metadata on anonymous public Pin HTML.
Highlights:
- Adds pinterest-pin for direct public Pinterest Pin URLs, including localized pinterest.com subdomains and slugged Pin paths
- Uses only standard Open Graph metadata already present in anonymous static HTML
- Normalizes requested Pin ID, title, description, public image URL/dimensions, updated time, source link, and Pinterest-declared metadata
- Does not parse PWS_DATA, PWS_INITIAL_PROPS, or other internal PWS bootstrap state
- Does not call undocumented pidgets APIs, require Pinterest API tokens, or use browser rendering
- Reuses ShareXtract existing generic Open Graph parser instead of duplicating HTML parsing
- Adds a Pinterest-specific identity safeguard: live validation showed link rel=canonical and og:url can point to a different Pin ID whose fetched content has different title/image/time
- Therefore the requested Pin ID remains ShareXtract stable canonical/dedupe identity; Pinterest-declared canonical/OG URLs are recorded separately with an explicit mismatch flag
- Three real public Pins validated; both matching and mismatching declared-canonical cases covered
- Adds a fixed Pinterest Live Health sample and deterministic contract fixture
- Registry grows to 29 routes/standards with 29 contract fixtures and 17 configured live samples
- 109 local tests, clean-wheel validation, bilingual README link checks, YAML validation, secret scan, and full Live Matrix passed
- GitHub Actions success across all five jobs
This release keeps Pinterest extraction standards-based and public-only while avoiding false deduplication caused by Pinterest content-level canonicalization behavior.
ShareXtract v0.20.0
Telegram public channel/group post extraction through the official anonymous Post Widget.
Highlights:
- Adds telegram-post for public t.me/channel/message_id and compatible telegram.me URLs
- Uses Telegram official anonymous Post Widget HTML with no login, Bot Token, OAuth, or browser runtime
- Normalizes author/channel, message text, exact timestamp, view count, verification state, reactions, link-preview metadata, and public photos
- Text/link-preview sample t.me/telegram/83 live-verified
- Photo/reaction sample t.me/durov/43 live-verified
- Does not call or export widget auth/upload API configuration
- Does not export temporary audio/video playback stream URLs
- Pure HTTP + HTML parsing keeps this adapter lightweight and deterministic
- Adds a fixed documented Live Health sample and contract fixture
- Registry grows to 28 routes/standards with 28 contract fixtures and 16 configured live samples
- 105 local tests, clean-wheel validation, bilingual README link checks, YAML validation, secret scan, and full Live Matrix passed
- GitHub Actions success across all five jobs
Telegram officially documents its Post Widget for messages from public channels and groups; this release consumes only that public embedding surface and excludes auth/upload helpers and temporary streams.
ShareXtract v0.19.0
Reddit public posts and threads through documented oEmbed, with standard Atom RSS as a resilient content enhancement.
Highlights:
- Adds reddit-oembed for public Reddit thread and comment-permalink URLs
- Uses documented https://www.reddit.com/oembed?url=... as the stable primary public contract
- Reuses ShareXtract standard Atom parser against thread .rss for post body and comments
- Maps Atom entry zero to the post body and later entries to normalized comment messages with author, timestamp and permalink
- RSS is explicitly best-effort: 403/429/unavailability preserves the oEmbed result instead of failing the adapter
- extraction_method remains documented_reddit_oembed so RSS rate limits do not create false protocol drift
- Does not call currently blocked Reddit .json post endpoints
- Requires no Reddit OAuth, login cookies, copied credentials, or browser automation
- Comment permalinks canonicalize to their parent thread
- Adds a fixed Reddit Live Health sample and deterministic contract fixture
- Registry grows to 27 routes/standards with 27 contract fixtures and 15 configured live samples
- Manual live verification successfully returned the original post body plus 12 comments; a later clean-wheel run hit RSS 403 while oEmbed still succeeded, validating the intended layered fallback
- 101 local tests, clean-wheel validation, bilingual README link checks, YAML validation, secret scan, and full Live Matrix passed
- GitHub Actions success across all five jobs
This release deliberately respects Reddit current API access policy: the blocked anonymous .json surface is not bypassed. ShareXtract relies on Reddit public oEmbed and open Atom syndication instead.
ShareXtract v0.18.0
Kuaishou public atlas/image extraction through an isolated anonymous browser route, plus accurate optional-runtime health reporting.
Highlights:
- Adds kuaishou-atlas for current public picture/atlas share pages and short links
- Keeps kuaishou-video ahead of atlas so ordinary videos remain on the lighter anonymous Apollo SSR path
- Recognizes that current image-share static window.INIT_STATE is empty and uses browser rendering only as a last resort
- Opens a fresh anonymous browser context with no imported cookies, storage, or account state
- Scopes extraction to the active .swiper-slide-active .player work so recommendation cards are not mixed into the result
- Normalizes author, caption, topics, visible like/comment/collection counts, avatar, music title, and public /ufile/atlas/ image URLs
- Release-time live validation extracted 31 original atlas images from the current work
- Does not pre-seed, copy, manufacture, export, or persist did/browser visitor state
- Does not generate or replay __NS_hxfalcon or other protected internal request parameters
- Does not convert page-internal protected requests into a private API integration
- Excludes audio/video streams, protected request URLs, share tokens, and browser storage from normalized output
- Adds a generic fetch_public_rendered_snapshot browser helper returning only final URL/title/text/HTML
- Adapter Health now understands Playwright/Chromium as an optional runtime and distinguishes package presence from executable availability
- Clean base wheel correctly reports kuaishou-atlas optional_unavailable; configured Playwright + Chrome reports healthy
- Registry grows to 26 routes/standards with 26 deterministic contract fixtures
- 97 local tests, clean-wheel validation, bilingual README link checks, YAML validation, secret scan, fixed Live Matrix, and Kuaishou atlas manual live validation passed
- GitHub Actions success across all five jobs including browser-extra
This release keeps browser execution inside the public-only boundary: normal anonymous page execution is allowed, but page-generated device state and protected requests are not imported, persisted, exported, manufactured, or replayed.