Skip to content

ShadowCrawl v2.4.3

Choose a tag to compare

View all tags
@zelda2003 zelda2003 released this 19 Feb 12:28
· 106 commits to main since this release
v2.4.3
df86a11

v2.4.3 (2026-02-19)

Feat

  • GitHub blob URL auto-rewrite: web_fetch on github.com/*/blob/* URLs is now transparently rewritten to raw.githubusercontent.com before fetching — returns the raw file/source directly instead of GitHub's React SPA shell.
  • GitHub SPA payload extraction: looks_like_spa now detects GitHub's react-app.embeddedData script tag. extract_spa_json_state extracts payload.blob.text, payload.readme, payload.issue.body, payload.pullRequest.body, payload.discussion.body from the embedded JSON — gives clean readable content on repo home pages, issues, and PR pages.
  • JSON fragment line filter in post_clean_text: Lines that are ≥55% JSON structural tokens ({}"[]:,) and lines starting with { or [ with length >40 are stripped as pipeline noise — prevents escaped GitHub SPA fragments from leaking into clean_content.

Chore (build hygiene)

  • web_fetch: extract_relevant_sections=true returns only the most relevant sections for query (short output; avoids huge tool responses).

  • Fixes cross-target build warnings caused by platform-specific cfg blocks:

    • removes unused_imports for Path/PathBuf on non-macOS targets
    • avoids dead_code warnings for setup-only helpers on Windows builds

Built locally from macOS (Apple Silicon) using cargo-zigbuild.

Assets 6
Loading