Skip to content

scrAPE v0.19.0

Choose a tag to compare

@rhaffle87 rhaffle87 released this 23 Jul 13:41
· 209 commits to main since this release

scrAPE v0.19.0 Release Notes

Release Date: July 23, 2026
Package Version: 0.19.0
Git Tag: v0.19.0
Distribution Build: dist/scrape_dashboard-0.19.0-py3-none-any.whl & dist/scrape_dashboard-0.19.0.tar.gz


🌟 High-Impact Upgrades in v0.19.0

1. FlareSolverr 127.0.0.1:8191 & Background Docker Auto-Start

  • Configured default FLARESOLVERR_URL to "http://127.0.0.1:8191/v1" with fallback to localhost:8191, resolving Windows IPv6 resolution latency.
  • Implemented background Docker container launch (docker start flaresolverr) when port 8191 is unreachable on startup.
  • Enriched downstream CDN streaming media requests with harvested domain session cookies (session_id).

2. Dual Token-Bucket Speed & Rate Limiting

  • Page Rate Limiting (--rate-limit / RPS): Regulates outgoing page HTTP request rate.
  • Download Speed Limiting (--dl-speed-limit / KBPS): Throttles network bandwidth across active media chunk streams.

3. Extended High-Resolution URL Heuristics

  • Added path transformation rules for Erome (/t/ / /th/ $\rightarrow$ /v/) and WordPress (-scaled.jpg / -scaled.png stripping).

4. Search Query Pre-Filtering (is_search_page_url)

  • Intercepts and skips un-crawlable search query endpoints (/search?q=, ?text=, search_query=) on Google, Vimeo, Flickr, and YouTube before request allocation.

📦 Distribution Packages Built

dist/
├── scrape_dashboard-0.19.0-py3-none-any.whl   (9.9 KB Wheel Package)
└── scrape_dashboard-0.19.0.tar.gz             (48.2 KB Source Distribution)

🧪 Verification Benchmarks

  • pytest Test Suite: 131 passed in 2m 48s (0 failures, 0 errors).
  • Multi-Seed Live Scrape: 1,643 images and 202 videos (~9.31 GB) collected across test seed runs.