Skip to content

0.2.1

Choose a tag to compare

@Lucifer-02 Lucifer-02 released this 12 Sep 05:10
· 17 commits to master since this release

Release Notes

✨ New Features

  • Real Proxy Rotation & Context Isolation: Added ProxyRotator and create_browser_context (src/map_miner/scraper.py) for per-task network isolation and zero context leaks.
  • Persistent Disk Cache: Added --disk-cache-dir with a 1 GB cap, reducing wire data transfer by ~94.5%.
  • Proxy Bypass: Added DEFAULT_PROXY_BYPASS for static assets to cut proxy bandwidth usage by ~40%.
  • Extended Telemetry Blocking: Aborted client_204, cspreport, and /maps/photometa beacon requests.
  • Test Suite: Expanded test coverage from 27 to 41 unit tests.

🔄 Changes

  • Assigned proxies at BrowserContext level instead of process level.
  • Updated proxy type annotations and added .cache/ to .gitignore.

🐛 Bug Fixes

  • Resolved HTTP/2 multiplexing issues that prevented rotating proxy gateways from rotating IPs.
  • Fixed cross-query cookie and cache fingerprinting across concurrent searches.