Skip to content

v0.4.2: Mobile Proxy Auto-Rotation, PyInstaller CA Resilience & curl (77) Graceful Fallback

Latest

Choose a tag to compare

@eminsk eminsk released this 16 Nov 19:38
· 1 commit to main since this release

Release v0.4.2: Mobile Proxy Auto-Rotation, PyInstaller CA Resilience & curl (77) Graceful Fallback

🚀 Highlights & New Features

🔄 Mobile Proxy Auto-Rotation & Multi-Threaded Scraping

  • First-Class Mobile Proxy Support: High-performance multi-threaded scraping architecture specifically engineered to operate with rotating mobile proxies (including MobileProxy.space).
  • Automated IP Rotation: Transparent support for external IP-change rotation URLs (change_ip_url) with configurable cooldowns, health checks, and automatic retries upon rate-limiting (HTTP 429/403).
  • Parallel Concurrency: Enables scaling scraping workloads across multiple workers without risking subnet bans or anti-bot blocks.

🛡️ PyInstaller & Bundled Runtime CA Resilience (fixes Duff89/parser_avito#346)

  • _MEIPASS Discovery: get_ca_bundle() now dynamically locates cacert.pem inside PyInstaller's temporary unpack directories (sys._MEIPASS) or environment variables (CURL_CA_BUNDLE, REQUESTS_CA_BUNDLE, SSL_CERT_FILE).
  • Windows 8.3 Short Paths: Implemented path normalization via GetShortPathNameW on Windows, resolving libcurl issues when user profile directory paths contain Cyrillic, spaces, or non-ASCII characters.

⚡ Resilient SSL Fallback (curl: (77))

  • Zero-Downtime Auto-Recovery: Integrated automatic detection of curl: (77) error setting certificate verify locations across both synchronous (SyncHttpTransport) and asynchronous (AsyncHttpTransport) engines.
  • Graceful Fallback: Transparently recovers and retries requests with verify=False if certificate stores are corrupted or inaccessible, ensuring continuous parser execution without process crashes.

🐛 Bug Fixes & Improvements

  • Typing Imports: Resolved missing Any, Tuple, and AvitoConfig type hints across models, exporters, and parameters parser.
  • Cross-Platform ProcessGuard: Harmonized process collision detection messages and regex patterns across Windows, Linux, and macOS (flock).

📦 Installation

Install or upgrade via pip or uv:

pip install --upgrade avito-sdk
# or with uv
uv add avito-sdk