Repository navigation
v0.4.2: Mobile Proxy Auto-Rotation, PyInstaller CA Resilience & curl (77) Graceful Fallback
LatestRelease v0.4.2: Mobile Proxy Auto-Rotation, PyInstaller CA Resilience & curl (77) Graceful Fallback
🚀 Highlights & New Features
🔄 Mobile Proxy Auto-Rotation & Multi-Threaded Scraping
- First-Class Mobile Proxy Support: High-performance multi-threaded scraping architecture specifically engineered to operate with rotating mobile proxies (including MobileProxy.space).
- Automated IP Rotation: Transparent support for external IP-change rotation URLs (
change_ip_url) with configurable cooldowns, health checks, and automatic retries upon rate-limiting (HTTP 429/403). - Parallel Concurrency: Enables scaling scraping workloads across multiple workers without risking subnet bans or anti-bot blocks.
🛡️ PyInstaller & Bundled Runtime CA Resilience (fixes Duff89/parser_avito#346)
_MEIPASSDiscovery:get_ca_bundle()now dynamically locatescacert.peminside PyInstaller's temporary unpack directories (sys._MEIPASS) or environment variables (CURL_CA_BUNDLE,REQUESTS_CA_BUNDLE,SSL_CERT_FILE).- Windows 8.3 Short Paths: Implemented path normalization via
GetShortPathNameWon Windows, resolving libcurl issues when user profile directory paths contain Cyrillic, spaces, or non-ASCII characters.
⚡ Resilient SSL Fallback (curl: (77))
- Zero-Downtime Auto-Recovery: Integrated automatic detection of
curl: (77) error setting certificate verify locationsacross both synchronous (SyncHttpTransport) and asynchronous (AsyncHttpTransport) engines. - Graceful Fallback: Transparently recovers and retries requests with
verify=Falseif certificate stores are corrupted or inaccessible, ensuring continuous parser execution without process crashes.
🐛 Bug Fixes & Improvements
- Typing Imports: Resolved missing
Any,Tuple, andAvitoConfigtype hints across models, exporters, and parameters parser. - Cross-Platform ProcessGuard: Harmonized process collision detection messages and regex patterns across Windows, Linux, and macOS (
flock).
📦 Installation
Install or upgrade via pip or uv:
pip install --upgrade avito-sdk
# or with uv
uv add avito-sdk