Repository navigation
WebScraper Pro 1.4.0
WebScraper Pro - Commercial Web Scraping Application
Features
Core Engine
- Static Scraping: Fast HTTP-based scraping with requests + BeautifulSoup
- Dynamic Scraping: Full browser automation with Playwright (JavaScript rendering)
- Auto Mode: Automatically selects the best scraping method
- Proxy Rotation: Multiple strategies (random, round-robin, least-used, fastest)
- Rate Limiting: Token bucket, sliding window, fixed delay, adaptive algorithms
- Smart Parsing: CSS Selector, XPath, Regex, JSON Path, Table extraction
Data Export
- CSV (Excel-compatible with UTF-8 BOM)
- JSON (pretty-printed)
- Excel XLSX (with formatting, auto-filter, frozen headers)
- XML (structured)
- HTML Table (styled, responsive)
- SQLite Database
Professional UI
- Modern dark/light theme
- Dashboard with real-time progress
- Visual extraction rules manager
- Proxy management with health monitoring
- Task scheduler for automated scraping
- Comprehensive settings panel
Advanced Features
- Stealth mode to avoid bot detection
- Custom page actions (click, type, scroll, wait)
- Auto-scroll for infinite pages
- Link following and crawling
- Per-domain rate limiting
- Scheduled tasks (interval, daily, weekly, monthly)
Installation
- Download and extract the ZIP file
- Run
WebScraperPro.exe - No installation required - portable application
System Requirements
- Windows 10/11 (64-bit)
- ~150 MB disk space
- Internet connection for scraping
Built with Python, CustomTkinter, Playwright, and BeautifulSoup