Repository navigation
Async Update! v1.0.0
This major update brings full asynchronous support to the HLTV.org scraper, drastically improving speed and efficiency by enabling parallel scraping sessions. Key improvements include:
- Complete rewrite of all scripts to use asyncio and AsyncCamoufox for faster, non-blocking requests
- Enhanced Cloudflare bypass with improved session and cookie management
- Support for proxy rotation and dynamic User-Agent switching for better stealth
- Modular and cleaner codebase for easier customization and extension
- Robust error handling and retry logic for more reliable scraping
- Detailed logging and progress reporting to keep track of scraping status
- Continued use of BeautifulSoup and pandas for parsing and data handling
Please leave feedback, either here on GitHub or on Discord :)