Repository navigation
v1.0.0 - Initial Release
Features
- Incremental Scraping: Only fetch new or updated events based on existing CSV data.
- Detailed Event Information: Optionally scrape detailed specifications for each event using the
--detailsflag. - Flexible Date Range: Users can specify custom date ranges for scraping.
- Data Management with pandas: Efficiently handle data merging and updates using pandas.
- Error Handling and Logging: Robust handling of common web scraping issues like
StaleElementReferenceExceptionand appropriate wait times for element loading.
Improvements
- Optimized scraping performance to reduce script execution time.
- Enhanced reliability in reading and writing data to the CSV file.
Bug Fixes
- Resolved issues related to incorrect
current_daysettings for some events. - Improved exception handling to prevent unexpected script termination.
Usage
For more information on how to use the scraper, refer to the README.