This project is a web scraper for Newegg — an online electronics marketplace — that collects product details such as names, prices, and links based on a user-defined search term.
The code is inspired by Tech With Tim’s Selenium tutorial, with additional tweaks to handle bot detection and improve scraping reliability.
- ✅ Automates product searches on Newegg
- ✅ Extracts product names, prices, and links
- ✅ Handles multiple pages using the same browser session
- ✅ Implements bot-avoidance options in Selenium
- ✅ Displays a clean summary of results sorted by price
- Python 3
- Selenium – for browser automation
- BeautifulSoup4 (bs4) – for parsing HTML
- re (Regex) – for text matching
- time – for controlling page load intervals
- Clone this repository
git clone https://github.com/yourusername/newegg-web-scraper.git cd newegg-web-scraper