This project is an advanced web scraping tool built using JavaScript and Node.js. It can scrape static content, dynamic content (via Puppeteer), and data from APIs.
- Static Content Scraping: Scrapes content from websites with no JavaScript-rendered content.
- Dynamic Content Scraping: Handles JavaScript-heavy websites using Puppeteer.
- API Scraping: Gathers data from public or private APIs.
- Pagination Handling: Automatically loops through multiple pages of content.
-
Clone the repository:
git clone https://github.com/ayushkush26/advanced-scraper.git cd advanced-scraper