Skip to content

This project is an advanced web scraping tool built using JavaScript and Node.js. It can scrape static content, dynamic content (via Puppeteer), and data from APIs.

License

Notifications You must be signed in to change notification settings

ayushkush26/webscraper

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

2 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Advanced Scraper Project

Overview

This project is an advanced web scraping tool built using JavaScript and Node.js. It can scrape static content, dynamic content (via Puppeteer), and data from APIs.

Features

  • Static Content Scraping: Scrapes content from websites with no JavaScript-rendered content.
  • Dynamic Content Scraping: Handles JavaScript-heavy websites using Puppeteer.
  • API Scraping: Gathers data from public or private APIs.
  • Pagination Handling: Automatically loops through multiple pages of content.

Installation

  1. Clone the repository:

    git clone https://github.com/ayushkush26/advanced-scraper.git
    cd advanced-scraper

About

This project is an advanced web scraping tool built using JavaScript and Node.js. It can scrape static content, dynamic content (via Puppeteer), and data from APIs.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published