Skip to content

Web Automation and Data Scrapping project from devconf website using puppeter.

Notifications You must be signed in to change notification settings

ardhrubo/webautomation

Repository files navigation

Project Title: Web Scraping with Puppeteer and P-Queue

Overview

This project showcases the power of Puppeteer and P-Queue for efficient web scraping. By leveraging these tools, you can easily scrape links from any website with ease and speed.

Installation

  1. Clone the repository: git clone https://github.com/your-username/your-repository.git
  2. Install dependencies: npm install

Usage

  1. Run the script: node intro.mjs
  2. Watch as the script efficiently scrapes links and saves screenshots in the 'images' directory.
  3. Explore the possibilities of web scraping with Puppeteer and P-Queue!

Contributing

Contributions are welcome! Please open an issue to discuss any major changes before submitting a pull request.

License

This project is licensed under the MIT License. See the LICENSE file for details.


This will start the script and begin the web scraping process. Screenshots of the visited pages will be saved in the 'images' directory.

Contributing Pull requests are welcome. For major changes, please open an issue first to discuss what you would like to change.

License MIT

About

Web Automation and Data Scrapping project from devconf website using puppeter.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published