List of libraries, tools and APIs for web scraping and data processing.
-
Updated
Jun 8, 2024 - Makefile
List of libraries, tools and APIs for web scraping and data processing.
The All in One Framework to build Awesome Scrapers.
Web data extraction tool implemented as chrome extension
Web scraper, crawler and parser in C#. Designed as simple, declarative and scalable web scraping solution.
Simple library which helps you to retrieve the source of various video streaming sites.
Instagram user's photos and videos downloader. Download all media files from any username. Working 2022!
Spin up Tor containers and then proxy HTTP requests via these Tor instances
📱 A tool to download android apps from Google Play Store and Xiaomi App Store (the famous Chinese Store).
Zoominfo scraper with using of rotating proxies and headless Chrome from ScrapingAnt
GPT4 Assisted Web Scraping Library
Producthunt.com famous website scraper script. Scrap all offers and save in spreadsheet excel file.
Alibaba scraper with using of rotating proxies and headless Chrome from ScrapingAnt
🚀 OFFICIAL STARTER TEMPLATE FOR BOTASAURUS SCRAPING FRAMEWORK 🤖
Building a dataset of Twitter replies for unsupervised learning / bot-blocking
An API wrapper for Scrappey.com written in Python (cloudflare, datadome bypass & solver)
An API wrapper for Scrappey.com written in Node.js (cloudflare bypass & solver)
Python script to automate the download of textbooks from Chegg
🚀 THIS WEB SCRAPING TEMPLATE PROVIDES YOU WITH A GREAT STARTING POINT WHEN CREATING WEB SCRAPING BOTS. 🤖
Digital Data Collection Workshop
A Docker-based pipeline to publish the content of a local Ghost 4 server as static pages.
Add a description, image, and links to the scraping-tool topic page so that developers can more easily learn about it.
To associate your repository with the scraping-tool topic, visit your repo's landing page and select "manage topics."