Scraping
Locally saves webpages to your hard disk with images, css, js & links as is.
A social networking service scraper in Python
BrowserAutomationStudio can automate everything that Chrome can.
Learn everything web scraping with David Teather Codes on YouTube
A fast and powerful http toolkit that take a list of domains to find active domains and other information such as status-code, title, response-time , server, content-type and many other
Tool to find metadata and hidden information in the documents.
To extract main article from given URL with Node.js
An advanced Twitter scraping & OSINT tool written in Python that doesn't use Twitter's API, allowing you to scrape a Tweets and more while evading most API limitations.
Get unified metadata from websites using Open Graph, Microdata, RDFa, Twitter Cards, JSON-LD, HTML, and more.
DOMPurify - a DOM-only, super-fast, uber-tolerant XSS sanitizer for HTML, MathML and SVG. DOMPurify works with a secure default, but offers a lot of configurability and hooks. Demo:
Introducing AmazonMe, a Python-based web scraper designed to extract data from amazon.com using the requests and beautifulSoup libraries. It simplifies navigation and makes it easy to gather inform…
Search Engine Position Rank Tracking App
Official Implementation of OCR-free Document Understanding Transformer (Donut) and Synthetic Document Generator (SynthDoG), ECCV 2022
Scrapy, a fast high-level web crawling & scraping framework for Python.
Library that helps use puppeteer in scrapy.

