Uscrapper Vanta: Dive deeper into the web with this powerful open-source tool. Extract valuable insights with ease and efficiency, from both surface and deep web sources. Empower your data mining and analysis with Vanta's advanced capabilities. Fast, reliable, and user-friendly, Uscrapper Vanta is the ultimate choice for researchers and analysts.

Automatically curates and posts content to LinkedIn. It can optionally use web scraping to gather data, which is then fed to ChatGPT to craft engaging LinkedIn posts.

Python-based web crawling script with randomized intervals, user-agent rotation, and proxy server IP rotation to outsmart website bots and prevent blocking.

ScrapeGPT is a RAG-based Telegram bot designed to scrape and analyze websites, then answer questions based on the scraped content. The bot utilizes Retrieval Augmented Generation and webscraping to return natural language answers to the user's queries.

JSON collection of scraped file extensions, along with their description and type, from FileInfo.com

Scraper for https://marvelsnapzone.com to retrieve metadata of Marvel SNAP cards.

Web scraping, web harvesting, or web data extraction is data scraping used for extracting data from websites.Web scraping a web page involves fetching it and extracting from it.Web scraping automatically extracts data and presents it in a format you can easily make sense of.Use of APIs being probably the best way to extract data from a website. …

A spider to crawl webpages

Download ALL the images (JPEG/GIF/PNG) from any Tumblr website! This project employs Python3 and BeautifulSoup4 to scrape a Tumblr site (with the url provided by the user) to download, page by page, all the images from the Tumblr site's posts. Ideal for archiving other peoples' Tumblrs <3

DPULSE - Tool for complex approach to domain OSINT

This script scrapes the verses and references from an openbible.info page into a JSON file - if needed, we use bible-api.com to translate to another bible version.

This script downloads manhua, manga or manhwa and save them in a same name directory.

A scraper for gathering data from Facebook's embedded comment widgets for all pages on any number of URLs! It bypasses the Facebook graph API (you don't need an access token) so there's little risk of throttling.

In this repository, I am sharing the Web Scraper for SEO Marketers in which they can extract metadata from the websites whether it's a static website or a Javascript-based website.

This scanner will allow you to collect information an you target site.

Airbnb listing scraper

Web-Site Scraping Utility

This is a website url scraper built using python.

Spider through a website login and process the pages behind it.

Scrapes any website to retrieve all hyperlinks from it in a matter of seconds. Scraping made easy!