DPULSE - Tool for complex approach to domain OSINT
-
Updated
Jul 24, 2024 - Python
DPULSE - Tool for complex approach to domain OSINT
Python-based web crawling script with randomized intervals, user-agent rotation, and proxy server IP rotation to outsmart website bots and prevent blocking.
Uscrapper Vanta: Dive deeper into the web with this powerful open-source tool. Extract valuable insights with ease and efficiency, from both surface and deep web sources. Empower your data mining and analysis with Vanta's advanced capabilities. Fast, reliable, and user-friendly, Uscrapper Vanta is the ultimate choice for researchers and analysts.
Web Link Crawler: A Python script to crawl websites and collect links based on a regex pattern. Efficient and customizable.
Introducing NightFall, a cutting-edge tool revolutionizing Open-Source Intelligence. Dive deeper into the vast web with NightFall, unlocking unparalleled data extraction capabilities. NightFall empowers users to explore uncharted territories of the dark web and unearth hidden gems with pinpoint accuracy, courtesy of its advanced keyword extraction.
Scraper for https://marvelsnapzone.com to retrieve metadata of Marvel SNAP cards.
Automatically curates and posts content to LinkedIn. It can optionally use web scraping to gather data, which is then fed to ChatGPT to craft engaging LinkedIn posts.
Use GPTparser with your OpenAI API to scrape & parse files into structured JSON files.
A robust Image Scraper that leverages OpenAI's GPT Chat Completions to determine the relevant HTML used to Scrape Images from websites.
Transform your website into a dynamic and interactive platform with SiteAssistant AI. Built with Python, Streamlit, LangChain, Openai - GPT 3.5
ScrapeGPT is a RAG-based Telegram bot designed to scrape and analyze websites, then answer questions based on the scraped content. The bot utilizes Retrieval Augmented Generation and webscraping to return natural language answers to the user's queries.
Manga Scraping Tool made in python, It fetches the manga page from the website and downloads it in JPG format and saves it locally. This is basically web Scraping
Web scraping using Scrapy framework is often the most efficient way to gather structured data from websites, and this project showcases its power and flexibility in action.
This script scrapes the verses and references from an openbible.info page into a JSON file - if needed, we use bible-api.com to translate to another bible version.
Python Script To Verify Url Existence And Provide Basic Information
This Python script scrapes Salatomatic for US masjid data, including names, locations, and phone numbers. It uses requests, BeautifulSoup, and csv modules for web scraping and CSV handling.
Simple program which is able to extract the video stream from online streaming sites and show it using VLC
Download all anime episodes from gogoanime simultaneously. This is provided as a Python package.
This script downloads manhua, manga or manhwa and save them in a same name directory.
There is a script for scraping yellowpages.com website for name, contact, address and link
Add a description, image, and links to the website-scraper topic page so that developers can more easily learn about it.
To associate your repository with the website-scraper topic, visit your repo's landing page and select "manage topics."