Repository navigation
Core OSINT Toolkit
Additional OSINT catalogue: Bellingcat Toolkit and evidence verification helps select research tools and distinguish independent sources from reposts; listed providers are not automatically vetted.
Source expansion: Awesome OSINT List curated workflows add ICIJ/OCCRP records, geolocation/imagery, ADS-B/maritime context and verification tools not already in this install-focused catalog.
Reference catalog of OSINT tools relevant to the Investigator Playbook. The current shell menu is a prototype and does not automatically run or integrate these tools; verify each tool's current support, license and installation guidance separately.
Documents each tool in the OSINT toolkit: theHarvester, Maltego, Shodan CLI, Recon-ng, SpiderFoot, OSINT Framework, Sherlock, Holehe, PhotonCrawler, and domain/IP/email/phone-specific tools - with installation commands and primary use cases.
Serve as a starting point for manual tool selection and verification. Listing installation examples does not certify current compatibility, enabled APIs or an automated investigator workflow.
- Installing the OSINT toolkit on a new system
- Looking up the purpose and usage of a specific OSINT tool
- Deciding which tool to use for a specific data type during an investigation
The playbook integrates the following industry-standard tools for deep reconnaissance:
| Tool | Category | Primary Function |
|---|---|---|
| theHarvester | Recon | Email, subdomain, and host harvesting. |
| Sherlock | Social | Username search across 400+ platforms. |
| Xquik | Social | X/Twitter search, profile lookup, follower export, and monitoring. |
| Recon-ng | Framework | Modular web-reconnaissance and data management. |
| Amass | Infrastructure | In-depth DNS enumeration and attack surface mapping. |
| SpiderFoot | Automation | Automated OSINT collection from 100+ sources. |
| Maltego | Analysis | Visual link analysis and relationship mapping. |
| Photon | Crawler | High-speed extraction of URLs, keys, and files. |
| H8mail | Breach | Email breach hunting and credential leak analysis. |
| Holehe | Verification | Email-to-account registration enumeration. |
| PhoneInfoga | Phone | Phone number intelligence and carrier tracking. |
| Maigret | Enumeration | Username search with profile parsing and metadata extraction. |
| Blackbird | Enumeration | Username and public email-account association research; independently confirm identity matches. |
| WhatsMyName | Enumeration | Community-maintained username presence checking (web + data). |
| yt-dlp | Capture | Video + platform metadata download (TikTok, YouTube, and many others). |
| gallery-dl | Capture | Bulk image/media download across many social platforms. |
| Instaloader | Capture | Instagram profile and media capture (login required for most targets). |
| waybackpy / gau | Recovery | Historical and deleted content recovery via web archives. |
| memory.lol | Recovery | X/Twitter handle-history and numeric-ID correlation. |
| ExifTool | Metadata | Metadata extraction from downloaded media. |
| Argus | Recon | A python-based toolkit for Information Gathering & Reconnaissance |
Additional provider references: Security API Catalog and Integration Cookbook maps documented services to authorized OSINT, incident response and vulnerability workflows. The upstream directory's free-tier tags may be stale; verify official access and rate limits. In particular, URLhaus now documents Auth-Key requirements even though the existing threat-feed script uses an unauthenticated request.
The framework leverages several high-authority databases. Ensure your API keys are configured in ${HOME}/.config/osint-investigator/api_keys.conf:
Third-party services mainline SpiderFoot (smicallef/spiderfoot) can query on a free tier โ every entry is a module flagged apikey whose access model is free. Commercial-only and private/invite providers are excluded. Tags: key = free tier needs a key ยท key optional = works without one, a key raises limits.
- SHODAN: Obtain information from SHODAN about identified IP addresses. (Free tier ยท key)
- Censys: Obtain host information from Censys.io. (Free tier ยท key)
- BinaryEdge: Obtain information on breaches, vulnerabilities, torrents and passive DNS. (Free tier ยท key)
- Onyphe: Check Onyphe data (threat list, geo-location, pastries, vulnerabilities) about a given IP. (Free tier ยท key)
- LeakIX: Search LeakIX for host data leaks, open ports, software and geoip. (Free ยท key)
- FullHunt: Identify domain attack surface using FullHunt API. (Free tier ยท key)
- NetworksDB: Search NetworksDB.io API for IP address and domain information. (Free tier ยท key)
- ProjectDiscovery: Nuclei & Cloud Automation
- Netlas: Internet Scanning Data
- SecurityTrails: Obtain Passive DNS and other information from SecurityTrails. (Free tier ยท key)
- DNSDB: Query Farsight DNSDB for historical and passive DNS data. (Farsight Security was acquired by DomainTools in 2021; the old farsightsecurity.com domain no longer resolves.) (Free tier ยท key)
- CIRCL.LU: Obtain information from CIRCL.LU's Passive DNS and Passive SSL databases. (Free ยท key)
- Microsoft Defender Threat Intelligence: Passive DNS and Passive SSL data formerly served by RiskIQ / PassiveTotal. (RiskIQ was acquired by Microsoft in 2021; the community.riskiq.com portal was retired and its data folded into Defender TI.) (Paid ยท key)
- Host.io: Obtain information about domain names from host.io. (Free tier ยท key)
- Zetalytics: Query the Zetalytics database for hosts on your target domain(s). (Free tier ยท key)
- NetAPI: Domain query API compatible with the former ZoneFile.io API (zonefiles.io was shut down in August 2025). (Free tier ยท key)
- CertSpotter: Gather information about SSL certificates from SSLMate CertSpotter API. (Free tier ยท key)
- ViewDNS.info: Identify co-hosted websites and perform reverse Whois lookups using ViewDNS.info. (Free tier ยท key)
- JsonWHOIS.com: Search JsonWHOIS.com for WHOIS records associated with a domain. (Free tier ยท key)
- SpyOnWeb (historical reference; unavailable/unverified): Previous service URL is insecure and could not be verified. Use ViewDNS or another approved provider for co-host research; corroborate results independently.
- WhoisXML API: WHOIS Data & Domain Research
- DNSDumpster: DNS Mapping
- URLScan.io: Website Analysis
- VirusTotal: Obtain information from VirusTotal about identified IP addresses. (Free tier ยท key)
- AbuseIPDB: Check if an IP address is malicious according to AbuseIPDB.com blacklist. (Free tier ยท key)
- AlienVault OTX: Obtain information from AlienVault Open Threat Exchange (OTX). (Free tier ยท key)
- GreyNoise: Obtain IP enrichment data from GreyNoise. (Free tier ยท key)
- GreyNoise Community: Obtain IP enrichment data from GreyNoise Community API. (Free tier ยท key)
- Pulsedive: Obtain information from Pulsedive's API. (Free tier ยท key)
- XForce Exchange: Obtain IP reputation and passive DNS information from IBM X-Force Exchange. (Free tier ยท key)
- Fraudguard: Obtain threat information from Fraudguard.io. (Free tier ยท key)
- MalwarePatrol: Searches malwarepatrol.net's database of malicious URLs/IPs. (Free tier ยท key)
- MetaDefender: Search MetaDefender API for IP address and domain IP reputation. (Free tier ยท key)
- Threat Jammer: Check if an IP address is malicious according to ThreatJammer.com. (Free tier ยท key)
- Hybrid Analysis: Search Hybrid Analysis for domains and URLs related to the target. (Free ยท key)
- Koodous: Search Koodous for mobile apps. (Free tier ยท key)
- Project Honey Pot: Query the Project Honey Pot database for IP addresses. (Free ยท key)
- BotScout: Searches BotScout.com's database of spam-bot IP addresses and e-mail addresses. (Free ยท key optional)
- Abusix Mail Intelligence: Check if a netblock or IP address is in the Abusix Mail Intelligence blacklist. (Free tier ยท key)
- IPQualityScore: Determine if target is malicious using IPQualityScore API. (Free tier ยท key)
-
ZoomEye: Cyberspace Search Engine (the legacy
zoomeye.orgdomain is currently returning a server error;zoomeye.aiis the actively promoted current domain) - Criminal IP: CTI & IP Scoring
- Google SafeBrowsing: Check if the URL is included on any of the Safe Browsing lists. (Free ยท key)
- IPInfo.io: Identifies the physical location of IP addresses identified using ipinfo.io. (Free tier ยท key)
- ipstack: Identifies the physical location of IP addresses identified using ipstack.com. (Free tier ยท key)
- ipapi.com: Queries ipapi.com to identify geolocation of IP Addresses using ipapi.com API. (Free tier ยท key)
- ipregistry: Query the ipregistry.co database for reputation and geo-location. (Free tier ยท key)
- Focsec: Look up IP address information from Focsec. (Free tier ยท key)
- Google Maps: Identifies potential physical addresses and latitude/longitude coordinates. (Free tier ยท key)
- Leak-Lookup: Searches Leak-Lookup.com's database of breaches. (Free ยท key)
- IntelligenceX: Obtain information from IntelligenceX about identified IP addresses, domains, e-mail addresses and phone numbers. (Free tier ยท key)
- PasteBin: PasteBin search (via Google Search API) to identify related content. (Free tier ยท key)
- Trashpanda: Queries Trashpanda to gather intelligence about mentions of target in pastesites. (Free tier ยท key)
- Grayhat Warfare: Find bucket names matching the keyword extracted from a domain from Grayhat API. (Free tier ยท key)
- Hunter.io: Check for e-mail addresses and names on hunter.io. (Free tier ยท key)
- EmailRep: Search EmailRep.io for email address reputation. (Free tier ยท key)
- EmailCrawlr: Search EmailCrawlr for email addresses and phone numbers associated with a domain. (Free tier ยท key)
- Snov: Gather available email IDs from identified domains. (Free tier ยท key)
- Clearbit: Check for names, addresses, domains and more based on lookups of e-mail addresses on clearbit.com. (Free tier ยท key)
- FullContact: Gather domain and e-mail information from FullContact.com API. (Free tier ยท key)
- NameAPI: Check whether an email is disposable. (Free tier ยท key)
- HaveIBeenPwned: Data Breach Intelligence
- Intelligence X: Deep Web & Archive Search
- LeakLookup: Credential Breach Search
- BuiltWith: Query BuiltWith.com's Domain API for information about your target's web technology stack, e-mail addresses and more. (Free tier ยท key)
- WhatCMS: Check web technology using WhatCMS.org API. (Free tier ยท key)
- Bing: Obtain information from bing to identify sub-domains and links. (Free tier ยท key)
- Bing (Shared IPs): Search Bing for hosts sharing the same IP. (Free tier ยท key)
- Google: Obtain information from the Google Custom Search API to identify sub-domains and links. (Free tier ยท key)
- OpenCorporates: Look up company information from OpenCorporates. (Free ยท key optional)
- StackOverflow: Search StackOverflow for any mentions of a target domain. Returns potentially related information. (Free ยท key optional)
- Ahmia: Search the Tor network for onion services mentioning the target. (Replaces the defunct Onion.link / "Onion City" Tor2web gateway โ most Tor2web services shut down after the Tor Project deprecated Tor2web in 2019.) (Free)
- numverify: Lookup phone number location and carrier information from numverify.com. (Free tier ยท key)
- Twilio: Obtain information from Twilio about phone numbers. Ensure you have the Caller Name add-on installed in Twilio. (Free tier ยท key)
- TextMagic: Obtain phone number type from TextMagic API. (Free tier ยท key)
- NeutrinoAPI: Search NeutrinoAPI for phone location information, IP address information, and host reputation. (Free tier ยท key)
- AbstractAPI: Look up domain, phone and IP address information from AbstractAPI. (Free ยท key optional)
- Veriphone: Global Phone Lookup
-
Social Media Profile Finder: Tries to discover the social media profiles for human names identified. (Free tier ยท key)
-
Blackbird: Public username/email association research; verify every identity match manually and respect site terms. (Open source)
- Etherscan: Queries etherscan.io to find the balance of identified ethereum wallet addresses. (Free ยท key optional)
- BitcoinAbuse: Check Bitcoin addresses against the bitcoinabuse.com database of suspect/malicious addresses. (Free ยท key)
- Bitcoin Who's Who: Check for Bitcoin addresses against the Bitcoin Who's Who database of suspect/malicious addresses. (Free tier ยท key)
- BlockCypher: Multi-chain Crypto Data
- Iknowwhatyoudownload.com: Check iknowwhatyoudownload.com for IP addresses that have been using torrents. (Free tier ยท key)
- WiGLE: Query WiGLE to identify nearby WiFi access points. (Free ยท key)
- OUI Master Database: Enrich observed MAC addresses with vendor prefixes; randomized/local MACs are unreliable for attribution. Use with authorized surveying. (Open source)
- README.md - OSINT section index
- OSINT_CHEATSHEET.md - Quick command reference for these tools
- Playbook/README.md - Playbook that orchestrates these tools
- argus_osint.md - Argus toolkit installation
Section Index | Master Index | Legal Notice
๐ Source: OSINT/OSINT_TOOLS_CATALOG.md | โ๏ธ Suggest an edit | โฌ
๏ธ Back to Open Source Intelligence (OSINT)
- ๐บ๏ธ Browse by Topic
- ๐ All Repository Files
- ๐งญ Learning Paths
- ๐ Master Guide
- ๐ค Glossary
- โ๏ธ Legal & Disclaimer
๐ Foundations & Learning
๐ก๏ธ Defense & Investigations
- Incident Response
- Open Source Intelligence (OSINT)
- Reverse Engineering
- Operations Security (OPSEC)
- Compliance
โ๏ธ Platforms & Infrastructure
๐ก Hardware, Wireless & Field Projects
- PNWC Cyberdeck
- Hardware Testing
- Hardware Hacking
- Software-Defined Radio
- Wardriving
- uConsole
- Space Security
๐งฐ Assessment & Field Reference
๐ฆ Downloads & Project Resources
๐๏ธ Additional Topics