Skip to content

Core OSINT Toolkit

github-actions[bot] edited this page Nov 15, 2026 · 1 revision

Additional OSINT catalogue: Bellingcat Toolkit and evidence verification helps select research tools and distinguish independent sources from reposts; listed providers are not automatically vetted.

Source expansion: Awesome OSINT List curated workflows add ICIJ/OCCRP records, geolocation/imagery, ADS-B/maritime context and verification tools not already in this install-focused catalog.

๐ŸŽฏ Purpose

Reference catalog of OSINT tools relevant to the Investigator Playbook. The current shell menu is a prototype and does not automatically run or integrate these tools; verify each tool's current support, license and installation guidance separately.

โš™๏ธ Function

Documents each tool in the OSINT toolkit: theHarvester, Maltego, Shodan CLI, Recon-ng, SpiderFoot, OSINT Framework, Sherlock, Holehe, PhotonCrawler, and domain/IP/email/phone-specific tools - with installation commands and primary use cases.

๐Ÿ† Goal

Serve as a starting point for manual tool selection and verification. Listing installation examples does not certify current compatibility, enabled APIs or an automated investigator workflow.

๐Ÿ“‹ When to Use

  • Installing the OSINT toolkit on a new system
  • Looking up the purpose and usage of a specific OSINT tool
  • Deciding which tool to use for a specific data type during an investigation

The playbook integrates the following industry-standard tools for deep reconnaissance:

Tool Category Primary Function
theHarvester Recon Email, subdomain, and host harvesting.
Sherlock Social Username search across 400+ platforms.
Xquik Social X/Twitter search, profile lookup, follower export, and monitoring.
Recon-ng Framework Modular web-reconnaissance and data management.
Amass Infrastructure In-depth DNS enumeration and attack surface mapping.
SpiderFoot Automation Automated OSINT collection from 100+ sources.
Maltego Analysis Visual link analysis and relationship mapping.
Photon Crawler High-speed extraction of URLs, keys, and files.
H8mail Breach Email breach hunting and credential leak analysis.
Holehe Verification Email-to-account registration enumeration.
PhoneInfoga Phone Phone number intelligence and carrier tracking.
Maigret Enumeration Username search with profile parsing and metadata extraction.
Blackbird Enumeration Username and public email-account association research; independently confirm identity matches.
WhatsMyName Enumeration Community-maintained username presence checking (web + data).
yt-dlp Capture Video + platform metadata download (TikTok, YouTube, and many others).
gallery-dl Capture Bulk image/media download across many social platforms.
Instaloader Capture Instagram profile and media capture (login required for most targets).
waybackpy / gau Recovery Historical and deleted content recovery via web archives.
memory.lol Recovery X/Twitter handle-history and numeric-ID correlation.
ExifTool Metadata Metadata extraction from downloaded media.
Argus Recon A python-based toolkit for Information Gathering & Reconnaissance

๐Ÿ”‘ Configuration & APIs

Additional provider references: Security API Catalog and Integration Cookbook maps documented services to authorized OSINT, incident response and vulnerability workflows. The upstream directory's free-tier tags may be stale; verify official access and rate limits. In particular, URLhaus now documents Auth-Key requirements even though the existing threat-feed script uses an unauthenticated request. The framework leverages several high-authority databases. Ensure your API keys are configured in ${HOME}/.config/osint-investigator/api_keys.conf:

API-Key Providers โ€” Free Only

SpiderFoot

Third-party services mainline SpiderFoot (smicallef/spiderfoot) can query on a free tier โ€” every entry is a module flagged apikey whose access model is free. Commercial-only and private/invite providers are excluded. Tags: key = free tier needs a key ยท key optional = works without one, a key raises limits.

1. INTERNET SCANNING & ATTACK SURFACE

  • SHODAN: Obtain information from SHODAN about identified IP addresses. (Free tier ยท key)
  • Censys: Obtain host information from Censys.io. (Free tier ยท key)
  • BinaryEdge: Obtain information on breaches, vulnerabilities, torrents and passive DNS. (Free tier ยท key)
  • Onyphe: Check Onyphe data (threat list, geo-location, pastries, vulnerabilities) about a given IP. (Free tier ยท key)
  • LeakIX: Search LeakIX for host data leaks, open ports, software and geoip. (Free ยท key)
  • FullHunt: Identify domain attack surface using FullHunt API. (Free tier ยท key)
  • NetworksDB: Search NetworksDB.io API for IP address and domain information. (Free tier ยท key)
  • ProjectDiscovery: Nuclei & Cloud Automation
  • Netlas: Internet Scanning Data

2. DNS, DOMAIN, WHOIS & CERTIFICATES

  • SecurityTrails: Obtain Passive DNS and other information from SecurityTrails. (Free tier ยท key)
  • DNSDB: Query Farsight DNSDB for historical and passive DNS data. (Farsight Security was acquired by DomainTools in 2021; the old farsightsecurity.com domain no longer resolves.) (Free tier ยท key)
  • CIRCL.LU: Obtain information from CIRCL.LU's Passive DNS and Passive SSL databases. (Free ยท key)
  • Microsoft Defender Threat Intelligence: Passive DNS and Passive SSL data formerly served by RiskIQ / PassiveTotal. (RiskIQ was acquired by Microsoft in 2021; the community.riskiq.com portal was retired and its data folded into Defender TI.) (Paid ยท key)
  • Host.io: Obtain information about domain names from host.io. (Free tier ยท key)
  • Zetalytics: Query the Zetalytics database for hosts on your target domain(s). (Free tier ยท key)
  • NetAPI: Domain query API compatible with the former ZoneFile.io API (zonefiles.io was shut down in August 2025). (Free tier ยท key)
  • CertSpotter: Gather information about SSL certificates from SSLMate CertSpotter API. (Free tier ยท key)
  • ViewDNS.info: Identify co-hosted websites and perform reverse Whois lookups using ViewDNS.info. (Free tier ยท key)
  • JsonWHOIS.com: Search JsonWHOIS.com for WHOIS records associated with a domain. (Free tier ยท key)
  • SpyOnWeb (historical reference; unavailable/unverified): Previous service URL is insecure and could not be verified. Use ViewDNS or another approved provider for co-host research; corroborate results independently.
  • WhoisXML API: WHOIS Data & Domain Research
  • DNSDumpster: DNS Mapping
  • URLScan.io: Website Analysis

3. THREAT INTELLIGENCE & IP/DOMAIN REPUTATION

  • VirusTotal: Obtain information from VirusTotal about identified IP addresses. (Free tier ยท key)
  • AbuseIPDB: Check if an IP address is malicious according to AbuseIPDB.com blacklist. (Free tier ยท key)
  • AlienVault OTX: Obtain information from AlienVault Open Threat Exchange (OTX). (Free tier ยท key)
  • GreyNoise: Obtain IP enrichment data from GreyNoise. (Free tier ยท key)
  • GreyNoise Community: Obtain IP enrichment data from GreyNoise Community API. (Free tier ยท key)
  • Pulsedive: Obtain information from Pulsedive's API. (Free tier ยท key)
  • XForce Exchange: Obtain IP reputation and passive DNS information from IBM X-Force Exchange. (Free tier ยท key)
  • Fraudguard: Obtain threat information from Fraudguard.io. (Free tier ยท key)
  • MalwarePatrol: Searches malwarepatrol.net's database of malicious URLs/IPs. (Free tier ยท key)
  • MetaDefender: Search MetaDefender API for IP address and domain IP reputation. (Free tier ยท key)
  • Threat Jammer: Check if an IP address is malicious according to ThreatJammer.com. (Free tier ยท key)
  • Hybrid Analysis: Search Hybrid Analysis for domains and URLs related to the target. (Free ยท key)
  • Koodous: Search Koodous for mobile apps. (Free tier ยท key)
  • Project Honey Pot: Query the Project Honey Pot database for IP addresses. (Free ยท key)
  • BotScout: Searches BotScout.com's database of spam-bot IP addresses and e-mail addresses. (Free ยท key optional)
  • Abusix Mail Intelligence: Check if a netblock or IP address is in the Abusix Mail Intelligence blacklist. (Free tier ยท key)
  • IPQualityScore: Determine if target is malicious using IPQualityScore API. (Free tier ยท key)
  • ZoomEye: Cyberspace Search Engine (the legacy zoomeye.org domain is currently returning a server error; zoomeye.ai is the actively promoted current domain)
  • Criminal IP: CTI & IP Scoring
  • Google SafeBrowsing: Check if the URL is included on any of the Safe Browsing lists. (Free ยท key)

4. IP GEOLOCATION & NETWORK DATA

  • IPInfo.io: Identifies the physical location of IP addresses identified using ipinfo.io. (Free tier ยท key)
  • ipstack: Identifies the physical location of IP addresses identified using ipstack.com. (Free tier ยท key)
  • ipapi.com: Queries ipapi.com to identify geolocation of IP Addresses using ipapi.com API. (Free tier ยท key)
  • ipregistry: Query the ipregistry.co database for reputation and geo-location. (Free tier ยท key)
  • Focsec: Look up IP address information from Focsec. (Free tier ยท key)
  • Google Maps: Identifies potential physical addresses and latitude/longitude coordinates. (Free tier ยท key)

5. EMAIL, BREACH & CREDENTIAL INTELLIGENCE

  • Leak-Lookup: Searches Leak-Lookup.com's database of breaches. (Free ยท key)
  • IntelligenceX: Obtain information from IntelligenceX about identified IP addresses, domains, e-mail addresses and phone numbers. (Free tier ยท key)
  • PasteBin: PasteBin search (via Google Search API) to identify related content. (Free tier ยท key)
  • Trashpanda: Queries Trashpanda to gather intelligence about mentions of target in pastesites. (Free tier ยท key)
  • Grayhat Warfare: Find bucket names matching the keyword extracted from a domain from Grayhat API. (Free tier ยท key)
  • Hunter.io: Check for e-mail addresses and names on hunter.io. (Free tier ยท key)
  • EmailRep: Search EmailRep.io for email address reputation. (Free tier ยท key)
  • EmailCrawlr: Search EmailCrawlr for email addresses and phone numbers associated with a domain. (Free tier ยท key)
  • Snov: Gather available email IDs from identified domains. (Free tier ยท key)
  • Clearbit: Check for names, addresses, domains and more based on lookups of e-mail addresses on clearbit.com. (Free tier ยท key)
  • FullContact: Gather domain and e-mail information from FullContact.com API. (Free tier ยท key)
  • NameAPI: Check whether an email is disposable. (Free tier ยท key)
  • HaveIBeenPwned: Data Breach Intelligence
  • Intelligence X: Deep Web & Archive Search
  • LeakLookup: Credential Breach Search

6. WEB TECH, COMPANY & SEARCH

  • BuiltWith: Query BuiltWith.com's Domain API for information about your target's web technology stack, e-mail addresses and more. (Free tier ยท key)
  • WhatCMS: Check web technology using WhatCMS.org API. (Free tier ยท key)
  • Bing: Obtain information from bing to identify sub-domains and links. (Free tier ยท key)
  • Bing (Shared IPs): Search Bing for hosts sharing the same IP. (Free tier ยท key)
  • Google: Obtain information from the Google Custom Search API to identify sub-domains and links. (Free tier ยท key)
  • OpenCorporates: Look up company information from OpenCorporates. (Free ยท key optional)
  • StackOverflow: Search StackOverflow for any mentions of a target domain. Returns potentially related information. (Free ยท key optional)
  • Ahmia: Search the Tor network for onion services mentioning the target. (Replaces the defunct Onion.link / "Onion City" Tor2web gateway โ€” most Tor2web services shut down after the Tor Project deprecated Tor2web in 2019.) (Free)

7. PHONE NUMBER INTELLIGENCE

  • numverify: Lookup phone number location and carrier information from numverify.com. (Free tier ยท key)
  • Twilio: Obtain information from Twilio about phone numbers. Ensure you have the Caller Name add-on installed in Twilio. (Free tier ยท key)
  • TextMagic: Obtain phone number type from TextMagic API. (Free tier ยท key)
  • NeutrinoAPI: Search NeutrinoAPI for phone location information, IP address information, and host reputation. (Free tier ยท key)
  • AbstractAPI: Look up domain, phone and IP address information from AbstractAPI. (Free ยท key optional)
  • Veriphone: Global Phone Lookup

8. SOCIAL MEDIA & IDENTITY

  • Social Media Profile Finder: Tries to discover the social media profiles for human names identified. (Free tier ยท key)

  • Blackbird: Public username/email association research; verify every identity match manually and respect site terms. (Open source)

9. CRYPTOCURRENCY & BLOCKCHAIN

  • Etherscan: Queries etherscan.io to find the balance of identified ethereum wallet addresses. (Free ยท key optional)
  • BitcoinAbuse: Check Bitcoin addresses against the bitcoinabuse.com database of suspect/malicious addresses. (Free ยท key)
  • Bitcoin Who's Who: Check for Bitcoin addresses against the Bitcoin Who's Who database of suspect/malicious addresses. (Free tier ยท key)
  • BlockCypher: Multi-chain Crypto Data

10. TORRENT, P2P & WIRELESS

  • Iknowwhatyoudownload.com: Check iknowwhatyoudownload.com for IP addresses that have been using torrents. (Free tier ยท key)
  • WiGLE: Query WiGLE to identify nearby WiFi access points. (Free ยท key)
  • OUI Master Database: Enrich observed MAC addresses with vendor prefixes; randomized/local MACs are unreliable for attribution. Use with authorized surveying. (Open source)

Related Files


Section Index | Master Index | Legal Notice


๐Ÿ“„ Source: OSINT/OSINT_TOOLS_CATALOG.md | โœ๏ธ Suggest an edit | โฌ…๏ธ Back to Open Source Intelligence (OSINT)

Clone this wiki locally