Skip to content
This small utility retrieves from the CommonCrawl data set unique subdomains for a given domain name.
Python
Branch: master
Clone or download
Latest commit 6325110 Jul 25, 2019
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
CCrawlDNS.py Removed debugging string Jul 25, 2019
README.md Added info Jul 25, 2019

README.md

CCrawlDNS

CommonCrawl data set subdomain extracter.

Author: Laurent Gaffie <laurent.gaffie@gmail.com > https://g-laurent.blogspot.com

Intro

CCrawlDNS is a small pentest utility that make use of the CommonCrawl data set API (petabytes of data!). This tool will make multiple queries to CommonCrawl.org and fetches all collected subdomains since 2008 related to the DNS you provided as target and will store in a DB all unique subdomains.

This tool uses multiprocessing for performance enhancement.

Usage

Running the tool:

python CCrawlDNS.py example.com

python3 CCrawlDNS.py example.com

Requirements

pip install requests
You can’t perform that action at this time.