Skip to content

c-x/crawler-dns

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

1 Commit
 
 
 
 
 
 

Repository files navigation

This is a simple web crawler based on Scrapy framework for DNS Names collection with : 
- nameserverspy.com
- afnic.fr

Run it once a day using crontab and you will get a nice mongo collection with daily names registred (.com, .fr, etc)

Require :
- scrapy 0.14.1
- mongodb

Usage :
$ scrapy crawl nameserverspy 
$ scrapy crawl afnic


About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Languages