Skip to content

Tor website crawler (specific for Alphabay at the time)

Notifications You must be signed in to change notification settings

yourmansoham/onion-crawler

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

39 Commits
 
 
 
 
 
 
 
 

Repository files navigation

Onion_Website_Parser.

@rbsteinm and I were hired in order to develop an open-source tool which purpose is to crawl a specific .onion website. It crawls the forum pages of a forum and retrieves some information to store it in a MongoDB.

In order to use it, you need to be running any Linux distribution, use python3.5, install the required libraries: pip3.5 install -r requirements.txt, install the tor browser and provide to the commandline your tor browser folder. Also, remember to fill out the parameters that you need in the credentials section of the python/crawler.py file (login, etc).

Example: ./python/crawler.py path_to/my_tor_browser/folder

About

Tor website crawler (specific for Alphabay at the time)

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Python 100.0%