No description, website, or topics provided.
Switch branches/tags
Nothing to show
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Failed to load latest commit information.

Go Tor Crawler

It get the site list and download each site contents to a directory called "sites".

How to

  1. Start the Tor proxy:

docker run -it -p 8118:8118 -p 9050:9050 dperson/torproxy

  1. Build and start the crawler:

go get
go get
go get
go install
go-tor-crawler config.json

  1. Go make a coffee, the files will be saved in "sites" directory.