Skip to content

Web crawler used to measure the accessibility of popular websites requested through the I2P anonymity network.

Notifications You must be signed in to change notification settings

iiacoban42/spiderbot

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

52 Commits
 
 
 
 
 
 
 
 

Repository files navigation

spiderbot

About

Web crawling popular websites and identifying blocking behavior when accessing the Internet through the I2P network.

Run it

Create a python environment and install the dependencies with pip install -r requirements.txt
Run the spider with scrapy runspider i2p/i2p/scraper/spider.py

About

Web crawler used to measure the accessibility of popular websites requested through the I2P anonymity network.

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages