Skip to content

Carlos1Costa/scrapy-vault

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

12 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

scrapy-vault

Crawler to browse through The Vault https://vimm.net/vault

Please dont use it!!

I started this project because it seemed possible to check all files with MD5 within the zip file itself. But after I started, I realized that not all files contain the txt with the MD5. Well, if I were to start again, I would make the crawler to download directly from No-Intro, it would have been much faster. Eventually I will do that.

If you decide to use this crawler, please keep the throtle I setup, don't overload the guys' server. Be respectful!

About

Crawler to browse through The Vault

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published