Skip to content
This repository has been archived by the owner on Oct 17, 2023. It is now read-only.

Latest commit

 

History

History
27 lines (15 loc) · 1.08 KB

README.md

File metadata and controls

27 lines (15 loc) · 1.08 KB

Chrome Crawler

Is a web spider extension for Google Chrome.

Description

img1

The idea is simple really. You just give it a URL, it then goes off and finds all the links on that page then follows them to more pages then gets all the links and follows them and so on and so on.

Along the way it checks each page to see if there are any ‘interesting’ files linked there, if it finds an interesting link it will flag it for you so you can check it out.

Theres an options page that lets you customise the way it all works:

img2

Get the Extension

Grab it on the Chrome Web Store: https://chrome.google.com/webstore/detail/amjiobljggbfblhmiadbhpjbjakbkldd

Blog

Find out more on my blog: