Skip to content
master
Switch branches/tags
Code

Latest commit

 

Git stats

Files

Permalink
Failed to load latest commit information.
Type
Name
Latest commit message
Commit time
 
 
 
 
 
 
 
 

Spidey: A Focused Web Crawler

A focused web crawler using Python

Web crawling is the first step in buildling a web search engine. It refers to browsing the web in a methodical, automated manner, with the aim of downloading pages to be indexed. Focused crawling is a special type of crawling wherein only pages that are related to a specific topic are crawled.

Read readme.txt and explain.txt for more details.

About

A focused web crawler using Python

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages