Slybot web crawler
Pull request Compare This branch is 148 commits behind scrapy:master.
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Failed to load latest commit information.
docs
slybot
README.rst
scrapy.cfg
setup.py

README.rst

Slybot crawler

Slybot is a Python web crawler for doing web scraping. It's implemented on top of the Scrapy web crawling framework and the Scrapely extraction library.

Requirements