Skip to content

HTTPS clone URL

Subversion checkout URL

You can clone with HTTPS or Subversion.

Download ZIP
Spider that crawls the home page of TechCrunch (http://techcrunch.com/)
Python
branch: master

Fetching latest commit…

Cannot retrieve the latest commit at this time

Failed to load latest commit information.
techCrunch
LICENSE
NOTES.txt
README.txt

README.txt

Spider that crawls the home page of TechCrunch (http://techcrunch.com/)

Scrapy framework is used to scrape information from the homepages of TechCrunch.
Data on who posted, posters link, headline, headline link and time posted are extracted.

The data is then dumped into MySQLdb.

Checkout:
    http://scrapy.org/
Something went wrong with that request. Please try again.