Skip to content
Find file
Fetching contributors…
Cannot retrieve contributors at this time
9 lines (6 sloc) 315 Bytes
Spider that crawls the home page of TechCrunch (http://techcrunch.com/)
Scrapy framework is used to scrape information from the homepages of TechCrunch.
Data on who posted, posters link, headline, headline link and time posted are extracted.
The data is then dumped into MySQLdb.
Checkout:
http://scrapy.org/
Something went wrong with that request. Please try again.