Join GitHub today
GitHub is home to over 20 million developers working together to host and review code, manage projects, and build software together.
Fetching latest commit…
Cannot retrieve the latest commit at this time.
|Failed to load latest commit information.|
Spider that crawls the home page of TechCrunch (http://techcrunch.com/) Scrapy framework is used to scrape information from the homepages of TechCrunch. Data on who posted, posters link, headline, headline link and time posted are extracted. The data is then dumped into MySQLdb. Checkout: http://scrapy.org/