forked from typhoeus/typhoeus
Typhoeus wraps libcurl in order to make fast and reliable requests.
forked from joenorton/rubyretriever
Asynchronous Web Crawler & Scraper
forked from stewartmckee/cobweb
Web crawler with very flexible crawling options. Can either use standalone or can be used with resque to perform clustered crawls.
forked from fx/wymrails
Easy installation/integration of WYMEditor in Ruby on Rails