master
Spider is a Web spidering library for Ruby. It handles the robots.txt, scraping, collecting, and looping so that you can just handle the data. — Read more
http://rubyforge.org/projects/spider/
This URL has Read+Write access