@@ -5,7 +5,7 @@ Usage: robots = Robots.new "Some User Agent" assert robots.allowed?("http://www.yelp.com/foo") assert !robots.allowed?("http://www.yelp.com/mail?foo=bar") - robots.other_values # gets misc. key/values (i.e. sitemaps) + robots.other_values("http://foo.com") # gets misc. key/values (i.e. sitemaps) If you want caching, you're on your own. I suggest marshalling an instance of the parser. README 730bb40607a583e78bfee32a2bf7a24b95a4bb07 Kyle Maxwell kyle@kylemaxwell.com http://github.com/fizx/robots/commit/5e676b604e69650342473881f8855262bc49f183 5e676b604e69650342473881f8855262bc49f183 2008-08-10T23:32:10-07:00 2008-08-10T23:32:10-07:00 doc patch fb41282a159c261c73b3c185d716a03b4f92dfdd Kyle Maxwell kyle@kylemaxwell.com