Skip to content

HTTPS clone URL

Subversion checkout URL

You can clone with HTTPS or Subversion.

Download ZIP
Browse files

Update README

  • Loading branch information...
commit f32124a70bef43c364d1238ccc9173ee82dccdca 1 parent c86743d
@jaimeiniesta authored
Showing with 0 additions and 2 deletions.
  1. +0 −2  README.rdoc
View
2  README.rdoc
@@ -112,9 +112,7 @@ You're welcome to fork this project and send pull requests. I want to thank spec
* Get page.base_dir from the URL
* Distinguish between external and internal links, returning page.links for all of them as found, page.external_links and page.internal_links converted to absolute URLs
-* Be able to set a timeout in seconds
* If keywords seem to be separated by blank spaces, replace them with commas
-* Mocks
* Check content type, process only HTML pages, don't try to scrape TAR files like http://ftp.ruby-lang.org/pub/ruby/ruby-1.9.1-p129.tar.bz2 or video files like http://isabel.dit.upm.es/component/option,com_docman/task,doc_download/gid,831/Itemid,74/
* Autodiscover all available meta tags
Please sign in to comment.
Something went wrong with that request. Please try again.