Skip to content

Commit

Permalink
Update README.textile
Browse files Browse the repository at this point in the history
  • Loading branch information
stewartmckee committed Nov 27, 2017
1 parent 804af69 commit de71860
Showing 1 changed file with 0 additions and 4 deletions.
4 changes: 0 additions & 4 deletions README.textile
Original file line number Diff line number Diff line change
Expand Up @@ -6,10 +6,6 @@ h1. Cobweb v1.1.0
!https://gemnasium.com/stewartmckee/cobweb.png!
!https://coveralls.io/repos/stewartmckee/cobweb/badge.png?branch=master(Coverage Status)!:https://coveralls.io/r/stewartmckee/cobweb

"
!https://app.codesponsor.io/embed/Qr2oGXuncPZ4SKa8ABiA3QZn/stewartmckee/cobweb.svg(Sponsor)!
":https://app.codesponsor.io/link/Qr2oGXuncPZ4SKa8ABiA3QZn/stewartmckee/cobweb

h2. Intro

CobWeb has three methods of running. Firstly it is a http client that allows get and head requests returning a hash of data relating to the requested resource. The second main function is to utilize this combined with the power of Resque to cluster the crawls allowing you crawl quickly. Lastly you can run the crawler with a block that uses each of the pages found in the crawl.
Expand Down

0 comments on commit de71860

Please sign in to comment.